The described implementations relate to processing of an environment using a plurality of sub-volumes, and specifically to generating surface representations in the plurality of sub-volumes for individual processing. One example can identify planar fragments within the plurality of sub-volumes. The example can determine that various planar fragments constitute part of a contiguous planar surface and should be aggregated. The example can also output data representing the contiguous planar surface formed from the aggregated planar fragments.