A depth sculpturing system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. The depth sculpturing system further includes a user input device. Execution of programming by a processor configures the depth sculpturing system to perform functions to track, via the user input device, motion of a two-dimensional input selection from an initial touch point to a final touch point. The depth sculpturing system determines a rotation matrix between an initial ray and a final ray that project to the initial touch point and the final touch point, correspondingly. The depth sculpturing system generates a depth sculptured image by applying the rotation matrix to vertices of an initial depth image. The depth sculpturing system presents, via an image display, the depth sculptured image.