A method and an apparatus for constructing a three-dimensional channel, and a non-transitory computer-readable recording medium are provided. In the method, a depth image corresponding to a first panoramic image is generated. Then, channel object detection is performed on the first panoramic image to obtain channel object boxes in the first panoramic image. Each of the channel object boxes is four annularly interconnected arc-shaped sides, and each of the arc-shaped sides is a circular arc of a great circle. Then, a three-dimensional point cloud of a channel object in the first panoramic image is generated based on the first panoramic image, the channel object boxes and the depth image.