A panoramic camera system is disclosed that includes an unified optical system, an image capture device, and a processing unit. The unified optical system may include a first set of lenses that guide images received from horizontal directions of a target scene that surrounds the unified optical system. The unified optical system may also include a deflecting device that deflects the images guided through the first set of lenses and a second set of lenses that projects the images deflected by the deflecting device. The image capture device collects the projected images into a determined pattern based on the second set of lenses. Moreover, the processing unit processes the collected images from the image capture device to generate at least one of image signals and video signals representing a panoramic rendition of the target scene.