The invention relates to the technical field of robots, and particularly relates to a system and a method of automatically photographing a panoramic photograph. The system for automatically photographing a panoramic photograph is used for a robot system, and comprises a speech recognition unit, a control unit, a moving unit and an image capturing unit, wherein the speech recognition unit is used for recognizing instruction information in speech information, and the instruction information at least comprises a photographing instruction and photographing track information; the control unit is connected with the speech recognition unit for receiving the instruction information and generating a control signal to control a corresponding device to act; the moving unit is connected with the control unit and moves to an ending position from a starting position along the photographing track under effects of the control unit; and the image capturing unit is arranged on the moving unit and moves along with the moving unit, and the image capturing unit is connected with the control unit for capturing an image under effects of the control unit. The panoramic photograph can be automatically photographed when the user issues a panoramic photograph photographing instruction, the technical problem of automatically photographing the panoramic photograph is solved, the panoramic photograph photographing is simpler, and the spliced panoramic photograph has better effects.