A retractable speaker structure for use in a vehicle is provided. The retractable speaker structure includes: a case formed with a chamber; a driving member installed in the chamber and including a stepping motor and a transmission shaft connected to the stepping motor; a retracting mechanism disposed in the chamber and including a screw rod and a retractable rod fitted with the screw rod. The screw rod is driven by the transmission shaft to rotate, thereby enabling the retractable rod to perform a protruding/retracting movement relative to the screw rod; and a speaker secured at an end section of the retractable rod and moved with the retractable rod. Accordingly, the retractable speaker structure is able to be adjusted for being protruded or retracted according to the actual needs, thereby effectively simplifying components and lowering production cost.