A hydraulic auto-tensioner includes a cylinder with a sleeve fitting hole, and a sleeve press-fitted therein. A rod has its bottom end slidable in the sleeve. A return spring is mounted between a spring seat at an upper portion of the rod and a bottom surface of the cylinder. An oil passage, with a check valve, is formed between the fitting surfaces of the sleeve fitting hole and the sleeve and communicates the pressure chamber with the reservoir chamber. The rod has a valve fitting hole open to its bottom surface, and an oil passage communicating the valve fitting hole with the reservoir chamber. A relief valve, mounted in the valve fitting hole, includes a valve seat with a valve hole having an orifice for restricting the flow rate of oil released from the pressure chamber into the reservoir chamber through the oil passage when the relief valve opens.