An oil seal structure includes: a bearing unit for a shaft, being provided in a housing hole of a bearing housing; a damper positioned outside the bearing unit in a radial direction of the shaft to absorb vibration of the shaft; a seal body portion facing the damper through a gap in an axial direction of the shaft; a partition wall positioned between the damper and the seal body portion to divide the gap into a first space on the damper side and a second space on the seal body portion side; and a guide portion provided in the partition wall to be closer to an oil drain port than the shaft and having: an inner side in the radial direction of the shaft, being positioned on the first space side; and an outer side in the radial direction of the shaft, being positioned on the second space side.