An optical connector includes: a ferrule that has a brim part; an elastic member that presses the ferrule; a housing that houses the ferrule retractably, and the housing has a protrusion that contacts the brim part of the ferrule, which is pressed by the elastic member in which the protrusion prevents the ferrule from falling out forward; and a regulating part that regulates a rear side limiting position of the ferrule. An interval from a position of the ferrule to the rear side limiting position when the connector is connected is smaller than a retraction amount that the ferrule has retracted when the connector is connected.