A varifocal head mounted display (HMD) includes an electronic display, an optical system, and the guidance system. The electronic display presents content. The optical system includes one or more optical elements and provides the content to an eyebox of the HMD. The guidance system is a flexure based guidance system that includes an actuator and a first and second flexure elements (e.g., parallel beam, dual Roberts, etc.) guiding movement of the electronic display along an optical axis of the optical system in order to adjust a location of one or moveable elements in the optical system and, thereby, control a location of an image plane. The first and second flexure elements are able to flex or bend with movement of the actuator to adjust the location of the one or moveable elements that includes the electronic display and/or one or more optical elements of the optical system.