An inertial drive actuator includes a displacement unit, a vibration substrate, a movable body, a first magnetic field generator which generates a magnetic field so that, a magnetic attractive force or a magnetic repulsive force acts in a direction opposite to the movable body, a first yoke, and which induces a magnetic flux generated by the first magnetic field generator such that, the flux generated by the first magnetic field generator is concentrated on a surface of the movable body, opposite to the vibration substrate, and second yokes and on a side of the vibration substrate, opposite to a direction facing the movable body, and the second yokes and control a frictional force acting between the movable body and the vibration substrate by controlling the magnetic field generated by the first magnetic field generator.