A manipulation device has a manipulation body operated by the manipulator in a manipulation direction, a support body freely supporting the operation of the manipulation body, and a movable load imparting mechanism imparting a load to the manipulation body. The movable load imparting mechanism has a movable member engaged with the movable axis of the manipulation body, a magnetism generating mechanism having a coil that generates a magnetic field and a first yoke provided so as to enclose the coil, and a magnetic viscous fluid, its viscosity changing according to the strength of a magnetic field. The magnetic viscous fluid is filled in a first gap between the first yoke and the movable member. In the gap, a first buffering layer not harder than the movable member is provided on at least one of the opposing plane of the first yoke and the opposing plane of the movable member.