A control device for controlling a controlled system, such as steering, braking or accelerating when driving a car, as well other operations for other vehicles or systems, includes an automatic control system that generates automatically generated control signals, a haptic control command input device generates manual control command inputs, and an arbitration unit which resolves disputes between the automatically generated signals and the manual control command inputs. The haptic control generates control signals that depend on both the automatically generated control signals and the manual control command inputs, and adjustments are made continuously therebetween using rule based feed back control signals. Arbitration is performed in the dead spaced of the controlled system or the haptic control command input device.