Methods of interpreting user actions for controlling electronic devices, as well as apparatuses and systems implementing the methods. User actions can involve eyes, head, face, fingers, hands, arms, other body parts, as well as facial, verbal and/or mental actions. Hand and/or voice free control of devices. Methods for large as well as fine motion and placement of objects. Use of actions before and during other actions to confirm the intent of the other actions. Objects can be moved or warped based on combinations of actions. Measurement of eye gaze, and iterations and helper signals for improved accuracy of control. Triggers to start and end recognition of user actions and generation of device commands.