A method and apparatus for capturing touchless inputs and controlling an electronic device with the same are described. In one embodiment, the method for controlling a user interface of software on a portable electronic device, the method comprising: obtaining one or more touchless inputs by capturing movements of the portable electronic device resulting from one or more hand gestures made by a hand holding the portable electronic device; determining one or more operations to control the user interface being displayed on a display of the portable electronic device based on the one or more touchless inputs; and controlling the software using at least one of the one or more operations.