A software application and system that enables point-and-click interaction with a TV screen. The application determines geocode positioning information for a handheld device, and uses that data to create a virtual pointer for a television display or interactive device. Some embodiments utilize motion sensing and touchscreen input for gesture recognition interacting with video content or interactive device. Motion sensing can be coupled with positioning or localization techniques the user to calibrate the location of the interactive devices and the user location to establish and maintain virtual pointer connection relationships. The system may utilize wireless network infrastructure and cloud-based calculation and storage of position and orientation values to enable the handheld device in the TV viewing area to replace or surpass the functionality of the traditional TV remote control, and also interface directly with visual feedback on the TV screen.