The disclosure provides methods and systems for spatially remote controlling a network controllable device in a physical user environment. An exemplary method may include tracking, by a processor, a position and orientation of a remote control device based on sensor data. The sensors may be one or more of a gyroscope, accelerometer, and a magnetometer. Based on the tracking, a ray extending from the remote control device in a direction the remote control device is pointing is determined. The determined ray is compared to a predefined map, the predefined map including a spatial location associated with each of one or more network controllable devices. The method may include, based on the comparing, selecting a network controllable device of the one or more network controllable devices corresponding to the determined ray. In response to receiving a user input, a control signal is then transmitted to the selected network controllable device.