A system and method of tracking a user input device such as a game controller includes emitting light from multiple light sources in the user input device. The multiple light sources having a known spacing relative to each other on the user input device and at least some of the multiple light sources are capable of emitting light through a inside surface and an outside surface of the user input device. The multiple light sources can define a plane of the user input device that can be used to track the movement, location and orientation of the user input device. The user device is tracked using image data from a camera. The image data is communicated to a computer where the image data is processed to identify the movement, location and orientation of the user input device.