An optical tracking system comprises an array of point source emitters that output respective optical emissions, and a plurality of angle of arrival sensors. Each sensor comprises one or more optical elements and a focal plane array (FPA), with the optical elements arranged to resolve the optical emissions into one or more linear patterns on the FPA. A processing system in communication with the sensors establishes the orientation and position of each of the optical emitters using the linear patterns. A headgear tracking system employs point source emitters on a piece of headgear, with front and rear arrays of angle of arrival sensors located in an aircraft cockpit; a processing system in communication with the sensor arrays establishes an orientation and position for each of the optical emitters on the headgear.