A neutron detector system, with a detector having a pair of spaced diamond detector layers, sandwiched between outer silicon layers. In response to incident neutrons, the detector system measures pulse heights and response times, and from those measurements, calculates the carbon recoil energy and time of flight of scattered neutrons. This data is further used to calculate a “direction cone”, which represents the approximate angle of arrival of the incident neutron. These direction cones can be used to image neutron events.