A scanning display system includes smart infrared pulsing to detect gestures and touch events with reduced power consumption. Infrared laser light pulses are emitted at a first density in a field of view and reflections are detected. Times of flight of the infrared laser light pulses are measured to determine if an object is in the field of view. The density of the infrared pulses may be increased based on various factors to detect gestures and touch events. Power consumption is reduced by reducing the density of laser pulses when possible.