Disclosed are a device and a method of hand tracking based on a tailored illumination profile. In some embodiments, the hand tracking device includes an illumination module, an imaging sensor and a processor. The illumination module provides an illumination profile that matches a predicted interaction volume within which a user of the near-eye display device is expected to place a body part of the user to interact with a user interface of the near-eye display device. The imaging sensor receives light reflected by an environment of the near-eye display device including the body part of the user and generates depth values corresponding to depths of the environment relative to the near-eye display device. The processor tracks a location of the body part of the user based on the depth values and determines an adjustment of an illumination intensity of the illumination module based on the location of the body part of the user.