An exterior door handle assembly for a vehicle door includes a strap-handle portion pivotally movable to open the vehicle door. A self-contained elongated module includes (i) an elongated housing, (ii) an elongated light-transmitting cover and (iii) a light pipe. The strap-handle portion receives the self-contained elongated module. At least one light emitting diode is disposed proximate an end region of the strap-handle portion. With the door handle assembly mounted at a vehicle door and when the light emitting diode is electrically powered, light emitted by the light emitting diode passes along the light pipe and through the elongated light-transmitting cover so as to be viewable by a person viewing the exterior door handle assembly from outside of the vehicle door.