A laser-sustained plasma light source for transverse plasma pumping includes a pump source configured to generate pumping illumination, one or more illumination optical elements and a gas containment structure configured to contain a volume of gas. The one or more illumination optical elements are configured to sustain a plasma within the volume of gas of the gas containment structure by directing pump illumination along a pump path to one or more focal spots within the volume of gas. The one or more collection optical elements are configured to collect broadband radiation emitted by the plasma along a collection path. Further, the illumination optical elements are configured to define the pump path such that pump illumination impinges the plasma along a direction transverse to a direction of propagation of the emitted broadband light of the collection path such that the pump illumination is substantially decoupled from the emitted broadband radiation.