A M×N wavelength selective switch (WSS) module capable of independently routing any wavelength channel from any input port to any output port is provided. The M×N WSS includes a first beam relayer including first and second elements having optical power, each of which is disposed such that light transmitted to or from a first plurality of ports passes through a common point. The M×N WSS also includes a wavelength dispersive element, a first switching array having M rows including K switching elements, a second beam relayer, and a second switching array including N switching elements. The second switching array includes an optical by-pass disposed at the common point, which provides means for separating the input and output beams of light, and which allows both the input and output optical beams to traverse similar paths throughout the optical train.