A method for removing sulfur containing dust particles from particulate material exiting a material preheater in which the particulate material is heated by kiln off gases may include a number of steps. Off gases from the kiln are directed through a gas conduit to the preheater to preheat particulate material traveling through the preheater in a direction countercurrent to the direction of off gas flow through the preheater. Material exiting the preheater is directed to a material bypass conduit that is separated from the gas conduit and is flow connected to a material inlet to the kiln. A stripping gas is directed through the conduit to entrain dust particles in the preheated material and to carry said dust particles away from the preheated material.