A continuous process for producing hemicellulose sugars from a biomass extraction liquor is provided. A system is configured for continuously producing hemicellulose sugars and/or hemicellulose derivatives from a biomass extraction liquor, the system comprising at least a first hydrolysis reactor and a second hydrolysis reactor. Each of the hydrolysis reactors is in switchable communication with (i) an operating feed stream of a biomass extraction liquor containing water, hemicellulose oligomers, and dissolved or suspended lignin, and (ii) a cleaning feed stream of a cleaning agent selected from the group consisting of steam, an alkaline solution, an organic solvent, and combinations thereof. The cleaning agent dissolves precipitated lignin formed from the lignin under the hydrolysis reaction conditions.