The invention relates to a process for modifying polymer particles of an aqueous polymer dispersion in which positively or negatively charged polymer particles are provided with an inorganic salt shell. The inorganic shell leads to an improved drying ability and storage stability of the latex and improves the storage stability of the resulting polymer powder. The obtained polymer powder exhibits an improved viscosity and faster skin-forming time in the final application and is therefore particularly useful in a building material composition.