An anti-shake auto-focus modular structure includes an image sensor, an auto-focus module for driving a lens to focus captured image on the image sensor; a plurality of suspension wires for suspending the auto-focus module at a position perpendicular to a light entering direction (z-axis), so that the auto-focus module is movable in an x-axis or a y-axis direction; a deviation compensation magnet assembly including at least one x-axis magnet and at least one y-axis magnet; a deviation compensation assembly including at least one x-axis driving winding and at least one y-axis driving winding corresponding to the x-axis magnet and the y-axis magnet, respectively, for producing an electromagnetic field each to drive the x-axis or the y-axis magnet and accordingly the auto-focus module to move in the x-axis or the y-axis direction for compensating a positional deviation of the auto-focus module in the x-axis or the y-axis direction.