The invention provides an image processing method and device and a recognition and tracking system. The system comprises an image acquisition device and a visual interaction device with a marker. Markers of the visual interaction device are distributed on one surface or a plurality of surfaces. The method comprises the steps of obtaining a target image with a marker; confirming identity information of a marker in the target image; according to the marker information of the target image and the identity information of the marker, determining a tracking method adopted by a visual interaction device corresponding to the marker; and according to a corresponding tracking method, acquiring attitude information between the visual interaction device and the image acquisition device.