A motion capture system includes a wearable device (e.g. a glove) suitable for being worn by a user and including one or more markers having respective colors. A video camera acquires a sequence of color frames of the user moving while wearing the glove, while a range camera acquires corresponding depth frames of the same scene. A processing unit processes both color frames and depth frames for reconstructing the 3D positions of the markers. In particular, the depth information provided by the depth frames are used for isolating a validity area within the color frames, and the markers are searched based on their colors, exclusively within the validity area of the color frames. The movements of the user are then captured as a sequence of positions of the markers. Combined use of color information and depth information provide a very reliable and accurate motion capture.