A color wheel module for an image display device prevents the motor from being damaged during balancing processes. The color wheel module includes a spindle, a motor, a carrier, a connection ring and a color wheel. The motor drives the spindle to rotate. The carrier is mounted onto the spindle and is driven by the spindle for rotation. The color wheel includes a plurality of color filters bonded onto the connection ring, and then the bonded color filters and the connection ring are mounted onto the carrier. Thus balancing of the color wheel may be done before it is mounted on the carrier to avoid damaging the spindle and the motor resulting from adding or removing substance during the balancing process.