A woven fabric with a color glitter effect is woven from plurality A directional yarn sets and B directional yarn sets perpendicular the A directional yarns, wherein each A directional yarn set includes at least one yarn, a shrinkage of which is more than 3%, and the at least one yarn at least contains two successive organizing points for a downward arrangement when it is woven, such that each B directional yarn set is compressed to form a convex structure and has at least two yarns with different colors, a central level position of one of the at least two yarns of a peak portion of the convex structure, at which the B directional yarn set is located, is higher than a top level position of a lowest yarn of a valley portion of a concave structure, at which the B directional yarn set is located.