A rinse-off type hair cosmetic composition containing the following ingredients: (A) from 1 to 10 wt % of a higher alcohol having from 12 to 28 carbon atoms, (B) a quaternary ammonium salt represented by the following formula (1) or a tertiary amine type compound represented by the following formula (2) or salt thereof, (C) from 15 to 70 wt % of a polyhydric alcohol, and (D) from 0.01 to 10 wt % of a dimethylpolysiloxane. The content ratio of the ingredient (A) to the ingredient (B) is from 1:1 to 10:1 in terms of molar ratio. As a method for preventing colored hair from fading, the hair cosmetic composition is used before or after shampooing the colored hair. The hair cosmetic composition can inhibit the bleeding of a colorant from colored hair upon shampooing, and is also excellent in the smoothness of the hair upon applying the composition and also upon rinsing it off.