A method of recovering a defect portion of a resist pattern formed on a substrate including applying a shrinking agent composition so as to cover the resist pattern having the defect portion; forming a developing solution-insoluble region on the surface of the resist pattern; and developing the covered resist pattern, the shrinking agent composition including a polymeric compound (X) which is a homopolymer or a random copolymer.