An ink set includes a combination of a first ink and a second ink, the first ink containing a self-dispersion pigment having at least one hydrophilic group directly or through another atomic group bonded to the surface of the pigment particle, and ammonium ions, the second ink containing a pigment, a polymer having an acid value of 160 mg KOH/g or less, and alkali metal ions, wherein the first ink further contains a compound (A) selected from nonionic surfactants and/or a compound (B) selected from the group consisting of polyethylene glycol with an average molecular weight of 600 to 2,000, α,ω-alkanediol having six carbon atoms, and an imidazolidinone derivative.