A phosphate solution for a zinc or zinc-based alloy plated steel sheet, and a zinc or zinc-based alloy plated steel sheet using the same are provided. The phosphate solution for a zinc or zinc-based alloy plated steel sheet contains a molybdenum (Mo) ion, a calcium (Ca) ion and a phosphate ion. A zinc or zinc-based alloy plated steel sheet includes a base steel sheet, a zinc-based or zinc alloy-based plating layer formed on the base steel sheet, and a phosphate film formed on the zinc-based or zinc alloy-based plating layer. The phosphate film contains a molybdenum compound, Ca and a phosphate. A pitting phenomenon occurring at the time of treating a steel sheet with a phosphate is prevented, and excellent corrosion resistance is exhibited on a phosphate film.