A hydrogen production apparatus including a desulfurizer, a reformer, a CO transformer a gas flow path, and a purge gas supply path which is provided where a purge gas is supplied to an upstream side of a pressure feeding apparatus in the gas flow path, prior to a stopping operation, a purging step of replacing gas within the gas flow path with the purge gas and filling the purge gas into the gas flow path is performed, and in a start-up operation in which a heating means is operated to increase the temperature of the gas within the gas flow path, which is performed prior to a hydrogen purification operation, a pressure increasing step of supplying the purge gas from the purge gas supply path to the closed circulation circuit and increasing the pressure within the closed circulation circuit is performed.