Catalysts and processes for forming catalysts for use in hydrogenating acetic acid to form ethanol. In one embodiment, the catalyst comprises a first metal, a silicaceous support, and at least one metasilicate support modifier. Preferably, the first metal is selected from the group consisting of copper, iron, cobalt, nickel, ruthenium, rhodium, palladium, osmium, iridium, platinum, titanium, zinc, chromium, rhenium, molybdenum, and tungsten. In addition the catalyst may comprise a second metal preferably selected from the group consisting of copper, molybdenum, tin, chromium, iron, cobalt, vanadium, tungsten, palladium, platinum, lanthanum, cerium, manganese, ruthenium, rhenium, gold, and nickel.