A fuel deck for on-board storage and delivery of gaseous fuel for a locomotive. The fuel deck is formed between the engine deck and the trucks of the locomotive. The fuel deck includes a base for riding on the trucks, a ceiling configured to separate the fuel deck from the engine deck, and one or more support structures extending between the base and the ceiling. The support structures are configured to support the load from the engine deck, and separate the base from the ceiling to form a fuel storage compartment that is adapted to store one or more fuel tanks that contain the gaseous fuel. A fuel system including one or more fuel tanks is also provided, where each fuel tank may have more than one inlet/outlet port for enabling faster refilling or distribution of the gaseous fuel, among other considerations.