Provided are a computer program product, system, and method for distributed global data vaulting in a grid of server computers. At each of the server computers, it is determined that there is a system shutdown. For each data element at that server computer, a list of one or more vault devices at other server computers is retrieved from a vault distribution table, and the data element is dumped to the one or more vault devices at the other server computers.