Some embodiments provide a method for managing a set of forwarding elements. The method receives configuration information for a set of gateways specifying (i) multiple gateways for implementing logical router ports and (ii) a ranking order of the gateways in the set. The method configures a first gateway in the ranking order as a master gateway for the set of gateways. Upon receiving a first notification that the first gateway is not operational, the method configures a second gateway in the ranking order as the master gateway for the set of gateways. Upon receiving a second, subsequent notification that the first gateway has resumed operation, the method maintains the second gateway in the ranking order as the master gateway for the set of gateways and configures the first gateway in the ranking order as a first standby gateway.