A method for hierarchical occupancy based congestion management includes receiving, by a computing device, a plurality of data flows, each of the plurality of data flows is received from a source and includes a plurality of data packets and storing the plurality of data packets in a buffer including multiple storage units. The method includes determining if the buffer is congested, responsive to determining the buffer is congested randomly selecting at least two occupied units of the buffer and identifying a source of each of the data packets stored in the occupied units of the buffer and generating a congestion notification message. The method also includes comparing a selection criterion associated with each identified source to determine which identified source has a higher selection criterion and sending the congestion notification message to the identified source with the higher selection criterion.