An emergency egress system with an access panel assembly, a latch assembly, a handle assembly, a fixed ladder portion, and a slidable ladder portion, is disclosed. The access panel assembly includes a door panel. The latch assembly and the handle assembly are attached to the door panel. The handle assembly has a holding portion that works in conjunction with the latch assembly that has a wing portion. The holding portion is manipulable to rotate the latch assembly in the locked position to hold the fixed ladder portion and the slidable ladder portion together via the wing portion, which is to maintain the door panel in the closed position. The holding portion is manipulable to rotate the latch assembly to the unlocked position to allow the wing portion to rotate and release the slidable ladder portion for exit.