An operation management system includes an authentication system and a control system. The authentication system includes a first terminal identification information reception unit that receives terminal identification information from an operation portable terminal device as the terminal device enters an authentication zone, and a terminal identification information transmission unit that transmits the identification information to the control system. The control system includes a second terminal identification information reception unit that receives the identification information from the terminal identification information transmission unit, a first terminal identification information storage unit that stores the identification information, a third terminal identification information reception unit that receives the identification information from the terminal device, and a permission unit that permits operation of the control system by the terminal device as the identification information received by the third terminal identification information reception unit is stored in the first terminal identification information storage unit.