A system and method for controlling an electronic gaming machine (“EGM”) from a mobile device during a remote access play session. The EGM is switched between a local access mode in which the inputs on the EGM are active and a remote access mode in which the inputs on the EGM are de-activated and a player interfaces the EGM using a mobile device such as a smartphone or a tablet computer. During remote access play sessions, all critical game play operations continue to be performed exclusively on the EGM and not on the mobile device. Critical game play operations include random number generation and determination of game outcome. Game content, including video, screenshot images and audio of the game are transmitted to the mobile device for display to the player. Player input and selections are made on the mobile device.