An information handling system includes a wireless management controller having a first wireless network interface used to establish a secure short-range wireless network connection between a management controller and a mobile device. A second wireless network interface establishes a peer-to-peer wireless network connection between the management controller and the mobile device. The management controller stores a secure shell public key received from the mobile device through the secure short-range wireless network connection. The management controller randomly identifies a port number for the peer-to-peer wireless network connection, and disables network traffic through other ports associated with the peer-to-peer wireless network connection. The management controller also transmits a media access control address, the port number, and a host fingerprint to the mobile device through the secure short-range wireless network connection, and receives an access request from the mobile device on the port number of the peer-to-peer wireless network connection after the mobile device authenticated the media access control address and the host fingerprint Determining whether the mobile device is authentic through a secure shell negotiation based on the received secure shell public key. In response to the determination that the mobile device is authentic identifying a group owner of the peer-to-peer wireless network connection based on a negotiation with the mobile device. After the establishment of the peer-to-peer wireless network connection, the management controller may communicate packets with the mobile device on the port number of the peer-to-peer wireless network connection, where outbound packets are encrypted and inbound packets are decrypted.