A game controller has first and second controller housings having an attachment guide structure that detachably couples to an attachment tab structure disposed on opposing sides of an information handling system and a bridge. Input devices of the controller housing communicate directly with the information handling system through opposing pins and pads disposed in the attachment features or indirectly by communicating with the bridge through opposing pins and pads so the bridge communicates with the information handling system. The attachment guide structure has opposing lips with plural slots that pass tabs of the attachment tab structure through so that a sliding motion engages the tabs behind the lips. Magnets of opposing polarity repel attachment attempts when a game controller attempts to attach to an opposite side of an information handling system or bridge housing from that which the game controller is intended to attach, such as a left side controller attached to a right side of a bridge or information handling system.