The present disclosure provides an optical tag-based information apparatus interaction method and system. The method includes: using a terminal device to perform image acquisition on an optical tag at a relative fixed position to an information apparatus so as to determine a position and an attitude of the terminal device relative to the optical tag; determining, in conjunction with a predetermined position of each information apparatus relative to the optical tag, the position of the terminal device relative to each information apparatus; acquiring an imaging position of each information apparatus on a display screen of the terminal device, and displaying an interactive interface of each information apparatus at the imaging position thereof on the display screen, such that an interactive operation can be performed on each information apparatus. The disclosure allows a user to control an information apparatus in a field of view anytime and anywhere, and interact with the device as What You See Is What You Get (WYSIWYG).