A handheld electronic apparatus, a remote control method, a home appliance system and a home appliance apparatus are disclosed. The handheld electronic apparatus comprises a network module, an orientation sensor, a touch display and a processor. The network module receives a broadcast packet, which comprises a home appliance orientation and a controllable function of the home appliance apparatus and is outputted from the home appliance apparatus. The orientation sensor provides the remote control orientation of the handheld electronic apparatus. The processor relates the controllable function to a touch gesture of the touch display, and determines whether the home appliance apparatus is a controlled apparatus according to the home appliance orientation and the remote control orientation. When the home appliance apparatus is the controlled apparatus, and the touch display receives the touch gesture, the remote control home appliance apparatus executes the controllable function.