A remote control based on user's gesture includes an infrared emission unit, a storage unit, a gesture sensing unit, a processing unit and a code chip. The gesture sensing unit is configured to capture images and identify hand gestures in the images and output the gesture signals corresponding to the hand gestures to the processing unit; The storage unit stores a first relationship table of gesture signals and associated function instructions. The storage unit also stores a second relationship table of the function instructions and associated infrared remote control codes. The processing unit parses the gesture signal into the corresponding function instruction according to the first relationship table, and then outputs the function instruction to the encode chip, the encode chip chooses an infrared remote control code according to the function instruction and the second relationship table and drives the infrared emission unit to emit infrared rays carrying the infrared remote control code to the device.