Apparatus and method for eliminating noise in stereo image are disclosed, the method according to an exemplary embodiment of the present invention comprising, obtaining a first image captured by a first sensor unit and a second imaged captured by a second sensor unit; calculating a pixel difference of the second image relative to a first image based on a predetermined reference point; determining a pixel amount of the second image to be calibrated using a reference pixel difference and the pixel difference; and generating a driving signal for driving an Optical Image Stabilizer (OIS) actuator using the pixel amount to be calibrated.