A lens movement control method and a lens movement control apparatus of a camera module for preventing allophone of a Voice Coil Actuator (VCA) are provided. The lens movement control method of a camera module includes switching the camera module from a camera operation mode to a camera stop mode, generating a control signal for removing the occurrence of VCA allophone in the camera stop mode, moving a lens to a VCA allophone removal location based on the generated control signal, and powering-off the camera module to move the lens moved to the VCA allophone removal location to a bottom surface of the lens.