An apparatus for motion estimation which supports multiple video compression standards and the method thereof is provided. The apparatus uses an interpolation filter with fixed coefficients. The apparatus also adjusts block sizes and calculation details of cost functions according to various video compression standards. Therefore the apparatus is capable of supporting multiple standards and providing high-quality video compression.