An apparatus for detecting multiple objects using adaptive block partitioning is disclosed. An object contour extracting unit configured to extract a contour information of an object using a local binary pattern LBP and difference image between adjacent images. An adaptive block partitioning unit configured to perform a block partitioning of an object not overlapped based on the extracted contour information. A motion quantization unit configured to calculate a motion orientation histogram MOH of the object by performing N-directional quantization about a motion vector. An object detection unit configured to detect the object using a block of the partitioned object, the contour information and the MOH, and estimate a moving direction of the object after performing labeling the detected object. The apparatus may process effectively data through eight-directional quantization of a motion vector of an object using motion information provided in advance from an ISP chip, detect proper area of the object in the unit of a block with minimizing motion error of the object through the block with adaptive size and orientation histogram, and estimate simultaneously moving direction of the object with the detection of the object.