A hybrid connected component labeling process for analyzing digitized or binary images includes the following steps. Firstly, a forward scan is executed to assign a forward label to each foreground pixel in the image. Then, a backward scan is executed to assign a backward label to each foreground. The backward labels are rearranged and label connection is recorded. A label allocation table including final labels and reference labels is provided for recording the use of the labels. When an object is considered as noise, the label corresponds to the pixels of the object is released by updating the label allocation table.