A system, method and program product for providing automated learning for a people counting system. A system is disclosed that includes a grid system for dividing a field of view (FOV) of a captured image data into a set of blocks; an object detection and tracking system for tracking a blob passing through the FOV; and a learning system that maintains person size parameters for each block and updates person size parameters for a selected block when a blob appears in the selected block.