Examples described herein generally relate to a system for monitoring workers in a retail environment. The system may include a plurality of cameras located in different regions of the retail location and configured to capture a video feed of a respective region. The system may include a computer system comprising a memory storing computer executable instructions. The system may provide a video feed of at least one region of the retail environment to a machine learning classifier, the machine learning classifier trained on labeled videos, to classify a sequence of images of a worker into a probability certainty of an activity being performed by the worker. The processor may determine, based on the probability certainties generated by the machine learning classifier over a period of time, an activity schedule of the worker. The system may determine labor productivity statistics based on the activity schedule.