There is provided a work data management system which includes a detailed step classification unit that classifies work performed by a worker at a work site into a plurality of time-series detailed steps based on work data including image data of the work site and a data visualization unit that causes a result display unit to display at least the image data and the plurality of time-series detailed steps.