A semantic labeling apparatus and method thereof include a place identifier processor configured to, based on location data of a user, generate place attributes of places that indicate information of a user visit for each place, wherein user location remains unchanged within the places for a predetermined period of time. A group identifier processor is configured to cluster the places based on the place attributes, classify the places into groups, acquire a semantic label for each of the groups, and designate the acquired semantic label as the semantic label of each of the groups. A label determiner is configured to determine the semantic label of each of the groups as a semantic label of each member place of each of the groups.