In one embodiment, a method includes accessing a log associated with a user. The log includes a number of entries that each indicate a geo-location of the user at a point in time. The log spans a period of time and some of the entries are based on a geo-location determined and reported by a mobile computing device of the user without manual user input. The method also includes determining a pattern among the geo-locations of the user at the points in time; and determining for some of the geo-locations of the user at the points in time, a place corresponding to the geo-location; and inferring by the computing device a routine of the user based at least in part the pattern and the places.