An intelligent thermostat control system for a building, such as a residential home, that automatically adjusts a thermostat setting in the home based on real-time data continually received from mobile devices and/or social media files associated with the residents. This allows the thermostat controller to override the explicit programmed settings with implicit settings based on activity analysis taking the actual locations and schedules of the residents into account. The intelligent thermostat controller may control different zones differently to take into account the schedules and locations of specific residents associated with specific zones. The temperature controller may also adaptively learn a number of parameters based on monitored data, such as travel times and heating/cooling times for the zones based, to determine times for adjusting the thermostats.