Techniques for determining a status of a user are described. A mobile device equipped with sensors may collect sensor data pertaining to transportation modes of the user, tracking locations of the user, identifying environmental noise levels surrounding the user, or speech being spoken in proximity to the user. Features of the collected sensor readings are then used to infer activities the user may be performing. Based at least in part on the multiple inferred activities, a status of the user is determined.