Systems and processes for user identification using headphones associated with a first device are provided. For example, first movement information corresponding to movement of a second electronic device is detected. Second movement information corresponding to movement of a third electronic device is detected. A similarity score is determined based on the first movement information and the second movement information. In accordance with a determination that the similarity score is above a threshold similarity score, a user is identified as an authorized user of the first electronic device and the second electronic device. Based on the identification, an output is provided to the second electronic device.