A social engagement system includes a first exercise machine having a display able to present videos, a three-dimensional camera system, and local processing system able to provide pose estimation based on data from the three-dimensional camera system. The system also includes a communication module for connection to a cloud processing system, with the cloud processing system supporting connection to a second exercise machine having a display able to present videos, a three-dimensional camera system, and local processing system able to provide pose estimation based on data from the three-dimensional camera system. Additionally, the connection allows transfer of data useful for social engagement.