A self-propelled device can include at least a wireless interface, a housing, a propulsion mechanism, and a camera. Using the camera, the self-propelled device can generate a video feed and transmit the video feed to a controller device via the wireless interface. The self-propelled device can receive an input from the controller device indicating an object or location in the video feed. In response to the input, the self-propelled device can initiate an autonomous mode to autonomously operate the propulsion mechanism to propel the self-propelled device towards the object or location indicated in the video feed.