Computer implemented method for interactively animating an avatar in response to real world input are provided. The avatar can be transmitted between a first user and a second user using a computer program that is executed on at least one computer in a computer network. Additionally, the first user and the second user each interact using a respective computing system that is at least partially executing the computer program. The method is initiated by identifying components of the avatar representing the first user that can be modified using real-time effects. The method continues by the computing system identifying controller input from either the first user or the second user. The identification of the controller input is used to determine which of the identified components of the avatar representing the first user will be modified. In response to the identified controller input the real-time effects are applied to the identified components of the avatar that represent the first user. The avatar of the first user augmented to reflect the application of the real-time effects. In another operation, the method displays the augmented avatar of the first user on a screen connected to the computing system of one or both of the first and second users.