Technologies are described herein for dynamically remapping components of a virtual skeleton to enhance the control and appearance of an avatar. Embodiments disclosed herein may remap components of the virtual skeleton if a need for an enhancement, replacement or correction is identified. For example, one or more components of a virtual skeleton, e.g., a joint, hand, arm or leg, may be remapped with modeled components if the component is distorted, missing or incomplete. Components of a virtual skeleton may be remapped with modeled components if enhancements, augmentations, corrections or special effects are desired. A remapped skeleton defining one or more modeled components may be generated from model data. The remapped skeleton may be used to drive user-controlled animations having enhanced movement and appearance characteristics. In addition to driving user-controlled animations, the remapped skeleton may be used to drive robotic devices.