A system and method is disclosed determining caloric burn via an HCI system. Using a capture device which is able to detect the thickness of a user's arms, legs, torso, etc., the system determines a mass for each of a user's body parts. Thereafter, in one example, the system measures caloric burn for a given body part as a function of how far the body part was displaced, a mass of the body part displaced and gravity.