A human body portion tracking method is provided and including obtaining a first image from an image capturing apparatus; identifying a first reference point and a second reference point from the first image; determining a position relationship between a first section and a second section of the human body portion according to three-dimensional coordinates of the first reference point and the second reference point; obtaining a second image from the image capturing apparatus; identifying a third reference point from the second image.