A framework for anatomy-aware adaptation of a graphical user interface. Landmarks are first detected by passing one or more current images through a trained machine learning model. A body section may then be inferred based on the detected landmarks. One or more user interface elements may be determined based on the inferred body section. A graphical user interface may then be adapted with the determined one or more user interface elements.