A method and system for building a statistical four-chamber heart model from 3D volumes is disclosed. In order to generate the four-chamber heart model, each chamber is modeled using an open mesh, with holes at the valves. Based on the image data in one or more 3D volumes, meshes are generated and edited for the left ventricle (LV), left atrium (LA), right ventricle (RV), and right atrium (RA). Resampling to enforce point correspondence is performed during mesh editing. Important anatomic landmarks in the heart are explicitly represented in the four-chamber heart model of the present invention.