A system and method are described for automating the analysis of cephalometric x-rays. Included in the analysis is a method for automatic anatomical landmark localization based on convolutional neural networks. In an aspect, the system and method employ a deep database of images and/or prior image analysis results so as to improve the outcome from the present automated landmark detection scheme.