Systems and methods of predicting future medical events are based on the processing of medical image. The prediction of premature birth and estimation of gestational age based on ultrasound images are presented as illustrative examples. The new abilities to estimate the probability of future medical events, before they otherwise could be predicted, provides new avenues for the development of preventative treatments.