A method and apparatus for performing automated underwriting based on document images are described. The method may include receiving a document image corresponding to a form and data contained within the form for which an underwriting decision is to be rendered. The method may also include performing a first machine learning based analysis of the document image by extracting one or more keys and one or more values corresponding to the keys from the document image using a first machine learning model trained to digitize the form from the document image. The method may also include performing a second machine learning based analysis using the one or more keys and one or more values corresponding to keys as an input into a second machine learning model trained to make the decision based on key, value pairs. Furthermore, the method may include transmitting, to an organization system, a user interface generated using the decision and a confidence of the decision determined from the second machine learning based analysis.