Embodiments of the disclosure provide systems and methods for generating a report based on a medical image of a patient. An exemplary system includes a communication interface configured to receive the medical image acquired by an image acquisition device. The system may further include at least one processor. The at least one processor is configured to automatically determine keywords from a natural language description of the medical image generated by applying a learning network to the medical image. The at least one processor is further configured to generate the report describing the medical image of the patient based on the keywords. The at least one processor is also configured to provide the report for display.