Methods, computer systems, and computer storage media are provided that provide an interactive web-based alerts system. The system provides a combination of features including a mail application and a dashboard for reporting. Initially, automated emails sent from a plurality of sources are received and stored in a database. The automated emails are classified based on criteria including source, subject line, acknowledgement, and/or status. Using these classifications, various reports can be generated to provide insight into the alert quality and quantity. A dashboard interface displays the classified alerts and enables various interactions with the classified plurality of alerts. Based on the interactions, the dashboard interface is automatically updated, in real-time. In some embodiments, the interactions comprise causing an incident to be created for the alert, causing a category of the alert to be updated, or causing a shift report to be generated.