Embodiments for monitoring performance metrics of a computer network by defining key performance indicators for the computer network, collecting performance data for the key performance indicators, and providing one or more anomaly detection policies to define anomalous performance of the computer network using defined threshold values. A policy is applied to the collected performance data to detect abnormal performance and a notification is sent to a user upon each instance of the detected abnormal performance. An alert tracking component is used to reduce alert generation by compiling and displaying past alert response data to allow a user to directly modify threshold values for alert generation and define temporary parameters to increase alert thresholds.