A thermal imaging system including at least one thermal imaging device, a server, and at least one mobile device. The thermal imaging device captures thermal images of an environment. The server applies computer vision techniques to the thermal images, detects events of a predetermined type, and generates notifications of the events of predetermined types detected from the thermal images. The mobile device runs a mobile application that is configured to receive the notifications, present user interfaces, receive user annotations of the notifications in the user interfaces, and transmit the annotations to the server. According to the annotations, the server adjusts parameters used in the application of the computer vision techniques and in the generation of the notifications.