A method for heat-based control of a surveillance system is provided. The method may include detecting a first pattern of heat transferred from a heat source based on a first sensor dataset corresponding to a first event, determining an expected pattern of heat to be transferred from the heat source during a second event based on the first pattern of heat transfer, and generating a surveillance model based on the expected pattern of heat transfer. The method may further include detecting a second pattern of heat transferred from the heat source based on a second sensor dataset corresponding to the second event, detecting the heat source during the second event with respect to the second pattern of heat transfer, and determining a threat level corresponding to a security risk posed by the heat source with respect to the environment.