An embodiment of the invention may include a method, computer program product and computer system for multi-modal anomaly detection. The method, computer program product and computer system may include computing device which may receive primary sensor data from a primary sensor for a first device and determining a baseline from the primary sensor data for the first device. The computing device may receive primary sensor data from a primary sensor and secondary sensor data from a secondary sensor for a second device. The computing device may determine an anomaly in the primary sensor data for the second device based on the determined baseline for the first device and compare the anomaly in the primary sensor data for the second device to the received secondary sensor data for the second device.