Provided is a processing system to effectuate sensor processing of obstacle information for use in autonomous driving. The apparatus includes a communication module that receives sensor data collected by multiple sensors disposed to capture sensor data in a specified region to detect the obstacles. Additionally, a health status detection modules, in the system, determine the health status of the system and the sensors based on information from the sensors and a communication latency between the communication module and the sensors. The system also includes a sensor processing module to process the sensor data to identify anomalies in the data due to harsh conditions to eliminate any erroneous data.