An architecture and techniques to enable a mobile device to efficiently classify raw sensor data into useful high level inferred data is discussed. Classification efficiency is achieved by tuning the mobile device's raw sensor data classification pipeline to attain a balance of accuracy, latency and energy suitable for mobile devices. The tuning of the classification pipeline is accomplished via a multi-pipeline tuning approach that uses Statistical Machine Learning Tools (SMLTs) and a classification cost modeler.