Apparatus and methods may include a multimedia test engine operable to exercise and test multimedia application programming interfaces (APIs) of a wireless device based upon execution of a test configuration comprising a test script downloadable to the wireless device. The test engine is resident in memory on the wireless device and is operable to collect multimedia test data and, in some aspects, wireless device performance data, based upon the test configuration and forward the collected data to another device operable to analyze the collected data and generate a multimedia API test report viewable by an authorized user.