Methods, systems, and apparatus include computer programs encoded on a computer-readable storage medium for testing set-top boxes. A method includes: receiving an application for testing in a set-top box environment; identifying a set-top box for testing the application; executing the application on the set-top box, including commanding the set-top box to display a plurality of interfaces and initiating commands to transition the set-top box from a first presentation state to a second presentation state; capturing video output associated with the first presentation state; capturing video output associated with the set-top box after the transition to the second presentation state; monitoring and recording network traffic output by the set-top box; and providing an output associated with the monitoring and the captured video output to enable correlation between commands executed as part of the application execution, on screen output and network traffic of the set-top box.