An automated network-based test system for set top box devices is disclosed. According to certain embodiments, the network-based testing system using Simple Network Management Protocol facilitates remote testing of thousands of set-top boxes, where groups of these set top boxes can be located in various locations that are remote from a main controller server that is running the tests remotely.