Various technologies and techniques are disclosed for dynamically determining test platforms. A test platform matrix is generated for use with a test run. The test platform matrix is generated based on a combination of test coverage specifications and a history of test coverage from prior runs. Machines are provisioned for executing the test run according to the test platform matrix. Different system configurations are tested than prior system configurations that were tested in a most recent prior run.