In one embodiment, a method of providing a test framework in an on-demand services environment can include: accessing a plurality of tests via plug-ins to a core platform of the test framework; receiving, by a user interface, a selection of tests for execution from the plurality of tests, where the selected tests are configured to test a plurality of layers of a product; executing, by an execution engine coupled to the core platform, the selected tests; storing test results for the executed selected tests on a configurable repository; and reporting the stored test results in a summarized form on the user interface.