A method to prioritize a plurality of tests in a continuous deployment pipeline. The method ranks the plurality of tests based on a test attribute and a test context to provide a test rank for each of the plurality of tests. The method sets a test set for the continuous deployment pipeline using the test ranks. The method executes the test set in the continuous deployment pipeline.