A user interface for designing tests to be run against a piece of software. The user interface provides an environment in which test specifications including scenarios, business flow modules, flow lists, and steps and actions may be presented, created and modified. The user interface may be dynamically updated with data from a repository to update the presented information. Changes to code associated with the scenarios, business flow modules, flow lists, and steps and actions may be dynamically communicated back to a repository to update the code without a need to repackage an application associated with the code. The test specifications may be specified in a generic format, such as an eXtensible Markup Language (XML) format that meets a schema.