A method and system to reduce false positives within an automated software-testing environment using a comparator module, a filter application module, and a preview generator module is provided. In one exemplary embodiment, a method within a testing system for testing web pages associated with a current version website by automatically generating filter data by comparing differences between a plurality of iterations of a test case executed on a previous version website, automatically generating error data by executing the test case on the current version website, and detecting differences between the previous version and the current version of the website by applying filtering rules within the filter data to the error data to remove false positives.