A bias detection method, system, and computer program product to evaluate bias in an artificial intelligence service include selecting a bias context, the bias context having a bias specification associated with the bias context, generating test data for determining the bias in the artificial intelligence service based on the bias specification and the bias context, and testing the artificial intelligence service for the bias with the generated test data.