An image filtering system for compliance assessment is built and modified dynamically. The system defines a vocabulary for a domain by extracting entities from corpus documents and grouping entities into image categories. An image catalog is built by identifying objects in images from a system image catalog and associating the objects with entities in the image categories. Compliance rules are generated by identifying and using image categories related to topics in corpus data sources. An image classification pipeline is then trained to classify images according to the compliance rules until performance metrics are met. The training process may be repeated to extract new and updated knowledge in corpus document and/or corpus data sources. For compliance assessment of an image, entities in related image categories are identified. The image is then classified according to actions associated with any applicable compliance rules.