A computer implemented method, apparatus, and computer program product for generating video based cohorts. Digital video data is processed to identify a set of color and texture based attributes associated with the set of objects. The digital video data comprises metadata describing the set of objects. The set of color and texture based attributes are analyzed using cohort criteria to form a result. The cohort criteria specify attributes that are associated with members of a given cohort. A set of cohorts is generated based on the result. Each cohort in the set of cohorts comprises a subset of objects from the set of objects that share at least one color and texture based attribute in common.