Aspects of a method and system for a generalized multi-dimensional filter device are provided. A corresponding luma component and a corresponding chroma component of a sample of a composite video baseband signal for each of a plurality of filtering modes may be determined. A similarity level of the sample corresponding to each of the plurality of filtering modes may be determined. A corresponding coefficient for each of the plurality of filtering modes may be generated based on the determined similarity levels. A luma component and a chroma component of the sample of the composite video baseband signal may be generated based on the generated corresponding coefficients and the determined corresponding luma components and the determined corresponding chroma components for each of the plurality of filtering modes.