The present invention provides a color filter substrate and a manufacturing method thereof, an organic electroluminescent display panel and a display device. The color filter substrate of the present invention comprises a first base, and a plurality of color filters and black matrixes arranged on the first base, wherein two adjacent color filters are at least partially overlapped, and each black matrix is at least partially arranged at the overlapped position of the two adjacent color filters; and the color filter substrate further comprises a first adhesive layer for eliminating section differences between the adjacent color filters or between the color filters and the black matrixes, and the first adhesive layer is provided with scattering particles therein. The color filter substrate can be used in the organic electroluminescent display panel.