A method for a dominant color setting of a video region and a data structure and a method of a confidence measure extraction are disclosed. The video region dominant color setting method is characterized in that a region dominant color descriptor is expressed by the number of dominant colors with respect to a certain region, a dominant color expressed, a frequency that the dominant color appears, and an accuracy of a color value representing the region in a region dominant color based on various region dominant color extraction methods, for thereby expressing a region dominant color using a plurality of colors with respect to a region dominant color value and a confidence value of a region dominant color information based on various region dominant color feature extracting methods.