A hot-working tool material has an annealed structure and is to be quenched and tempered before using, wherein: the hot-working tool material has a composition from which a martensite structure can be prepared by the quenching; and, in ferrite crystal grains in the annealed structure in a cross section of the hot-working tool material, the ratio by number of ferrite crystal grains having a largest diameter (L) of 100 μm or more is not more than 10.0% relative to the total ferrite crystal grains, and the ratio by number of ferrite crystal grains having an aspect ratio (L/T) [wherein (L) stands for a largest diameter, and (T) stands for the largest transverse width orthogonally crossing the same] of 3.0 or more is not more than 10.0% relative to the total ferrite crystal grains.