An object of the invention is to provide a charged particle beam apparatus capable of achieving both acquisition of an image having high resolution of an inspection target pattern and suppression of a beam irradiation amount when a specific pattern is an inspection target from a highly integrated pattern group. In order to achieve the object, a charged particle beam apparatus is proposed in which at least one of a stage and a deflector is controlled so as to move a field of view from a reference position to an inspection or measurement target pattern, the number of objects included in a first image obtained by scanning a position of the field of view in a moving process of the field of view with a charged particle beam of a first irradiation condition is counted, and in a case where the number of the objects satisfies a predetermined condition, a second image is generated based on scanning with a charged particle beam of a second irradiation condition of a higher dose than that of the first irradiation condition.