According to one aspect of the present invention, a pattern inspection apparatus includes a circuit configured to perform, for each direction, filter processing on the image, using a plurality of two-dimensional spatial filter functions with different orientations; a circuit configured to extract a plurality of pixels each having a predetermined value larger than a first threshold, in pixel values each for the each direction of after the filter processing, as a plurality of outline pixel candidates through which an outline of the figure pattern passes; and a circuit configured to extract a plurality of outline pixels from the plurality of outline pixel candidates by excluding outline pixel candidates each of which has a differential value, greater than or equal to a second threshold, obtained by differentiating a pixel value of before the filter processing in a second direction orthogonal to a first direction corresponding to the predetermined value.