Disclosed herein a method of removing a point cloud outlier and an apparatus implementing the method. The method includes: arranging a point cloud obtained from a laser scanner along at least a first direction; selecting, neighboring first-axis points, between which a separation degree satisfies an inspection start threshold condition, as a first leading-side representative point and a first trailing-side representative point; selecting a first leading-side outlier candidate and a first trailing-side outlier candidate based on a first leading-side separation degree and a first trailing-side separation degree; and determining the first leading-side outlier candidate and the first trailing-side outlier candidate as a first outlier point, when the number of the outlier candidates satisfies an allowable threshold condition.