A system and method for filtering LiDAR data is provided. The system includes a LiDAR data collector that is configured to collect the LiDAR data from a LiDAR and store the LiDAR data in a matrix structure. A noise point determiner is configured to determine whether a first filtering condition for determining whether a point within a predetermined reference distance in the LiDAR data is present, a second filtering condition for determining whether a present point adjacent to a left and right by a reference of a reference point in the matrix structure is a first reference value or less, and a third filtering condition for determining whether a present point adjacent to a top and bottom by the reference of the reference point is a second reference value or less are satisfied.