According to one embodiment, a structure evaluation system of the embodiments includes a plurality of sensors, an arrival time determiner, a reliability calculator, and a map generator. The plurality of sensors detect elastic waves. The arrival time determiner determines arrival times of the elastic waves using elastic waves detected by the plurality of respective sensors. The reliability calculator calculates reliabilities related to measurement waveforms of the elastic waves on the basis of the arrival times. The map generator generates a first map on the basis of the calculated reliabilities or the reliabilities and a distance.