A semiconductor device has a magnetic sensor configured to detect a direction of magnetism. The magnetic sensor includes Hall elements arranged on a surface of a semiconductor substrate, and a magnetic flux concentrator formed of a magnetic material having the function of amplifying magnetism. The magnetic flux concentrator is arranged on the semiconductor substrate and at least partly covers each of the Hall elements. A slit or a slot is formed in the magnetic material to inhibit generation of stress applied to the Hall elements.