There is provided a behavior pattern extraction system which can extract user's behavior pattern with high accuracy. The behavior pattern extraction system includes: a location information acquiring section measuring location points which each indicate a location of a user; a staying point extraction section setting staying points and staying records based on an range in which location points which are each measured in a first period are concentrated, wherein the staying points each indicate a location where the user has stayed temporarily; a representative staying point extraction section setting a representative staying point and a representative staying record based on an range in which the staying points which are set in a second period which is longer than the first period are concentrated, wherein the representative staying point indicates a location where the user has repeatedly visited, and the representative staying record indicates an error range of the location of the representative staying point; and a behavior pattern record section recording the representative staying point and the representative staying record in a storage area as behavior pattern information of the user.