A database of the location based relationships of points of interest within an environment is automatically generated using a digital representation of the environment that includes the points of interest at different locations within the environment. The locations of the points of interest in the environment are identified and the location based relationships between the points of interest are determined. The points of interest are labeled with the determined relationships and the points of interest and labeled relationships are stored. For example, a graph structure may be produced where each node is a point of interest and the edges between nodes is labeled with the determined relationships.