A system and method for creating 3-dimensional agricultural field scene maps are disclosed comprising producing a pair of images using a stereo camera and creating a disparity images based on the pair of images, the disparity image being a 3-dimensional representation of the stereo images. Coordinate arrays can be produced from the disparity image and the coordinate arrays can be used to render a 3-dimensional local map of the agricultural field scene. Global maps can also be made by using geographic location information associated with various local maps to fuse together multiple local maps into a 3-dimensional global representation of the field scene. The disparity images can be used to analyze a variety of agricultural features.