Systems and methods are disclosed for utilizing digital aerial images to determine stockpile volumes. In particular, in one or more embodiments, the disclosed systems and methods utilize a UAV to capture a plurality of digital aerial images portraying stockpiles on a site. The disclosed systems and methods can generate a two-dimensional representation of the site and a three-dimensional representation of the site based on the plurality of digital aerial images. Moreover, the disclosed systems and methods can apply an elevation filter to the three-dimensional representation of the site to identify potential stockpiles. Further, the disclosed systems and methods can utilize a neural network to analyze two-dimensional features and three-dimensional features of the potential stockpiles to identify final stockpiles. The disclosed systems and methods can then utilize three-dimensional stockpile representations to determine stockpile volumes.