According to some embodiment, a storage system selects one or more directories within a file system as candidates for caching based on directory statistics associated with the directories, where each of the directories includes one or more file objects stored in the storage system. For each of the selected directories, the system determines whether the directory is to be cached based on a directory cache policy. The system caches the directory in a cache memory device in response to determining that the directory is to be cached.