A set of metafiles that stores at least metadata information and provenance information of an artificial intelligence (AI) process is generated, where the AI process is trained with a source data. The set of metafiles is accessed via an application programming interface (API) to the set of metafiles. In response to accessing the set of metafiles, the source data in the set of metafiles is transferred to a cache for processing by the AI process.