The disclosed technology is generally directed to online chat management services. In one example of the technology, organization information is accessed for tenants. The organization information includes, for each organization, configuration information for the organization. Each organization belongs to a corresponding tenant. Worker service instances are scheduled to perform fills associated with the organizations, such that sufficient fills are performed for each organization according to the configuration information for the organizations in the accessed organization information. Each fill includes: causing artifacts associated with a function to be created, such that the artifacts associated with the function are configured based on the corresponding tenant. Artifact information associated with the created artifacts is received, including at least one unique identifier associated with the created artifacts for the function. Server-side caching of a cache record that includes the artifact information associated with the created artifacts for the function is performed.