A system and method for management of communications for components of a global accelerator system is provided. The global accelerator system includes client devices communicating with a global access point via a public network to access various endpoints that can host services. In turn, a global access point communicates to various endpoints, which are organized into different data centers, via a private network. A global access point creates and manages separate TCP connections between the client and global access point and the client and endpoint to improve first byte latency experienced by clients that leverage the data throughput resources of the private network.