Embodiments include techniques to receive and process data from a data service provider, communicate a plurality of messages comprising the data to a streaming data platform and detect a failure of delivery of the plurality of messages to the streaming data platform. Embodiments further include techniques communicate the plurality of messages to a distributed message queue service of a distributed message queue system, publish each of the plurality of messages to the streaming data platform, determine each of the plurality of messages published to the streaming data platform was successful or unsuccessful, and retry publication of each unsuccessfully published message of plurality of messages to the streaming data platform.