A system manages access to a cost-constrained resource. The system includes two or more resource consumers that may request access to the cost-constrained resource. Each of the resource consumers may calculate a respective need value corresponding to an amount of data stored in a buffer of the resource consumer relative to a total amount of data that may be stored in the buffer. A concurrency arbitrator may grant access to the cost-constrained resource to a given resource consumer of the plurality of resource consumers based on need values received by the concurrency arbitrator from the plurality of resource consumers. Additionally, or in the alternative, the concurrency arbitrator may grant access to the cost-constrained resource to a given resource consumer based on an amount of data stored in a buffer of the cost-constrained resource that is to be transferred to the given resource consumer.