An integrated circuit with voltage regulator circuitry is provided. The voltage regulator circuitry may include an adaptive bleeder circuit. The adaptive bleeder circuit may include one or more switchable current leaker paths and an associated bleeder control circuit having current sensing circuitry and voltage comparison circuitry. The current sensing circuitry may monitor the amount of current that is being delivered to a load circuit, whereas the voltage comparison circuitry may output control signals that selectively activate one or more of the current leaker paths depending on the monitored current values. Adaptive bleeder circuit configured in this way can help maintain stability of the voltage regulator while minimizing dynamic power consumption.