For controlling a time-scaling of an audio signal, the audio signal being distributed to a sequence of frames that are received via a packet switched network, a change in a delay of received frames is detected. Moreover, an amount of time scaling that is to be applied to received frames for compensating for the detected change is determined. Further, a kind of the change is determined. Further, a length of a time window within which a time scaling of the determined amount is to be completed is determined depending on the determined kind of the change.