An audio processor for providing loudspeaker signals on the basis of input signals, like channel signals and/or object signals, obtains an information about the position of a listener and an information about the position of a plurality of loudspeakers, or sound transducers. The audio processor selects one or more loudspeakers for a rendering of the objects and/or of the channel objects and/or of the adapted signals, derived from the input signals. The selection depends on the information about the position of the listener and about the positions of the loudspeakers and takes into consideration the information about one or more acoustic obstacles. The audio signal processor renders the objects/channel objects/adapted signals derived from the input signals, in dependence on the information about the position of the listener and about positions of the loudspeakers, in order to obtain the loudspeaker signals, such that a rendered sound follows a listener.