Various aspects include approaches for intelligent acoustic beam steering. In particular aspects, a computer-implemented method of controlling a microphone array includes: generating an acoustic map including an acoustic description of a physical environment proximate the speaker system; focusing the microphone array in a direction based upon the acoustic map prior to receiving a voice command input at the microphone array, where generating the acoustic map includes: detecting a location of at least one noise source in the physical environment; and creating a microphone array filter configured to at least partially reject the at least one noise source; receiving voice feedback input from a user at the microphone array; and updating the acoustic map of the physical environment based upon the received voice feedback input.