A beamformer system that can isolate a desired portion of an audio signal resulting from a microphone array. A combination of beamformers is used to dampen undesired noise, whether diffuse or coherent. A fixed beamformer is used to dampen diffuse noise while an adaptive beamformer is used to cancel directional coherent noise. The adaptive beamformer isolates and weights audio from various directions. The weights may vary depending on the isolated desired audio signal, dynamically adjusting the step-size adjustments to the weights.