An image stabilization (IS) apparatus that is capable of preventing change of a field angle due to unnecessary mode transition. A selection unit transfers from a first IS mode to a second IS mode with a larger IS effect when a detected shake amount is maintained below a first threshold beyond first determination time and the shake amount is not maintained below a second threshold that is lower than the first threshold beyond a third determination time that is shorter than a second determination time, and transfers from the first IS mode to a third IS mode with the smallest IS effect when the shake amount is maintained below the second threshold beyond the second determination time that is shorter than the first determination time. A control unit controls an IS unit that corrects an image blur using the shake amount in the selected IS mode.