The present invention provides a method and device for generating a filter coefficient in real time. The method includes: looking up a converted window function value in a converted window function table based on a current coefficient index; generating a current cut-off angular frequency; generating a look-up table address based on the current coefficient index, the filter order and the current cut-off angular frequency and looking up a sine value in a sine table based on the look-up table address; and multiplying the converted window function value by the sine value to obtain the filter coefficient. The device includes a first memory, a second memory, a look-up table address generation module and a first multiplier. The present invention is easily implemented with low hardware resource consumption and high flexibility, and is particularly applicable for the hardware implementation of high-order finite impulse response filters.