A focus adjusting apparatus comprises a focus operating unit for generating a focus command signal for driving a focus lens according to an operating amount of the focus operating unit; a focus driving unit for driving the focus lens in response to the focus command signal from the focus operating unit; a focus position detecting unit for detecting a position of the focus lens; a focus detecting unit for detecting whether or not in-focus is achieved or detecting deviation amount from in-focus position; and an operation sensitivity determining unit for determining a focus operating sensitivity of the focus operating unit, wherein the operation sensitivity determining unit determines the focus operating sensitivity and the position of the focus lens, and wherein the focus driving unit drives the focus lens according to the focus operating sensitivity.