There is provided a control device including: an autofocus control section configured to execute an autofocus operation by moving at least one optical member; and an autofocus operation determination section configured to determine whether it is possible for the autofocus operation to bring biological tissue into focus, the biological tissue serving as an object. In a case where the autofocus operation determination section determines that it is not possible for the autofocus operation to bring the object into focus, the autofocus control section moves the at least one optical member to a predicted focal position set in advance in accordance with a purpose of imaging to make it possible to further improve convenience of a user.