The present invention relates to a system for providing a supplementary service by identifying an object in an image and comprises: an image service server and a user terminal. The image service server provides image information and includes a database that manages metadata for the provision of the service. The user terminal dynamically generates control command information according to the information for the object selected in the image. In addition, the user terminal receives the information for the object selected in the image that is displayed on screen and transfers the information to the image service server. Furthermore, the user terminal receives from the image service server the preset supplementary service that corresponds to the information for the object selected.