A method of displaying a three-dimensional (3D) image by using a display apparatus includes generating an annotation related to a point of the 3D image and determining an image depth of the annotation, and displaying the annotation with the 3D image based on the image depth of the annotation, in which the annotation comprises at least one point or area of the 3D image.