Disclosed is a method of removing staff lines from a music score an image. The method includes detecting a region with staff lines in an image including a music score; checking a gradient of the staff lines, and dividing the staff lines extending continuously in a longitudinal direction into a plurality of regions in consideration of the gradient, estimating each of the staff lines included in the divided regions by analyzing a histogram of the image, extracting each of the staff lines from the music score on the basis of the estimated staff lines and removing each of the extracted lines of the staff lines from the music score.