An apparatus for removing burrs on billets has a supporting element and at least two arms extending from the supporting element. Deburring devices are driven in rotation by burrs of billets. The deburring devices are supported by the arms. The apparatus is driven rotatably and reversibly by a drive between a stand-by position wherein the apparatus is spaced apart from the billet to be deburred and a working position wherein the deburring devices are close to the billet to be deburred and are able to contact a burr.