A desk frame elevation structure includes an inner tube telescopically received in an outer tube and a roller unit between the inner and outer tubes. The outer tube is fixed to a base and includes a bottom plate and a first top plate. A desk board unit is fixed to the inner tube. A telescopic rod is received in the inner tube and has top and bottom ends coupled to the outer and inner tubes, respectively. The inner tube extends through an upper buffer pad disposed below the first top plate. The upper buffer pad has an upper face abutting the first top plate and a lower face for abutting an abutting edge of the inner tube. A lower buffer pad is disposed above the bottom plate and includes a lower face abutting the bottom plate and an upper face for abutting a bottom end of the inner tube.