There are provided an optical surface protection film capable of permitting even a visual inspection of a coated body having a fine roughness, such as a prism sheet, to be performed under the condition that the protection film is attached to the coated body and excelling in adhesion reliability without an optical adverse effect on the coated body, and an optical film with the surface protection film. The optical surface protection film (1) has a base material layer (10) and an adhesive layer (12) stacked on one surface of the base material layer. The surface of the base material layer (10) on the side of the adhesive layer (12) has an arithmetic surface average roughness (Ra2) of 0.65 μm or less. The other surface of the base material layer (10) has an arithmetic surface average roughness (Ra1) of 0.6 μm or more.