A spectacle frame set includes a detachable spectacle frame and a utility spectacle frame. The detachable spectacle frame includes two hangers, a lens supporter extended between two inner sides of a pair of optical lenses, two first connectors provided at two front ends of the hangers respectively to detachably couple with two outer sides of the optical lenses respectively. The optical lenses are selectively assembled with the detachable spectacle frame or disassembled from the detachable spectacle frame to detachably mount the optical lenses behind the utility spectacle frame at a position that the optical lenses are overlapped aligned with the utility lenses of the utility spectacle frame respectively.