An optical member holding device includes a holding member, an optical member and an elastic member. The holding member has a recess defined by one or more lateral surfaces and a bottom surface with a through-hole opening at the bottom surface. The optical member is disposed on the bottom surface of the recess, and includes a light transmissive part. The optical member has an upper surface and one or more lateral surfaces. The elastic member consists of an inorganic material. The elastic member includes a main part disposed on the upper surface of the optical member, and a plurality of supporting parts each extending outward and bending downward to be in contact with the one or more lateral surfaces of the recess and the one or more lateral surfaces of the optical member to exert elastic force that secures the optical member in a predetermined location in the recess.