A frame member for housing a battery cell, frame assembly and frame/battery cell assembly made therefrom, as well as respective methods of making the same, are disclosed. A frame member for housing a battery cell includes an integral frame having a peripheral wall, the peripheral wall having an attachment face and an opposed cooling face, and an attachment feature located on the attachment face and a complementary attachment feature located on the attachment face that is symmetrically opposed to the attachment feature about a plane of symmetry of the frame, the peripheral wall defining an opening that is configured to matingly receive a battery cell therein. A pair of frame members having a cooling member placed therebetween and attached to the respective attachment faces comprises a frame assembly. A frame/battery cell assembly includes a pair of frame assemblies having at least one battery cell placed therebetween.