A purse, bag or case having one or more compartments for personal items. A gun storage compartment is defined by wall panels of the purse and has ambidextrous openings with closures for secure access by right or left handed users. A polymer foam panel within the compartment is deformed by a gun to provide a holster-like pocket within which the gun is contained and oriented for ready access and use. A wall panel of the purse is formed by or lined with a ballistic fabric material to resist penetration of the purse by bullets, knives or other objects and provide personal protection for the user.