A rechargeable lithium cell comprising: (a) a cathode having a cathode active material and a first electrolyte in ionic contact with the cathode active material; (b) an anode having an anode current collector but no anode active material and having no lithium metal when the cell is made; (c) an optional porous separator electronically separating the anode and the cathode; and (d) a second electrolyte, comprising a polymer electrolyte in ionic contact with the first electrolyte, wherein the polymer electrolyte is disposed substantially between the anode and the cathode, between the separator and the cathode, and/or between the separator and the anode. The polymer electrolyte substantially does not permeate into the anode or the cathode. Also provided is a method of preparing or operating such an anode-less lithium cell.