A neuromorphic device includes a first electrode layer arranged on a substrate, and an electrolyte layer arranged on the first electrode layer. The electrolyte layer includes a solid electrolyte material. The neuromorphic device further includes an ion permeable, electrically conductive membrane arranged on the electrolyte layer and an ion intercalation layer arranged on the ion permeable, electrically conductive membrane. The neuromorphic device includes a second electrode layer arranged on the ion intercalation layer.