The disclosed embodiments provide neural network inference accelerator based on one-time-programmable (OTP) memory arrays with one-way selectors. In some embodiments, a memory array may comprise: a plurality of one-time-programmable memory cells each comprising: a one-time-programmable memory element; a top electrode having an upper surface in contact with the one-time-programmable memory element; a dielectric layer in contact with a lower surface of the top electrode; a bottom electrode; and a dense layer having an upper surface in contact with the dielectric layer, and a lower surface in contact with the bottom electrode, wherein the dense layer comprises Al2O3 or MgO.