Described is a system for learning, prediction, and recall of spatiotemporal patterns. An input spatiotemporal sequence is learned using a recurrent spiking neural network by first processing the input spatiotemporal sequence using the recurrent spiking neural network. The recurrent spiking neural network comprises neurons having excitatory synaptic connections and inhibitory synaptic connections. Balanced inhibitory connectivity exists between neurons having excitatory synaptic connections. The recurrent spiking neural network uses distinct forms of synaptic plasticity for excitatory synaptic connections and inhibitory synaptic connections, such that excitatory synaptic connections strengthen and inhibitory synaptic connections weaken. In another aspect, the system is able to recall the learned spatiotemporal sequence and predict a future spatiotemporal sequence through activation of the recurrent spiking neural network.