Disclosed are systems, apparatuses, and methods for implementing a phase-model neural network using a fixed amount of memory. Such a phase-model neural network includes a plurality of neurons, wherein each neuron is associated with two parameters—an activity and a phase. Example methods include (i) generating a sequence of variables associated with a probability distribution of phases and (ii) sequentially sampling the probability distribution of phases using a fixed amount of memory, regardless of a number of phases used in the phase-model neural network.