A neural apparatus for a neural network system may be configured to receive one or more input signals during a decode time period, decode the one or more input signals during the decode time period, resulting in a decoded signal, and upon termination of the decode time period, process the decoded signal using internal neuron dynamics. The processed signal may be used to encode and emit one or more output signals in a subsequent decode time period to another neural apparatus of the neural network system.