A system and method is disclosed for providing single antenna interference cancellation processing with minimum latency. Incoming data frames are processed to generate a plurality of parallel data streams which are then further processed using a parallel single antenna interference cancellation algorithm to reject the signals and to generate a data stream containing only the desired symbols. In various embodiments of the invention, the parallel data streams are processed using a parallel arithmetic logic unit that is capable of operating in single-cycle mode in response to a first control stream and a multi-cycle mode in response to a second control stream. Embodiments of the invention comprise a three port memory interface operable to receive the parallel data streams and to generate a virtual three-dimensional data structure therefrom. In some embodiments of the invention, the virtual three-dimensional data representation comprises a plurality of segmented matrices, with the segmented matrices comprising data corresponding to portions of the incoming data frames. Data elements within the individual segments of the virtual three dimensional data structure can be calculated using data elements contained in a predetermined row and predetermined column of a segment.