A system and methods for reducing memory traffic and power consumption when solving systems of linear equations. Certain embodiments provide several aspects for improved performance in solving a consistent system of linear equations and in computing a generalized inverse. One aspect involves performing row transformations on AX=B, so that the transformed A contains row vectors that are either zero or are part of an orthonormal set. Another aspect involves performing column transformations on A, so that A contains column vectors that are either zero or are part of an orthonormal set. Another aspect involves performing row eliminations differently so that a variation of an LU factorization is obtained that is in a more directly useful form.