Techniques related to transform unit size determination for video coding are discussed. Such techniques may include comparing individual prediction residues of a unit of a picture of video such as a coding unit to an adaptive threshold and splitting a transform unit corresponding to the unit if any of the prediction residues exceed the adaptive threshold.