A motorcycle backrest assembly includes a pair of side plates each for mounting on either the left or right side of the motorcycle's rear fender. A receiver is securable to each plate for adjustably receiving one of two side rails depending from a backrest. Each receiver is angularly adjustable to vary the position of the backrest. The entire assembly can be quickly removed from the motorcycle and stored, if desired.