A cutting bit assembly for a mining machine includes a holder having a first surface, a second surface, and a bore extending therebetween, and a bit having a first end and a second end. The bit further includes a tip, a shank, and a shoulder positioned between the tip and the shank. The shank is positioned in the bore of the holder and defines a shank axis. The shoulder engages the first surface of the holder. The shank includes a projection adjacent the second end. The cutting bit assembly also includes a retainer having a groove and a resilient member. The groove engages a portion of the projection. The resilient portion engages the second surface of the holder and biases the retainer along the shank axis and away from the holder.