A quick change bearing holder apparatus for a rotating shaft including a shaft housing, a conical bearing holder and a bearing retainer element. The shaft housing has a conical socket. The conical bearing holder has an outer conical surface compatible with the conical socket of the shaft housing. The bearing retainer element mounts to the shaft housing to urge the bearing holder into the conical socket of the shaft housing. Lubrication feed lines and openings and drain lines and openings may be included in the shaft housing and conical bearing holder. Lubrication may further be facilitated using circumferential grooves in the shaft housing or the conical bearing holder. The outer conical surface of the conical bearing holder may have a taper angle that forms a self ejecting taper.