An electrical submersible pump assembly has a rotary pump, an electrical motor, and a seal section. A drive shaft extends from the motor into the pump. A radial bearing for the shaft includes a bearing sleeve secured to the shaft for rotation. A bushing rotatably receives the bearing sleeve in sliding contact. A support member has a receptacle into which the bushing locates. The receptacle has a greater inner diameter than an outer diameter of the bushing, defining an annular gap. A bearing carrier has a bore into which the support member is secured against rotation and radial movement relative to the bearing carrier. A compliant member in the gap in engagement with the bushing and the support member prevents rotation of the bushing relative to the support member and allows limited radial movement of the bushing relative to the bearing carrier.