An electrical submersible pumping system (ESP) for pumping fluids from a wellbore is made of segments, which include a motor, a seal section, a pump, and a shaft assembly connected to an output of the motor drives the pump. The motor, seal section, and pump are elongate members and coupled end to end to one another by housing connectors and shaft connectors. At least one of the housing connectors and shaft connectors have portions that are pivotable with other portions, so that adjacent segments of the ESP system can pivot with respect to one another. The housing connector can be a ball and socket assembly, where the ball fits within a spherically shaped chamber in the socket assembly. Opposing ends of the housing connector can mount to respective segments by threads or bolt flanges. The pivotal shaft connector may be a universal joint.