A technique is provided for pumping fluid in subsea applications. A self-contained pumping module is created by mounting one or more removable pumping units on a skid that can be lowered to a sea floor. Each removable pumping unit comprises an electric submersible pumping system enclosed by an outer housing. The self-contained pumping module also comprises hydraulic connectors and electrical connectors that facilitate connection with corresponding hydraulic lines and electric lines while at a subsea location.