Some embodiments of an infusion pump system include a controller device that is configured to removably attach to a pump device in a manner that provides a secure fitting, an overall compact size, and a reliable electrical connection. In particular embodiments, the controller device can be secured to the pump device in a generally side-by-side arrangement. The compact size can enhance discreteness and portability of the infusion pump system.