The present disclosure provides a cargo carrier system that is modular and can be arranged for a variety of applications, accessories, and cargo. The cargo carrier system has a modular base with a frame and a plurality of receptacles located within the frame configured to receive attachments. The base may have a rectangular frame coupled to a substantially flat top surface. Different components may be coupled to the frame by using standardized coupling attachments, thereby forming a highly customizable and modular system. Removable rails and clamping devices may be coupled to the base in a specific configuration and may be arranged based on the cargo being carried. A latching system couples the rails and other accessories to the base, as well as the cargo within the modular carrier system.