Disclosed herein are systems, methods, and devices for repairing holes in weld seams created by bobbin friction stir welding tools. A hole may be created when a welding tool or, more specifically, a pin of the tool is removed or otherwise extracted from a weld seam created by the tool. The method may involve inserting a plug (e.g., a rivet) into the hole, reshaping the plug in the hole (e.g., riveting) thereby securing the plug in the component, and creating another weld seam through the plug thereby consuming the plug. In some embodiments, the hole may be reshaped prior to inserting the plug. For example, the hole may be drilled out and/or a countersink may be created on one or both ends of the hole. Furthermore, the plug may extend outside of the hole prior to its reshaping and, in some embodiments, even after reshaping.