Oriented resorbable implants made from poly-4-hydroxybutyrate (P4HB) and copolymers thereof, have been developed that contain one or more antimicrobial agents to prevent colonization of the implants, and reduce or prevent the occurrence of infection following implantation in a patient. These oriented implants are particularly suitable for use in procedures where prolonged strength retention is necessary and there is a risk of infection. Coverings and receptacles made from poly-4-hydroxybutyrate and copolymers thereof, containing antimicrobial agents, have also been developed for use with implantable devices to prevent colonization of these devices, and to reduce or prevent the occurrence of infection following implantation of these devices in a patient. These coverings and receptacles may be used to hold, or partially or fully cover, devices such as pacemakers and neurostimulators. Preferably, the coverings and receptacles are made from meshes, non-wovens, films, fibers, and foams, and contain rifampin and minocycline.