A halter support apparatus for carrying milk collection containers comprise a halter strap and at least one support cup. The at least one support cup is capable of carrying the milk collection containers. The halter strap is connected to at least one support cup to support the weight of the milk collection containers. The halter strap is adjustable such that the milk collection containers inside the at least one support cup can be suspended in place near the user's breasts. The halter support apparatus also includes an elastic band wrapped around the user's body for securing the attachment of the breast shields to the user's breasts.