A refrigerator appliance includes walls, a door, an ice container, a magnet, and a sensor. The walls define an internal storage chamber. The door has an outer panel and a door liner disposed between the outer panel and the internal storage chamber. The door liner defines a receptacle. The ice container is removably positioned within the receptacle. The magnet is secured to the ice container. The sensor is disposed between the outer panel and the door liner. The sensor is configured to align with and detect a presence of the magnet through the door liner and to detect an absence of the magnet. The presence of the magnet is indicative that the ice container is positioned within the receptacle. The absence of the magnet is indicative that the ice container is not positioned within the receptacle.