When a speaker device is within communication range of an electronic device, various rules are used to determine whether to connect to or route audio data to the speaker device. For example, the electronic device may prompt the user to choose whether to connect to a wireless speaker device. In situations in which the user rejects connecting to the wireless speaker device, subsequent attempts by the speaker device to connect to the electronic device are also rejected or ignored without further prompting the user, or the wireless speaker device may be connected to the electronic device but audio data not routed to the wireless speaker device. By way of another example, the electronic device may determine whether to route audio data to a wireless speaker device based on signal strength and link quality metrics for wireless communication between the electronic device and one or more wireless speaker devices.