A wireless conference phone system has a base station to couple at least one conference unit to a telephone network, such as the public switched telephone network (PSTN) or a digital telephone network such as a voice over internet protocol (VoIP) network. Each conference unit performs echo cancellation of the audio signal received from a remote location allowing a simplified base station implementation.