Presented herein are techniques for monitoring the sensory outcome of a recipient of a sensory prosthesis in an ambient environment that includes one or more controllable network connected devices. The sensory outcome of the recipient in the environment is used to make operational changes to the one or more controllable network connected devices in order to create an improved environment for recipient.