A system and method for automatically generating an adaptive user interface for a plurality of appliances within a physical environment. Appliance description specifications of the appliances are generated from provided appliance functionality information and semantic information of related appliances and/or related environment information. The appliance description specifications can be analyzed to construct a semantic functionality relationship among the appliances and the adaptive user interface can be rendered based on an interface elements relationship which is a transformation of the semantic functionality relationship. The system has a user interface rendering module, which when run on a controller, implements the aforesaid appliance description specification generation and analysis, and adaptor modules, which when run on the appliances, maintain the appliance description specifications and allow exchange of same between the controller and appliances.