Described herein is a technique for customizing device behavior based on evaluated relationships between a user and the user's environment. User conduct is analyzed based on available sensors, which may include user-facing cameras. The user's environmental context is similarly evaluated based on the available sensors. Conduct and context, as well as any identified relationships between such conduct and context, may be reported to application programs, and may form the basis for customized device behavior.