Described herein are systems and methods for detecting a physiological response based on facial skin color changes (FSCC) recognizable in images taken with an inward-facing head-mounted visible-light camera (VCAMin). Some examples of physiological responses whose manifestation involves FSCC include emotional responses (which at times may be hidden to the naked eye), and physiological signals such as a heart rate, heart rate variability, and/or a breathing rate. In one embodiment, a system that detects a physiological response based on FSCC includes VCAMin that takes images of a region of interest (IMROI) on a user's face, which is illuminated by ambient light, and a computer that detects the physiological response based on FSCC recognizable in IMROI. Optionally, the system includes an outward-facing head-mounted visible-light camera (VCAMout) that takes images of the environment (IMENV), and the computer detects the physiological response also based on IMENV.