Systems and methods for determining a customized cosmetic formulation. In one method, a user is guided to capture an image of a skin region with known lighting and color characteristics, and the image is processed to provide calibrated skin color information. A customized cosmetic formulation is automatically determined for the user based on the calibrated skin color information. In another method, a user is interactively guided through capture of one or more skin region images using a device having an image sensor. The skin region images are processed to provide calibrated skin color information, which is compared to a ground truth data set to identify a set of closest known values in the ground truth data set. A customized cosmetic formulation is automatically determined for the user based on the comparison.