Automated control of an electrochromic device is described. A method includes receiving a first image captured from a first viewpoint of an electrochromic device. The method further includes identifying at least one of an obstructed portion of the first image or an unobstructed portion of the first image. The method further includes generating an obstruction map based on the at least one of the obstructed portion of the first image or the unobstructed portion of the first image. The method further includes determining, based on the obstruction map, a desired tinting state of the electrochromic device and causing a current tinting state of the electrochromic device to correspond to the desired tinting state.