Embodiments of the invention include a semiconductor light emitting device including a semiconductor structure. The semiconductor structure includes a light emitting layer disposed between an n-type region and a p-type region. A wavelength converting structure is disposed in a path of light emitted by the light emitting layer. A diffuse reflector is disposed along a sidewall of the semiconductor light emitting device and the wavelength converting structure. The diffuse reflector includes a pigment. A reflective layer is disposed between the diffuse reflector and the semiconductor structure. The reflective layer is a different material from the diffuse reflector.