A system, method, and computer readable medium for inverse graphics rendering comprise a differentiable rendering pipeline and a gradient descent optimization engine. A given scene is described using scene parameters. Visibility functions, and other rendered functions, are constructed to be continuous and differentiable, allowing the optimization engine and the rendering pipeline to efficiently iterate through increasingly refined scene models.