Embodiments described herein provide systems and processes for scene-aware object detection. This can involve an object detector that modulates its operations based on image location. The object detector can be a neural network detector or a scanning window detector, for example.