A sports simulation system includes a projectile tracker having a display presenting a three-dimensional sports scene. The projectile tracker captures images of a projectile tracking region disposed in front of the display to detect a launched projectile traveling through the tracking region towards the display. A processing stage, in communication with the projectile tracker, is responsive to data received from camera devices to determine three-dimensional positions, velocity, acceleration and spin of a detected projectile traveling through the tracking region, which are used by the processing stage to calculate a trajectory of the launched projectile into the three-dimensional sports scene.