A projection surface gaming system for projecting video images onto a physical gaming table is described herein. The projection surface gaming system includes a video projection device, an object sensing system, and a controller including a processor. The processor is programmed to execute an algorithm including the steps of projecting a first image on a surface of the physical gaming table using the video projection device, detecting a player's interaction with an area of the physical gaming table displaying the first image using the object sensing system, and projecting a second image on the surface of the gaming table in response to detecting the player's interaction with the area of the first image.