The invention provides a method for processing a frame-recording based video clip without the need of modifying the video clip and/or directly inserting any form of signals into the video clip. The method comprises the steps of: browsing the video clip frame by frame by a video editing software; importing a grid layer into the video editing software such that the grid layer is browsed synchronously with each frame of the video clip; analyzing movement of a character and/or an object in the video clip by the grid layer; generating a series of game data to record the movement; storing the series of game data in a game unit after the generation of the game data; and connecting a game input to the game unit to activate the game, wherein the game unit receives input data from the game input when the video clip is played and synchronously compares the input data with the game data to determine whether they matches with each other. The invention also provides an apparatus for constructing an interactive video game by use of a frame-recording based video clip.