Provided is a method of selecting test stimuli for use in evaluating performance of a video watermarking algorithm, including the steps of: calculating an image complexity rate (ICR) for each of a plurality of test stimulus candidates and classifying them into L (where L is an integer more than or equal to 2) levels based on the calculated ICR values; calculating an energy distribution rate (EDR) for each of the plurality of test stimulus candidates, and classifying them into M (where M is an integer more than or equal to 2) levels based on the calculated EDR values; calculating a motion rate (MR) for each of the plurality of test stimulus candidates and classifying them into N (where N is an integer more than or equal to 2) levels of the calculated MR values; and selecting at least one test stimulus from each of the L levels, M levels, the N levels of the test stimuli, respectively.