Simple, computational efficient, and robust audio features are applied in a uniform program indexing method for picking up video segments relating to highlight plays in a recorded program worthy of being reviewed. By focusing on certain frequencies in an audio sequence of the program, a computational complexity of the uniform program indexing method is significantly decreased. With the aid of MFCC coefficients and a DFBE coefficient generated from the MFCC coefficients, audio patterns may be utilized for differentiating exciting events in the program from other unnecessary information. Scores corresponding to various audio segments are regarded as standards for picking up video segments in the program worthy of being chosen in a recorded highlight collection. Some low-level-feature parameters, some video segments having highlight-related visual characteristics, and a re-ranking procedure are utilized for enhancing precision of the scores for providing video segments worthy of being reviewed.