An intra prediction mode selecting method is disclosed. First, a compress profile and a frame resolution of a frame data are received. Next, a plurality of corresponding prediction modes are selected according to the compress profile and the frame resolution, and the selected prediction modes are scheduled for sequentially calculating a plurality of corresponding cost functions. Finally, the cost functions are compared to select one of the prediction modes to serve as a prediction mode of the frame data.