Methods of selectively applying Bi-directional Optical Flow (BDOF) and Decoder-side Motion Vector Refinement (DMVR) on inter mode coded blocks employed in video coding standards, such as the now-current Versatile Video Coding (VVC) design, are performed at a computing device. In one method, when a current block is eligible for both applications of DMVR and BDOF based on a plurality of pre-defined conditions, the computing device uses a pre-defined criterion to classify the current block and then uses the classification in applying either BDOF or DMVR, but not both, on the block.