Just-in-time up-conversion utilizes frame tagging, and optionally pixel tagging, to minimize the data bandwidth required to drive a display. According to this approach video is maintained in its native frame rate until needed in the display device, such as for pixel control at the row/column drivers. By way of example, a frame tag comprises a repeat count and direction information upon which display refresh is based. In addition, pixel tagging can be utilized to dynamically configure the up-converter to generate pixel displacements within synthesized intermediate frames, such as based on different pixel layer representations. The data stream can utilize traditional fixed pixel lengths or variable pixel lengths to conserve additional bandwidth.