A layered video coding method is provided that selects data to upsamples from a base layer (BL) to provide to an enhancement (EL) to improved coding efficiency. The method determines a filter to determine an up-sampled value for a first layer for a video, wherein the filter has a set of coefficient values assigned to the filter. The up-sampled value is determined by applying the set of coefficient values to the plurality of sample values. The method then outputs the up-sampled value for use in coding a second enhancement layer (EL) of a higher resolution than the first layer. The up-sampled values may be for the 6/16 and − 6/16 phase offsets.