A device for decoding video data determines mode information for a current block of a current picture of the video data; derives weights for use in a bilateral filter based on the mode information for the current block; applies the bilateral filter to a current sample of the current block by assign the weights to neighboring samples of the current sample of the current block and the current sample of the current block and modifying a sample value for the current sample based on sample values of the neighboring samples, the weights assigned to the neighboring samples, the sample value for the current sample, and the weight assigned to the current sample; and based on the modified sample value for the current sample, outputs a decoded version of the current picture.