Methods, apparatus, and computer readable storage medium for entropy coding for intra prediction modes in video encoding and/or decoding. The method includes receiving, by a device, a coded video bitstream for a block; deriving, by the device, at least one context for a set index and a mode index for the block based on at least one of the following: information of the block and mode information of at least one neighboring block of the block, wherein: the set index indicates an intra mode set from a plurality of intra mode sets, and the mode index indicates an intra prediction mode from the intra mode set; extracting, by the device from the coded video bitstream, the set index and the mode index according to the at least one context; and determining, by the device, the intra prediction mode for the block based on the set index and the mode index.