A communication device of handling channel access procedures comprises a storage device storing instructions and a processing circuit coupled to the storage device. The processing circuit is configured to execute the instructions stored in the storage device. The instructions comprise receiving a first Physical Downlink Control Channel (PDCCH) signal indicating a first channel access procedure and a first priority class of the first channel access procedure from a network; performing the first channel access procedure with the network, after receiving the first PDCCH signal; receiving a second PDCCH signal indicating a second channel access procedure and a second priority class of the second channel access procedure from the network; and determining to continue or terminate the first channel access procedure with the network according to a comparison of the first priority class and the second priority class, after receiving the second PDCCH signal.