The disclosed computer-implemented method may include (i) receiving a video stream for encoding, (ii) determining that the video stream is associated with an application, (iii) analyzing the video stream to label one or more regions of a frame within the video stream with a semantic category, (iv) determining, based at least in part on the application with which the video stream is associated, a prioritization of the semantic category, and (v) allocating encoding resources to one or more portions of the frame that comprise at least a part of the one or more regions of the frame based at least in part on the prioritization of the semantic category. Various other methods, systems, and computer-readable media are also disclosed.