Methods and systems disclosed herein relate generally to systems and methods for predicting content based on vector data structures generated from image pixels. A content-prediction application accesses a color palette having two or more color-palette categories and selects a first color of the color palette. The content-prediction application generates a first vector based on a set of pixel values that represent the first color of the color palette. The content-prediction application determines a distance metric between the first vector and a second vector, in which the second vector is identified by applying a convolutional neural network model on an image depicting an item that includes a second color. In response to determining that the distance metric is less than a predetermined threshold, the content-prediction application selects the content item corresponding to the second vector.