In implementations of segmenting objects in vector graphics images, an object segmentation system can obtain points that identify an object in a vector graphics image, and determine a region of interest in the image that includes the object based on the points that identify the object. The object segmentation system can generate a heat map from the points that identify the object in the image, and a rasterized region from rasterizing the region of interest. The object segmentation system can generate a mask from the rasterized region and the heat map, the mask identifying pixels of the object in the rasterized region, and determine, from the mask, paths of the vector graphics corresponding to the object.