A system and method of animating an image of an object may include: receiving a first image, depicting a “puppet” object; sampling an input video, depicting a second, “driver” object, to obtain at least one second image; obtaining, by a first machine-learning (ML) model, a first identity-invariant feature of the puppet object, from the first image; obtaining at least one second identity-invariant feature of the driver object, from the respective at least one second image; calculating, by a second ML model, a transformation function, based on the first identity-invariant feature and the at least one second identity-invariant feature; applying the calculated transformation function on the first image, to produce one or more third images, depicting a target object, including at least one identity-invariant feature of the driver object; and appending the one or more third images to produce an output video depicting animation of the puppet object.