A method and a device for determining the self-motion of a vehicle in an environment are provided, in which at least part of the environment is recorded via snapshots by an imaging device mounted on the vehicle. At least two snapshots are analyzed for determining the optical flows of image points, reference points that seem to be stationary from the point of view of the imaging device being ascertained from the optical flows. The reference points are collected in an observed set, new reference points being dynamically added to the observed set with the aid of a first algorithm, and existing reference points being dynamically removed from the observed set with the aid of a second algorithm.