A device for removing at least one teat cup (1a) from a teat of an animal includes i) a cylinder (2) provided with a movable piston (3) dividing an inner space of the cylinder in a first compartment (4) and a second compartment (5), ii) a valve mechanism (9) adapted to connect a vacuum source (8) to the first compartment (4) when it is in a first position and to break this connection when it is in a second position, iii) a passage (15) leading into the first chamber (4), and iv) a valve member (16) adapted to allow a flow through the passage (15) to the first compartment (4) during occasions when an operator moves the teat cup (1a) from a storing position to a teat attaching position.