A beverage machine having a beverage brewing unit for receiving a single-serve capsule and including a capsule holding assembly for holding a capsule in a position during insertion by gravity of the capsule in the brewing unit; and a water injection assembly for at least partially enclosing the capsule and providing water in the capsule. The capsule holding part forms a front part of the unit and is mounted to the capsule injection assembly in a manner to be displaceable along a substantially horizontal path whereas the water injection assembly is located in a rear fixed part of the unit. The beverage machine has an outermost casing. One of these brewing unit assemblies can be moved or telescoped out or through this casing for inserting/removing the ingredient capsule and retracted into the outermost casing for bringing the brewing unit into its capsule extraction configuration.