A semiconductor device structure includes a first dielectric layer disposed over a semiconductor substrate, and a second dielectric layer disposed over the first dielectric layer. The semiconductor device structure also includes a first conductive plug disposed in the first dielectric layer, and a second conductive plug disposed in the second dielectric layer and directly over the first conductive plug. The semiconductor device structure further includes a silicide portion disposed between the first conductive plug and the second conductive plug.