A water-cooled EGR cooler is to be supplied with exhaust gas from an exhaust line and is to re-circulate the cooled exhaust gas to an intake line. A housing has an exhaust inlet, an exhaust outlet, a coolant inlet, and a coolant outlet. A heat exchange member is disposed in the housing and includes exhaust gas passages from the exhaust inlet to the exhaust outlet at a predetermined interval and also includes a coolant passage through which coolant can flow from the coolant inlet to the coolant outlet between the exhaust gas passages. A pipe member includes a bypass passage formed between an upper surface of the heat exchange member and an inside upper surface of the housing to allow the exhaust gas to bypass the heat exchange member and flow between the upper surface of the heat exchange member and the coolant outlet.