A high speed connector assembly is disclosed in this invention, including a receptacle connector and a plug connector. Each receptacle terminal of the receptacle connector disposes a first L-type contact piece, and each plug terminal of the plug connector disposes a second L-type contact piece. When the receptacle connector and the plug connector are electrically engaged, an extension section of the first L-type contact piece is pressed on a straight part of the second L-type contact piece, and an extension part of the second L-type contact piece is pressed on a straight section of the first L-type contact piece. So this engagement can form a double-contacts structure to restrain the short pile effect and reduce the crosstalk and loss at high speed signal transmission. A receptacle connector and a plug connector are also disclosed in this invention.