An electrical connector assembly includes an electrical connector and a pick-up cap assembled to the electrical connector. The electrical connector has an insulative housing defining a substantially rectangular cavity in a middle thereof and a plurality of contacts received in the cavity. The pick-up cap includes a main portion with a planar top surface and a plurality of latching arms extending from two opposite edges of the main portion for engaging with the electrical connector. Each latching arm has an engaging arm extending in a direction for engaging with the electrical connector and a pressing arm extending in an opposite direction. When the pressing arm is pressed inwardly, the engaging arm expands outwardly to release the electrical connector.