An electrical connector for electrically connecting a central processing unit (CPU) comprises an insulating housing having a plurality of terminals received therein and a pick-up cap removably assembled to the insulating housing for carrying and placing the CPU onto the insulating housing. The insulating housing has a plurality of receiving slots sunk from top surfaces of two sidewalls thereof and a plurality of wedge-shaped grooves disposed between the receiving slots on one same sidewall. The pick-up cap defines a plurality of hooks extending therefrom for buckling to the insulating housing. The pick-up cap also defines a plurality of latches corresponding to the receiving slots and a plurality of releasing arms corresponding to the grooves. The latches received in the receiving slots can clasp the CPU to retain the CPU on the pick-up cap and be released the CPU when the releasing arms are pulled outwardly.