A card edge connector (100) includes an insulative housing, a set of contacts (2) retained in the insulative housing and an ejector (3). The insulative housing has a central slot (12) and one tower portion (13) having a receiving slot (135). The contacts protrude into the central slot. The ejector has a main portion (31) received in the receiving slot, an ejecting portion (34) extending from a lower end (35) of the main portion, a locking portion (32) extending inwardly from an upper end of the main portion, and a lever portion (37) extending outwardly from the upper end of the main portion. The locking portion has a pair of vertical portions (324), and a transverse portion (323). The transverse portion connects the vertical portions and divides the vertical portions into upper and lower retaining parts.