A terminal block with a handle structure includes an insulation base having an accommodation space, an insertion port, and a side opening. The insulation base has a limit column and a pivot part formed in the accommodation space. A conductive terminal includes a conductive body and plural lead pins, and the conductive body is positioned in the accommodation space, and the lead pin passes out from the insulation base. An elastic plate includes an abutting arm with a curved surface, a bend section sheathing the limit column, and the abutting arm is suspended on a side of the insertion port, and a pivot of the handle structure is combined with the pivot part to make a handle protrude from the insulation base, and a pressing cam abuts against the curved surface of the abutting arm, so that the handle structure may avoid damages and provide a labor-saving effect.