A hydraulic brake handle assembly, wherein the response time of the hydraulic brake caliper can be much improved, and the brake action can be carried out immediately. When the brake lever is pressed, the volume of the oil pushed by the piston is doubled due to the hydraulic brake handle assembly is provided with two piston portions inserted in two oil chambers. Since the response time of the hydraulic caliper of the present invention is improved, it allows the brake pads of the hydraulic caliper to be assembled at a relatively large distance from the brake disc, so that sand won't get struck between the brake pads and the brake disc, and the brake disc remains useful when they are bent out of plain rubbing after using.