An image forming apparatus may include a first and second mode. In the first mode, the image forming apparatus uses a second charging member to charge toner that remains on an intermediate transfer member and then transfers the charged, remaining toner to an image carrier in a primary transfer portion. In the second mode, the image forming apparatus transfers the remaining toner adhered to the second charging member in the first mode to the intermediate transfer member. Also in a second mode, the image forming apparatus controls so that a surface potential of the image carrier that reaches the primary transfer portion at a timing at which the remaining toner transferred to the intermediate transfer member passes through the primary transfer portion has a same polarity as that of a surface potential of the image carrier in the first mode and also has an absolute value smaller than that thereof.