A conveying device includes: first rollers; second rollers; and a roller holder. Each first roller is movable along a conveying direction of a sheet between a first position and a second position. The roller holder includes: a roller accommodating portion; an abutment member; and a slide portion. The abutment member is movable along the conveying direction between a third position and a fourth position. The abutment member moves each first roller from the first position to the second position while moving from the third position to the fourth position, and moves each first roller from the second position to the first position while moving from the fourth position to the third position. The slide portion is movable along an arrayed direction of the first rollers between a fifth position and a sixth position. The slide portion is moved from the fifth position to the sixth position to move the abutment member from the third position to the fourth position, and moved from the sixth position to the fifth position to move the abutment member from the fourth position to the third position.