An adjustment device of a punching device punches a workpiece on a die so that the workpiece is punched into a predetermined shape. The adjustment device includes a first drive mechanism that moves the punch or the die in a direction orthogonal to a punching direction, and a controller connected to the first drive mechanism. The controller brings the punch and the die into contact with each other by moving the punch or the die in four orthogonal directions in a plane perpendicular to the punching direction from an initial position where the punch is inserted into the punching die. The controller causes the first drive mechanism to move the punch or the die to a center position where a central axis of the punch and a central axis of the die are aligned with other.