In a shift lever device, at a time when a shift lever is pivotally operated in a front-rear direction, a retainer and a link are pivoted integrally with the shift lever, and a pivot portion is pivoted in the front-rear direction. Further, at a time when the shift lever is pivotally operated in a left-right direction, the shift lever is pivoted with respect to the retainer, and the link is pivoted, and the pivot portion is thereby pivoted in the left-right direction. Moreover, a position of the pivot portion is detected by a detecting mechanism, and a shift position of the shift lever is detected. Therefore, the shift position of the shift lever can be detected via the link.