Embodiments of systems and methods for providing controller gestures in virtual, augmented, or mixed reality (xR) applications are described. In some embodiments, an Information Handling System (IHS) may include a processor and a memory coupled to the processor, the memory having program instructions stored thereon that, upon execution, cause the IHS to: receive one or more first Simultaneous Localization and Mapping (SLAM) landmarks corresponding to a first controller; receive one or more second SLAM landmarks corresponding to a second controller; determine, using the first and second SLAM landmarks, that the first controller is within a threshold distance of the second controller; in response to the determination, receive first Inertial Measurement Unit (IMU) data from the first controller and second IMU data from the second controller; identify, using the first and second IMU data, a gesture performed with the first and second controllers; and execute a command associated with the gesture.