Aspects are provided that allow a base station to use visual information of interfering UEs for optimizing shared channel access and beam and interference management and tracking. The base station may obtain visual information of a UE. The base station may then access a shared channel to communicate with the UE based on the visual information. After accessing the shared channel, the base station may communicate with the UE over the shared channel using one or more beams based on the visual information. Efficient channel access and communication in mmW environments may thereby be achieved.