Implementations are directed to methods for providing an enhanced encounter via a holographic virtual assistant, including detecting, by one or more processors, an encounter request from a user, selecting a first encounter including a first holographic representation and a first dialog output, providing the first encounter for presentation to the user on the holographic virtual assistant, receiving, from the user, a first user reaction, the first user reaction including a first user dialog input and a first user engagement input, and training, using the first user reaction, a conversational goal model.