An AI agent may be trained using online session logs of actual customers interacting with an online software application. Datasets may be generated using the session logs, and the AI agent may be trained to use the online application by applying various machine learning techniques to the datasets. The AI agent may be provided login credentials and instructed to log into and perform specified tasks using the online application as part of training. Once trained, the AI agent may be instructed to perform the same or other tasks using a modified version of the application. The AI agent mimics the responses and behaviors of actual users of the modified application. The AI agent can be trained to mimic users sharing a certain demographic characteristic, and its performance can be used to more effectively and efficiently enhance the software application for users at large and/or for users in the demographic.