A new approach to agent performance evaluation includes real-time transcription of a call or chat from a customer and a real-time scorecard analysis performed on an agent's device as the agent and the customer communicate with each other. The real-time scorecard analysis may be conducted based on a set of live score rules from the server side. The agent can get an immediate scoring feedback through a user interface on the agent's device. Additional analyses, such as a sentiment analysis, a summary analysis, etc., can be performed on the server side and displayed to the agent through the user interface on the agent's device. The agent's automatically generated performance score can be made available to the agent's manager, on-demand and/or in real time, allowing the manager to monitor, evaluate, and/or manage the agent's performance even as the agent converses or chats with the customer.