A method, apparatus, system and a computer program product are provided for scoring performance of a chatbot by capturing specified node performance metrics based on user interactions with one or more nodes in a dialog flow for the chatbot; assigning a score to each of the one or more nodes based on the specified node performance metrics; and assessing a performance measure for at least a portion of the chatbot by combining scores assigned to selected nodes in the dialog flow.