Aspects of the present disclosure, in certain embodiments, are directed toward providing a visual representation of question quality in a question answering system. More particularly, aspects are directed toward receiving, by a question answering system, an input question having a set of query attributes. The set of query attributes may be user-influenced characteristics of the input question. Aspects of the present disclosure are also directed toward evaluating, by comparing the set of query attributes to a set of assessment criteria, the quality of the input question. Aspects of the present disclosure are also directed toward assigning, in response to evaluating the quality of the input question, a set of quality values to the set of query attributes. Using the assigned set of quality values and the set of query attributes, an icon that indicates a visual representation of the quality of the input question may be generated.