KPI Tree

Metric Definition

Topic distribution

Topic Share = Conversations Tagged with Topic / Total Classified Conversations
Conversations Tagged with TopicConversations assigned to a given topic or theme
Total Classified ConversationsAll conversations that received a topic label

Track from

Conversation topic analysis

Conversation topic analysis is the practice of classifying customer conversations into themes, then measuring how much of your contact volume each theme accounts for. It answers the question of what customers are actually contacting you about, in proportions you can act on. When topics are decomposed into their drivers, the analysis points to the upstream causes that generate the contacts.

8 min read

Generate AI summary

What is conversation topic analysis?

Conversation topic analysis is the practice of classifying customer conversations into themes and measuring how much of your contact volume each theme accounts for. A model or a tagging scheme reads each conversation and assigns it to a topic, for example billing, password reset, shipping delay, or feature request. Those topics roll up into a distribution that shows what customers are actually contacting you about and in what proportion.

The value of topic analysis is that it turns an undifferentiated pile of tickets into a ranked list of problems. Raw ticket volume tells you how busy the team is. Topic analysis tells you why. A spike in volume is far easier to act on once you know that 40 percent of it is one billing edge case rather than a broad rise across the board.

Topic analysis is most useful when it runs continuously and feeds back into the teams who can remove the cause. A topic that keeps growing is a standing invitation to fix something upstream, whether that is a confusing checkout step, an unclear policy, or a recurring bug.

A topic taxonomy is only as good as its consistency. If the same conversation could plausibly land in three different topics, the distribution becomes noise. Keep topics mutually distinct, review the taxonomy regularly, and avoid a catch-all bucket that quietly swallows half your volume.

How to calculate conversation topic analysis

Topic analysis is built on topic share: the fraction of classified conversations that fall under each theme. The shares across all topics add up to one. The analysis becomes powerful when you track each share over time and pair it with the cost and outcome attached to that topic.

  1. 1

    Topic taxonomy

    The fixed list of themes you classify into. A good taxonomy is specific enough to be actionable but small enough to stay consistent, typically ten to thirty topics rather than hundreds.

  2. 2

    Classified conversations

    The conversations that received a topic label. Decide whether to classify everything or a sample, and apply one rule consistently so shares stay comparable across periods.

  3. 3

    Conversations per topic

    The count assigned to each theme. This is the raw input to topic share and the number that reveals which problems generate the most contact.

  4. 4

    Cost and outcome per topic

    The handle time, resolution rate, and follow-on cost each topic carries. A small topic that takes hours to resolve can matter more than a large topic that closes in one reply.

Reporting topic share alone can mislead, because two topics with the same share can carry very different load. Weight each topic by handle time or by its effect on satisfaction to find the topics that are genuinely expensive, not just frequent. The combination of share and cost is what turns topic analysis into a prioritisation tool.

Conversation topic analysis in a metric tree

A topic distribution tells you what customers contact you about, but not what produced the contact. A metric tree decomposes a topic into the upstream events that generate it, so a growing topic can be traced back to an ownable root cause rather than treated as a fact of life.

The first level groups topics by where they originate. Product issues come from bugs and confusing flows. Process and policy issues come from rules customers struggle with. Information gaps come from things customers cannot find or understand. Each group decomposes into specific, countable drivers, like a failed deploy, a checkout step, or a missing help article.

This structure changes the conversation. Instead of staffing up to absorb a rising topic, the tree shows whether the right move is a product fix, a policy change, or a documentation update that prevents the contact entirely.

Metric tree insight

Information-gap topics are usually the cheapest to eliminate. When a metric tree shows that a large, growing topic is just customers unable to find an answer, a single clear help article or in-product hint can remove thousands of conversations without touching the product itself.

Conversation topic analysis benchmarks

There is no universal benchmark for any single topic, because the right distribution depends entirely on your product and customers. What does generalise is the shape of a healthy distribution and how concentrated it should be. Use these patterns as a lens on your own data rather than as fixed targets.

Distribution patternTop topic shareWhat it usually means
Healthy and diffuseNo single topic over 15 percentContacts spread across many small topics. Usually a sign of a mature product where the obvious friction has already been removed.
ConcentratedOne topic at 15 to 30 percentA single theme dominates. This is the best kind of problem to have, because fixing one upstream cause removes a large, visible chunk of volume.
SpikingA topic doubling week over weekSomething just changed: a deploy, a policy update, or an outage. The fastest path is to find the change and reverse or communicate it.
Long tail of unknownsCatch-all bucket over 20 percentThe taxonomy is failing. Too many conversations land in other, so the distribution cannot guide action until the topics are refined.

Watch the rate of change of each topic share more than its absolute level. A topic that holds steady at 12 percent is a known cost. A topic climbing from 3 percent to 9 percent in a month is a new problem that has not yet been named. Pair each rising topic with its average resolution time to judge whether it is also expensive to handle.

How to improve conversation topic analysis

Improving topic analysis means two things: making the classification trustworthy, and acting on what it reveals. A precise distribution is worthless if nobody removes the causes behind the largest topics.

Refine the taxonomy

Keep topics distinct and actionable. Split a bucket the moment it grows large and vague, and retire topics that no longer earn their place. A clean taxonomy is the foundation everything else stands on.

Trace topics to root causes

For each large topic, decompose it into the upstream events that generate it. The goal is to stop describing what customers ask and start naming what produced the question.

Route topics to owners

Send each topic to the team that can remove its cause. Bugs go to engineering, policy friction goes to operations, information gaps go to content. A topic without an owner keeps growing.

Prioritise by cost, not count

Rank topics by total handle time and downstream impact, not raw frequency. The most valuable fix is often a mid-sized topic that quietly consumes hours of agent time per case.

The metric tree approach starts by ranking topics on share and cost together, then decomposing the heaviest into the events that create it. That tells you whether to ship a fix, change a policy, or write a help article.

KPI Tree lets you connect each topic to the team that owns its root cause. Engineering owns the bug topics. Finance owns the billing topics. Product and content own the information gaps. With RACI ownership on every node, the accountable owner is pushed when their topic starts climbing, and a verified impact loop confirms that the fix they shipped actually reduced the contacts rather than just moving them to a different bucket.

Common mistakes when tracking conversation topic analysis

  1. 1

    Letting the catch-all bucket grow

    An other bucket that absorbs a fifth of conversations hides your biggest unnamed problems. Audit it regularly and promote recurring patterns into their own topics.

  2. 2

    Ranking by frequency alone

    The most frequent topic is not always the most costly. Weight by handle time and outcome so a slow, painful topic is not buried under a fast, common one.

  3. 3

    Changing the taxonomy without versioning

    Renaming or merging topics mid-stream breaks the trend line. Version the taxonomy and annotate the chart so shifts are not mistaken for real changes in customer behaviour.

  4. 4

    Stopping at description

    Knowing that 20 percent of contacts are about returns is the start, not the finish. Without decomposing the topic into its causes, the analysis cannot drive a fix.

  5. 5

    Ignoring topics that never resolve

    A topic with high reopen rates points to a systemic issue the team cannot close. Watch resolution quality per topic, not only the share.

Related metrics

Ticket Volume

Customer Support Metrics

Metric Definition

Ticket Volume = Total New Tickets Created in Period

Ticket volume is the total number of new support tickets created within a defined period. It is the fundamental demand metric for support operations, determining staffing requirements, budget allocation, and the urgency of self-service and product quality investments.

View metric

Average Resolution Time

Customer Support Metrics
SalesforceIntercomPylon

Metric Definition

Average Resolution Time = Total Resolution Time Across All Tickets / Total Tickets Resolved

Average resolution time measures the mean elapsed time from when a support ticket is created to when it is fully resolved and closed. It captures the end-to-end customer experience of getting an issue fixed, encompassing wait times, agent work time, escalations, and any back-and-forth exchanges required to reach a solution.

View metric

Escalation Rate

Customer Support Metrics
Pylon

Metric Definition

Escalation Rate = (Escalated Tickets / Total Tickets Handled) x 100

Escalation rate measures the percentage of support tickets that are transferred from one tier or team to a higher tier or specialist group for resolution. It reflects the gap between the issues customers raise and the ability of frontline agents to resolve them, making it a key indicator of agent readiness, process maturity, and product complexity.

View metric

First Response Time

Customer Support Metrics
IntercomPylon

Metric Definition

FRT = Total First Response Times / Total Tickets With a First Response

First response time measures the elapsed time between a customer creating a support ticket and receiving the first substantive response from a human agent. It is the metric that shapes the customer's initial impression of the support experience and sets the tone for the entire interaction.

View metric

Metric trees for customer success

Metric Definition

See how conversation topic analysis sits within a wider tree of support and success metrics so the team can act on what each topic cluster is telling them.

View metric

Churn rate analysis

Metric Definition

Connect the topics surfacing in support conversations to retention outcomes, since recurring problem themes are often early signals of churn risk.

View metric

Decompose your topics and remove the causes

Build a topic metric tree that traces each theme back to the upstream events that create it, with the accountable owner alerted when their topic starts to climb.

Experience That Matters

Built by a team that's been in your shoes

Our team brings deep experience from leading Data, Growth and People teams at some of the fastest growing scaleups in Europe through to IPO and beyond. We've faced the same challenges you're facing now.

Checkout.com
Planet
UK Government
Travelex
BT
Sainsbury's
Goldman Sachs
Dojo
Redpin
Farfetch
Just Eat for Business