Deflecting common questions with AI to improve customer support agent efficiency at MasterClass while maintaining CSAT.
Agatha helped us in time to resolution...by allowing us to spend more quality time with the more challenging type of tickets.
MasterClass is a fast-growing online education platform that creates expert-led courses around the world. Due to their accelerated and continuous growth, MasterClass was looking for a tool or software to make their customer support experience more efficient and effective. MasterClass wanted to increase their customer satisfaction score while decreasing their first-reply time and total resolution time. To do so, MasterClass needed a way to deflect the Tier 1, ‘simple’, customer inquiry tickets so that the support agents can spend more time focusing on the Tier 2, ‘escalated’, support tickets.
Prior to Forethought & Agatha, MasterClass’ support process was as expected: support agents simply handled all tickets manually. However, the support team realized that Tier 1 tickets do not need agents to solve. A ‘simple’ Tier 1 ticket, for example, would be a billing issue: “How do I cancel my subscription” or “I want a refund”. While Tier 2 tickets are typically more technical and therefore commonly escalated issues. An example of a Tier 2 ticket would be: “My video is too slow or doesn’t work.” These tickets would need a human customer support agent to provide the customer with a resolution.
MasterClass’ Customers get accurate answers and agents don’t have to spend energy on mundane questions. With traditional Customer Support AI systems, there is a tradeoff between deflection and customer experience and CSAT. However, with Agatha this challenge is eliminated.
At over 90% accuracy, Agatha significantly outperforms other AI. Forethought’s Agatha was trained on MasterClass’ unique data to create dedicated models to support deflection. She uses Natural Language Understanding (NLU), an AI technology, to understand and deflect - and to ramp up qiuckly. Because she’s trained on MasterClass’ specific data, she has great models and can kick off her work supporting support agents in as little as 24 hours.
Agatha - or as she’s known at MasterClass, Alfred - has had a measurable impact on the team. MasterClass’s customer satisfaction has increased by approximately 3%, while the first-reply time has gone from 2 to 3 hours to 15 - 20 minutes. Additionally, over 8% of support tickets are currently being deflected. This deflection is allowing the simple tickets to be dealt with quickly, and is allowing MasterClass’ Customer Support Agents to tackle the challenging sooner because they aren’t solving easy inquiries.
I think why we see this increase in customer satisfaction, is because now our agents are spending time with these more challenging tickets and responding back quicker because they don’t have to deal with these easy, kind of one-off tickets, and so that helps us [MasterClass] drive better performance overall.
In addition to bringing in Agatha Answers to support new agents, MasterClass is working with the Forethought team to make Agatha even more accurate. Specifically, MasterClass is focused on streamlining their internal processes to increase ticket deflection accuracy. This next step is where MasterClass and Forethought work together to enhance the customer experience.