Skip to content
AI Knowledge Base

A support copilot that knows when to hand off

Grounded in your knowledge base and resolved tickets, it answers routine questions with citations, drafts replies for agents, and escalates with context when it is unsure.

  • Agent assist live in 6–10 weeks
  • Confidence gate before any customer answer
  • Works inside Zendesk, Salesforce and others
Who this is for

Support teams drowning in questions the knowledge base already answers

If a large share of your tickets are "how do I" questions with a documented answer, a copilot pays for itself in agent time. If most tickets need account access or judgement, start with agent assist and keep humans in the loop.

The copilot sits on top of the same retrieval layer as our enterprise RAG builds. What makes it a support product is the confidence gate, the hand-off with context, and the feedback loop that turns every edited draft into an improvement. We run exactly this pattern inside Eventify, our own event platform, where an AI support bot handles organiser and attendee questions.

Outcomes we design for
  • Routine questions answered with a cited article, instantly
  • Agents start from a sourced draft, not a blank reply box
  • Low-confidence and sensitive cases go to a human every time
  • Knowledge gaps surface as a ranked list for the content team
  • Deflection and edit rates measured from day one
  • Brand tone and policy rules enforced in every answer
Deflection flow

One retrieval path, two exits, one feedback loop

Support copilot deflection flow: a question is answered from the knowledge base, passed through a confidence gate, then either answered to the customer with citations or handed to an agent with a draft and sources; both outcomes feed evaluation and knowledge gaps back to the knowledge base Customer asks chat, email, portal Retrieve from KB articles, macros, tickets draft Confident and safe topic? yes Answer the customer with a cited article no, or sensitive Agent gets draft + sources reviews, edits, sends Feedback and evals ratings, edits, resolution thumbs up or down missing articles written, thresholds retuned
Every question goes through the same retrieval. The gate decides whether the customer sees the answer directly or an agent sees it first. Both exits feed ratings and edits back into evaluation, and the gaps they reveal go back into the knowledge base.

The confidence gate is not one number. It combines the retrieval score of the best passage, the agreement between the top passages, a topic classifier for sensitive categories, and the customer's account state where the integration allows it. The thresholds are set from the pilot data and retuned as the evaluation set grows. The hand-off always includes the draft and its sources, so the agent gains time even when the system was not sure.

Two modes

Agent assist first, customer-facing deflection when the numbers support it

Agent assist

The copilot lives inside the helpdesk. For each new ticket it shows a drafted reply, the articles it used and a confidence indicator. The agent edits and sends. Every edit is logged.

  • Low risk: a human approves every answer
  • Best source of training signal: edits show exactly what was wrong
  • Typical first scope: top 20 ticket categories by volume

Customer-facing deflection

In chat, the help centre or the ticket form, the copilot answers directly when the gate passes. It always offers a route to a person, and it never pretends to be one.

  • Opened topic by topic as evaluation scores allow
  • Sensitive categories routed to humans by rule, not by confidence
  • Brand tone, refusal rules and disclosure wording enforced

Both modes share the conversation design and guardrails we use in AI chatbots, including handling of abusive input, repeated questions and attempts to extract other customers' data. The prompt injection defence page covers the controls in detail.

What we deliver

Everything between your knowledge base and your agents' screens

  • Knowledge ingestion

    Help-centre articles, internal macros, product docs and anonymised resolved tickets, each tagged with its source type so official content wins ties. Stale and duplicate articles are flagged during the audit.

  • Draft generation with citations

    Replies in your tone, with the articles used shown alongside. Variables such as plan names and limits are pulled from the account record, not guessed from the article.

  • Confidence gate and routing

    Threshold logic, sensitive-topic rules and hand-off payloads that drop into the helpdesk's existing assignment and SLA workflows.

  • Measurement dashboard

    Deflection rate, draft acceptance and edit distance, escalations by reason, and a ranked list of questions with no good source. This is the list your content team works from each week.

  • Evaluation set and release gate

    Real tickets with approved answers, scored for correctness, tone and policy compliance on every prompt or model change. The method follows our guide to evaluating LLM outputs.

How we work

From ticket analysis to a copilot your agents trust

  1. Ticket and knowledge audit

    One to two weeks. We cluster recent tickets by intent, map each cluster to the articles that should answer it, and find the gaps. Output: the first-release scope and a content fix list.

  2. Integrate and ingest

    Helpdesk connection, knowledge ingestion with source tagging, anonymisation of ticket history. Retrieval tuned on the audit's question set.

  3. Agent-assist pilot

    A pilot team of agents uses drafts for two to four weeks. We track acceptance and edits daily and fix the top failure modes each week.

  4. Open deflection by topic

    Topics whose scores and edit rates pass the agreed bar are opened to customers. Sensitive topics stay human by rule. Thresholds are reviewed monthly.

  5. Operate and improve

    Weekly gap list to the content team, monthly evaluation review, and a retainer if you want us to keep tuning. Monitoring follows our LLMOps practice.

FAQ

Frequently asked questions

Should we start with customer-facing deflection or agent assist?

Agent assist, almost always. It uses the same retrieval and the same knowledge base, but a human reviews every answer, so the risk is low and the feedback is rich. Once edit rates fall and the question set scores well, the same system can be opened to customers for the topics it handles best.

What happens when the copilot is not confident?

It does not guess. Below the agreed threshold, or on sensitive topics such as billing disputes and cancellations, the conversation goes to a human with the draft answer and the sources attached. The agent sees why the system was unsure, which also tells your knowledge team what is missing.

Which helpdesk systems do you integrate with?

Zendesk, Salesforce Service Cloud, Freshdesk, Intercom, HubSpot and ServiceNow are the common ones. The copilot reads knowledge articles, macros and resolved tickets, and writes drafts back into the agent's workspace. See customer support AI for the wider solution.

Can we use resolved tickets as knowledge?

Yes, with care. Resolved tickets are the richest source of real answers, but they contain personal data and outdated advice. We anonymise, deduplicate and date-filter them, and keep them separate from official articles so the copilot can prefer the official source.

Do you have a support copilot of your own?

Yes. Our event platform Eventify includes an AI support and knowledge bot for organisers and attendees, built on the same retrieval approach described here. The case study describes what we learned running it.

How long does it take to go live?

Agent assist is usually live in 6–10 weeks, including knowledge audit, helpdesk integration and a pilot team. Customer-facing deflection follows once the evaluation set and the pilot edit rates support it, often another 4–6 weeks. Talk to us about your queue.

Ready to make AI work in production?

Tell us about your systems, your data and your constraints. We reply within one business day with a straight answer and a suggested next step.