How to trial an AI operator: preparation, 10 test calls and measuring the result
Sado AI team · · 4 min read
In short
An AI operator trial has three stages. First prepare a fact sheet: prices, address, hours, the most common questions and the rule for transferring to staff. Then make 10 test calls: a simple question, a booking, a question the sheet doesn’t cover, mixed speech, Russian, noise, “are you a robot?”, “put me through to a manager”. Finally give one flow, such as after-hours calls, to real customers for one or two weeks, listen to recordings daily and compare the numbers you chose in advance.
Before the trial: what to prepare
- A fact sheet: prices, address and landmark, hours, delivery or booking terms. The operator answers only from it.
- The 10–15 questions customers ask most, with a short answer to each.
- A transfer rule: when, and to whose phone. For example, “complaints to the manager, ready to buy to a salesperson”.
- Topics the operator must avoid: discounts you don’t offer, medical or legal advice.
- Testers: 3–4 staff of different ages, with female and male voices.
- Write down in advance what you’ll measure, or the trial ends with “liked it, didn’t like it”.
10 test calls
| Situation | What to say | What should happen |
|---|---|---|
| Simple question | “Are you open on Saturday?” | The exact answer from the sheet |
| Booking | “Book me for tomorrow morning” | Checks the day, time and name |
| Unknown question | Ask something not on the sheet | Doesn’t invent; creates a task for a manager |
| Mixed speech | Uzbek with Russian words: “zakaz”, “dostavka” | Answers in Uzbek |
| Russian | Speak Russian | Carries on in Russian |
| Interrupting | Talk while the operator is speaking | Stops and listens |
| Noise | Call from the street or a car | Understands or asks again |
| “Are you a robot?” | Ask directly | Doesn’t pretend to be human |
| Asking for a person | “Put me through to a manager” | Transfers by rule or agrees a callback |
| “Don’t call me” | Say it on an outgoing call | That number isn’t called again |
After each call, open the recording and transcript: see what the operator said and which answers it recorded. Questions to send the vendor beforehand: 13 questions to ask a voice AI vendor.
The trial on real calls
- Pick one flow: after-hours and weekend calls, or a reminder list for tomorrow’s appointments.
- Connect your number: the operator connects to it over SIP, and customers keep calling the same number.
- For outgoing calls, set hours and a daily limit, and list only customers you may call.
- Run it for one or two weeks. Every day, listen to 5–10 recordings and note the mistakes.
- Found a mistake? Check the sheet first: is the fact there, and is it clear? Fill the gap and listen again.
What to measure
- Answered calls, compared with how many went unanswered at those hours before: counting missed calls.
- Bookings, orders and requests.
- Calls transferred to staff and tasks left for managers.
- Mistakes found in recordings: wrong answers, unnecessary questions, misunderstandings.
- Minutes and cost: the portal shows the cost of each call.
For example, two weeks of night calls only: 20 two-minute calls a night × 14 nights = 560 minutes × 800 so‘m = 448,000 so‘m. These numbers are only an example. No monthly or setup fee: pricing.
The decision: continue, expand or stop
If the numbers look good, add the next flow: lunchtime and evenings, then outbound calls. If there are many mistakes, find the cause in the recordings and test one flow for another week. More on incoming calls: AI operator for incoming calls. Before all that, try it live or call 78 778 01 23.
Questions
Where should a trial start?
First talk to the operator live in your browser on the website, or call 78 778 01 23, which Sado’s own operator answers. Then test on your own number with your own facts.
How much does a trial cost?
You pay only for talked minutes: 800 so‘m a minute, no monthly or setup fee. Unanswered numbers cost nothing.
If we don’t like the result, can we stop?
Auto-calls stop with one button, and you set the operator’s hours yourself. With no monthly fee, time without conversations costs nothing.