Skip to content
Wetel
Go back

Which voice should my AI employee use for which language?

Every speaking voice belongs to one language and one quality tier, so you pick a voice by its language code first and its tier second, and keep the agent’s language, tier and voice name in agreement. The language your AI employee listens in is a separate setting from the voice it speaks with, so a Malay voice does not by itself make it listen for Malay.

Think of a receptionist with two skills you hire for separately: how well they understand callers, and how they sound on the phone. A lovely voice tells you nothing about their ear.

How do I pick a voice for a language?

Start from the language code, then choose a tier, then a voice name from the same row of the speech provider’s published list. A voice name is built as <language>-<tier>-<name>, so it already carries both the language and the tier. Three agent settings have to agree with it:

If they disagree, the request may be rejected or the voice ignored; do not rely on either. Wetel keeps no list of its own, because the provider adds and retires voices on its own schedule. The agentConfigOptions query returns links to both catalogues and a short curated voice list.

If you only want a natural default, pick a tier and a language and leave the voice name alone. A workspace can also set default voice settings once; a value set on the agent always takes precedence.

What do the tiers trade off?

There are five tiers, from cheapest and clearly synthetic to a narration tier that is not meant for live chat. As the docs describe them:

Tier, in orderUse it forRelative cost
The lowest tierCheapest, clearly syntheticLowest
The second tierBetter quality, still budgetLow
The middle tierNatural; a safe defaultMedium
A higher tierThe most natural for live conversationAbout 2x the middle tier
Narration tierRecorded content; not for real-time chatAbout 10x the middle tier

The exact tier values are in the guide’s text-to-speech section. “Natural” is the docs’ description, not a score we measured.

How is the listening language set?

With a primary language and up to three alternatives, all separate from the voice. The primary has by far the biggest effect on what the listener hears correctly; if you leave it empty, the agent’s speaking language is used. The alternatives are extra languages it may switch to:

There are two listening engines. One uses the primary and alternatives above. The other works out the language itself and ignores both settings. Which one your environment uses by default is in the speech service reference.

What about replies that mix languages?

Speaking mixed-language text is untested. A voice reads in its one language, so Malay words inside an English sentence may sound foreign. A slower route meant for recorded voice notes works out the language from the text and may do better, but we have not measured it. The docs’ advice is to have a native speaker listen to your own phrases on every voice you plan to ship.

For listening to mixed speech, see voice notes in English, Malay and Chinese.

What have we not measured?

We have not measured accuracy on recordings of your users. Our own tests used generated speech and openly licensed public recordings, not spontaneous Malaysian speech that mixes Malay, English and Chinese. So treat any setup as a starting point: collect real clips, write the correct text by hand, and compare before you go live.

Whatever you pick, the workspace owner decides which voice speaks for the business, and a person should listen before customers do.

To set up your first agent’s voice, start with Choosing Languages and Voices.


Share this post:

Next Post
Reading a file a customer sends in chat: how an AI employee receives it, checks it and uses it
Previous Post
What is a run record, and how do I read one?