Lightning v3.1 Pro

View as Markdown
Latest Release

Lightning v3.1 Pro is a premium 44.1 kHz text-to-speech pool with improved naturalness and a curated voice catalog. Runs on dedicated inference capacity, isolated from general traffic. Concurrency, latency, and rate limits are identical to standard Lightning v3.1; the difference is voice quality and the catalog.

Jump to: Benchmarks · Voice Catalog · API Reference · Quickstart

Model Overview

Developed bySmallest AI
Model typeText-to-Speech Websocket | Text-to-Speech SSE | Text-to-Speech HTTP
Languages29 — English + Hindi, plus 27 more (9 Indian, 8 Asian & Middle Eastern, 10 European); see Supported Languages
Audio Output formatsPCM, MP3, WAV, ulaw, alaw
Pricing (Standard Plan)~$0.195/10K characters
Concurrency (Standard Plan)10
Native Sample Rate44.1 kHz
Supported sample rates8,000 / 16,000 / 24,000 / 44,100 Hz
Audio channelsMono
Recommended GPUNVIDIA L40S
Max chunk size250 characters (optimal throughput at ~140 characters per request)

Key Capabilities


Performance & Benchmarks

Pro improves on standard Lightning v3.1 across accuracy, expressiveness, delivery, and MOS quality. Tables below pair Pro with the same competitor set documented on the Lightning v3.1 model card; refer to that card for Pro-vs-Standard comparisons. Open the accordion under each category to see what each metric measures.

Naturalness — higher is better

MetricLightning v3.1 ProGPT-4o-miniElevenLabs Turbo v2.5ElevenLabs Multilingual v2Sonic-3Gemini 2.5 ProGemini 2.5 FlashMAI-Voice-1Inworld 1.5S2 Pro
Overall3.163.133.163.173.203.073.283.173.063.02
Naturalness2.552.412.522.552.572.422.582.572.412.37
Intonation3.063.063.073.063.122.903.283.042.912.86
Prosody2.812.732.822.862.832.653.092.762.612.58
  • Overall — Holistic listener rating of how natural the voice sounds end-to-end.
  • Naturalness — How human-like the voice sounds; penalizes robotic or synthetic quality.
  • Intonation — Whether pitch rises and falls appropriately for the sentence type (question, statement, exclamation).
  • Prosody — The broader umbrella of rhythm, stress, and melody, how well the voice “reads” the sentence as a human would.

Expressiveness — higher is better

MetricLightning v3.1 ProGPT-4o-miniElevenLabs Turbo v2.5ElevenLabs Multilingual v2Sonic-3Gemini 2.5 ProGemini 2.5 FlashMAI-Voice-1Inworld 1.5S2 Pro
Overall3.553.453.443.463.383.493.543.503.373.41
Paralinguistics3.643.603.593.613.563.603.643.583.553.58
Emotions3.473.303.283.313.193.383.443.413.193.23
  • Overall — Holistic listener rating of how expressive the voice sounds given the context of the sentence.
  • Paralinguistics — Non-verbal vocal elements like laughter, sighs, or filler sounds (“um”, “uh”) and whether they’re rendered appropriately.
  • Emotions — How accurately the voice conveys the intended emotional tone (neutral, warm, urgent, etc.).

Delivery — higher is better

MetricLightning v3.1 ProGPT-4o-miniElevenLabs Turbo v2.5ElevenLabs Multilingual v2Sonic-3Gemini 2.5 ProGemini 2.5 FlashMAI-Voice-1Inworld 1.5S2 Pro
Boundary Consistency4.964.944.934.954.934.884.994.774.904.88
Pronunciation Style4.984.964.954.964.964.934.994.914.944.89
Natural Pace4.724.574.514.514.014.234.664.474.333.74
Pause Placement4.664.544.494.514.284.344.594.414.384.09
Breathing Naturalness3.823.063.143.142.792.883.433.282.772.42
  • Boundary Consistency — Whether phrase and sentence boundaries are marked consistently with pauses or pitch shifts, without arbitrary breaks mid-phrase.
  • Pronunciation Style — Not just correctness, but stylistic choices i.e., formal vs. casual register, regional accent consistency, honorific handling.
  • Natural Pace — Whether the speaking rate feels comfortable and appropriate for the content type, neither rushed nor dragging.
  • Pause Placement — Whether silences appear at semantically correct points (after commas, between clauses) rather than mid-word or mid-phrase.
  • Breathing Naturalness — Whether breath sounds occur at realistic points and with realistic frequency, not absent entirely or inserted randomly.

Accuracy

Mixed direction — WER, CER, Hallucination, and Deletion are lower is better; Pronunciation % is higher is better.

Whisper jiwer

MetricDirectionLightning v3.1 ProGPT-4o-miniElevenLabs Turbo v2.5ElevenLabs Multilingual v2Sonic-3Gemini 2.5 ProGemini 2.5 FlashMAI-Voice-1Inworld 1.5S2 Pro
WERlower1.36%1.26%1.35%1.33%1.43%1.26%1.37%1.25%1.10%2.83%
CERlower0.40%0.52%0.60%0.54%0.59%0.62%0.61%0.50%0.47%1.16%
Hallucinationlower0.00%0.07%0.08%0.01%0.06%0.04%0.01%0.06%0.00%0.22%
Deletionlower0.00%0.14%0.17%0.18%0.16%0.24%0.18%0.15%0.12%0.33%
Pronunciation %
Whisper jiwer
higher98.68%98.94%98.90%98.87%98.79%99.02%98.82%98.95%99.02%97.72%

Whisper LLM

MetricDirectionLightning v3.1 ProGPT-4o-miniElevenLabs Turbo v2.5ElevenLabs Multilingual v2Sonic-3Gemini 2.5 ProGemini 2.5 FlashMAI-Voice-1Inworld 1.5S2 Pro
WERlower0.96%0.82%0.72%0.57%0.88%0.70%0.72%0.60%0.55%2.15%
CERlower0.34%0.30%0.28%0.21%0.30%0.35%0.33%0.23%0.18%1.03%
Hallucinationlower0.00%0.07%0.07%0.00%0.02%0.02%0.01%0.03%0.00%0.10%
Pronunciation %
Whisper LLM
higher99.04%99.25%99.35%99.43%99.14%99.32%99.29%99.43%99.45%97.95%
  • WER (Word Error Rate) — Percentage of words in the transcript that differ from the reference; measures how faithfully the TTS renders the input text.
  • CER (Character Error Rate) — Like WER but at the character level.
  • Hallucination — Words or sounds the TTS generates that have no basis in the input text. Insertions, substitutions, or fabricated content.
  • Deletion — Words from the reference text that the TTS dropped entirely.
  • Pronunciation % — The proportion of words pronounced correctly out of total words.
  • Whisper jiwer vs Whisper LLM — Two judging methodologies. jiwer uses raw Whisper-decoded transcripts; LLM-judged uses a follow-on LLM to normalize transcription noise. Both report the same metric family; LLM-judged tends to give lower error rates by reducing false positives from punctuation/casing.

MOS v2 — higher is better

MetricLightning v3.1 ProGPT-4o-miniElevenLabs Turbo v2.5ElevenLabs Multilingual v2Sonic-3Gemini 2.5 ProGemini 2.5 FlashMAI-Voice-1Inworld 1.5S2 Pro
Mean MOS4.224.163.984.023.764.114.243.973.733.99
UTMOS3.763.763.373.412.773.573.713.332.543.50
WV-MOS5.054.554.604.634.764.654.764.624.914.48
  • Mean MOS — Mean Opinion Score: average listener rating on a 1–5 scale across the test set; the canonical aggregate quality metric in TTS evaluation.
  • UTMOS — A predicted MOS from the UTMOS reference model — an automated proxy for subjective quality.
  • WV-MOS — A predicted MOS from the WavLM-based WV-MOS reference model — another automated proxy commonly reported alongside UTMOS for cross-validation.

Want to reproduce these results? See the TTS evaluation script to measure TTFB and synthesis quality in your own environment.


Supported Languages

Pass the language body parameter to steer the Pro pool’s output:

language valueBehaviour
enUK + American accented English. Best paired with British or American Pro voices.
hiIndian accented English + Hindi (mid-utterance code-switching). Best paired with Indian Pro voices.
ISO 639-1 code of an additional Pro language (e.g. ta, de, ja)Native synthesis in that language. Pair with a Pro voice from that language’s catalog section below.
omittedDefaults to en + hi — mixed Indian + Western English coverage.

Additional Pro languages

27 additional languages have dedicated Pro voices. Pass the ISO 639-1 code in the language body parameter and pick a voice_id from the matching Voice Catalog section.

Indian

LanguageCodePro voices
Marathimr6
Tamilta12
Malayalamml6
Telugute8
Kannadakn10
Punjabipa7
Bengalibn5
Odiaor8
Gujaratigu5

Asian & Middle Eastern

LanguageCodePro voices
Arabicar2
Chinese (Mandarin)zh5
Indonesianid4
Japaneseja4
Koreanko1
Malayms2
Turkishtr2
Vietnamesevi1

European

LanguageCodePro voices
Germande7
Spanishes6
Frenchfr9
Italianit6
Portuguese (Brazilian + European)pt7
Russianru7
Greekel5
Finnishfi6
Norwegianno4
Polishpl4

For other languages, use the standard Lightning v3.1 model (12 languages, full voice catalog).


Voice Catalog

The Pro voice catalog is distinct from standard Lightning v3.1. Voices below are listed in recommended ranking per accent group.

Indian — Female

Voice IDName
rheaRhea
zariyaZariya
kareenaKareena
mishkaMishka
inaayaInaaya
sairaSaira
meherMeher
aariniAarini

Indian — Male

Voice IDName
avirajAviraj
vyomVyom
zoravarZoravar
reyanshReyansh
ahanAhan

British — Female

Voice IDName
sophieSophie
ellieEllie
cressidaCressida
ottilieOttilie
elowenElowen
seraphinaSeraphina

British — Male

Voice IDName
samSam
henryHenry
benedictBenedict
cormacCormac
rupertRupert
finleyFinley

American — Female

Voice IDName
kaitlynKaitlyn
savannahSavannah
ameliaAmelia
zoeZoe
rubyRuby
leahLeah
jennaJenna
kateKate
mollyMolly
saraSara
fionaFiona

American — Male

Voice IDName
blakeBlake
austinAustin
henryHenry
jackJack
leoLeo
lukeLuke
owenOwen

Indian Languages — 67 voices

Pair each voice with its matching language code (e.g. "language": "ta" with a Tamil voice).

LanguageCodeFemale voicesMale voices
Marathimrmrunal, manasi, ketaki, tejaswinimandar, tushar
Tamiltamalar, nila, tamilselvimathan, dinesh, prabhu, ezhil, kavin, tamizh, barath, sakthi, murugan
Malayalammlparvathy, lakshmivishnu, sreenath, unni, aravindan
Telugutesravani, swathinaveen, charan, sasank, bhaskar, gopal, manohar
Kannadaknspoorthi, rashmi, varsha, sahanarakshith, kishore, yogesh, gowtham, shankar, basava
Punjabipajasleen, manmeetrajdeep, tejinder, sukhdeep, amrit, gagandeep
Bengalibnrajib, tanmoy, subhro, arghya, indranil
Odiaorsasmita, ankitasubrat, debasish, sambit, pratik, rakesh, smruti
Gujaratigukrupa, riddhijignesh, mit, keval

Asian & Middle Eastern Languages — 21 voices

LanguageCodeFemale voicesMale voices
Arabicarlaylaadam
Chinese (Mandarin)zhhazel, viviandylan, silas, eli
Indonesianidnorabryce, miles, cole
Japanesejaaria, mila, daisyjasper
Koreankojune
Malaymssasharoman
Turkishtrbeau, wes
Vietnamesevikai

European Languages — 61 voices

LanguageCodeFemale voicesMale voices
Germandehanna, lea, petramax, ben, markus, finn
Spanishesmartina, ines, paulasebastian, mateo, gabriel
Frenchfrmanon, juliette, lucie, elise, amelielouis, nicolas, maxime, raphael
Italianitsilvia, concetta, ariannadavide, luca, leonardo
Portuguese (Brazilian)ptjuliana, leticiagustavo, thiago, bruno
Portuguese (European)ptcatarinafrancisco
Russianruanastasia, ekaterina, olga, irinaandrei, nikolai, maksim
Greekelkaterina, dimitra, athinadimitris, vasilis
Finnishfiaino, helmi, venlamika, timo, matti
Norwegiannosolveig, maritkristian, espen
Polishplewa, joannatomasz, jakub

Need a voice not in this list? Use the standard Lightning v3.1 catalog (217 voices, more languages, voice cloning). Pass "model": "lightning_v3.1" (or omit the field) instead of lightning_v3.1_pro.


API Reference

Endpoints

EndpointMethodUse Case
https://api.smallest.ai/waves/v1/ttsPOSTSynchronous synthesis
https://api.smallest.ai/waves/v1/tts/livePOST (SSE)Server-sent events streaming
wss://api.smallest.ai/waves/v1/tts/liveWebSocketReal-time streaming

See Synthesize Speech for the full request/response schema, supported parameters, and error codes. To route to the Pro pool you must set model to lightning_v3.1_pro explicitly — the field is optional but defaults to standard Lightning v3.1.


Best Practices

Voice ID + model pairing

Pair Pro voice IDs above with "model": "lightning_v3.1_pro". The API does not currently reject mismatched pairings, but pairing a Pro voice with "model": "lightning_v3.1" (or omitting model) can produce wrong or hallucinated audio. Server-side validation is on the roadmap.

Language selection

  • language: en → UK + American accented English. Pair with British or American Pro voices for best results.
  • language: hi → Indian accented English + Hindi with native code-switching mid-utterance. Pair with Indian Pro voices.
  • Any additional Pro language (e.g. language: ta, language: de, language: ja) → native synthesis in that language. Always pair with a Pro voice from that language’s Voice Catalog section.
  • Omit language → defaults to en + hi. Sensible when you don’t know the input language ahead of time.

Per-voice metadata still lives in tags.language on the voice catalog (GET /waves/v1/lightning-v3.1/get_voices). The body parameter sets the target language for the synthesis pass; the voice ID controls the timbre and accent of the speaker.

Text Formatting

  • Chunk boundaries. Segment input at natural prosodic boundaries (. ! ? ,). Maximum chunk size is 250 characters; optimal throughput at 140 characters per request.
  • Script integrity. Use native script for each language. Mixed-script input within a single language token produces unpredictable phoneme mappings.
  • Lexicon overrides. Use pronunciation dictionaries for domain-specific terms, brand names, and acronyms where default grapheme-to-phoneme conversion is insufficient.

For comprehensive text formatting rules (numeric handling, date/time, symbols, chunking logic), see TTS Best Practices.


Use Cases

Direct UseDownstream Use
Voice assistants and conversational AIMulti-turn conversational agents
Interactive chatbots with voice outputAudio content generation pipelines
Real-time narration and live streamingTelephony and IVR systems
Accessibility tools and screen readersPodcast generation
Customer service automation

FAQ

Pro runs on dedicated inference capacity, isolated from general Lightning traffic, and ships a curated premium voice catalog with improved naturalness. Concurrency, latency, and rate-limit ceilings are identical to standard Lightning v3.1 — the difference is voice quality and the catalog.

Set model to lightning_v3.1_pro explicitly. The field is optional, but it defaults to standard Lightning v3.1 — for Pro you must pass it on every request.

Pair Pro voice IDs with "model": "lightning_v3.1_pro". The API does not currently reject mismatched pairings, but pairing a Pro voice with "model": "lightning_v3.1" (or omitting model) can produce wrong or hallucinated audio. Server-side validation is on the roadmap.

No. Voice cloning is not available on the Pro pool. Clones continue to use standard Lightning v3.1 and the existing voice-cloning flow.

Set language: en for UK + American accented English, or language: hi for Indian accented English + Hindi with native code-switching. Omitting language defaults to en + hi.

Pro shares the Lightning v3.1 base-queue voices for English + Hindi (meher, devansh, kartik, maithili, liam, avery), so word events emit on those. Other Pro-only voices fall back to silent graceful degradation — audio is normal, but no word events are emitted.


Safety & Compliance

Known Limitations

  • No voice cloning. Voice cloning is not available on the Pro pool. Clones continue to use standard Lightning v3.1 and the existing voice-cloning flow.

Lightning v3.1 Pro must not be used for impersonation or fraud, generating deceptive audio content (deepfakes), creating content that violates consent or privacy, harassment or abuse, or any illegal or unethical purposes.

Compliance

  • No retention of synthesized audio
  • Usage monitoring for policy compliance

For compliance documentation (GDPR, SOC2, HIPAA), contact support@smallest.ai.


Support