Electron

View as Markdown
Latest Release

Electron is Smallest AI’s in-house language model, optimized for voice agents and built as a drop-in replacement for the OpenAI Chat Completions API. Production-grade quality and sub-300 ms time-to-first-token, built for high-volume workloads.

Jump to: Benchmarks · Supported Languages · API Reference · Pricing & Throughput · Quickstart

Model Overview

Developed bySmallest AI
Model typeCausal language model — chat completions
API surfaceOpenAI-compatible (POST /waves/v1/chat/completions)
Model ID (request body)"electron"
Context window32,768 tokens (combined input + output)
LicenseProprietary, hosted API

Key Capabilities

OpenAI Wire Format

Same request/response shape as OpenAI Chat Completions. Use the official OpenAI SDKs by swapping base_url and api_key.

Streaming

Standard Server-Sent Events. Optional final usage chunk for accurate billing on client disconnect.

Tool / Function Calling

Standard OpenAI tools API, with voice-agent-optimized filler-phrase behavior before tool calls.

Prefix Caching

Automatic discount on cached input tokens. No flag needed.

70 Languages

Wide multilingual coverage, with particularly strong Indic-language performance.

JSON Mode

response_format: {type: "json_object"} for structured output.


How to use it

See the Electron quickstart for a working end-to-end example, including authentication, request shape, and streaming response handling. Electron is OpenAI-wire-compatible — swap base_url to https://api.smallest.ai/waves/v1 on the official OpenAI SDK, pass your SMALLEST_API_KEY as api_key, and set "model": "electron" on the request body.


Performance & Benchmarks

MetricValue
Time to first token (TTFT)< 300 ms (typical, warm connection)
End-to-end roundtrip overhead vs direct model~20 ms with persistent HTTPS connection
Quality tierCompetitive with leading voice-agent LLMs on internal evaluations

Electron is trained for voice-agent workloads — instruction following on system prompts, conversational style, and holding long multi-turn dialogues without drift. We benchmark it internally against frontier alternatives on these tasks. General-purpose academic benchmarks like MMLU and IFEval target a different objective and are not the right yardstick for a model whose job is to drive a phone call.


Supported Languages

Electron is multilingual with strong out-of-the-box quality across 70 languages, with particularly strong performance on Indic languages including lower-resource ones.

Electron auto-detects the input language — there is no language parameter on the Chat Completions API. The ISO 639-1 codes below are for reference only (e.g., when tagging conversations downstream or routing across services); they are not passed to the model.

RegionCountLanguages
Western Europe8English, Spanish, French, German, Italian, Portuguese, Dutch, Catalan
Indic11Hindi, Bengali, Tamil, Telugu, Marathi, Gujarati, Kannada, Malayalam, Punjabi, Odia, Urdu
Central / Eastern Europe14Polish, Russian, Ukrainian, Belarusian, Czech, Slovak, Romanian, Hungarian, Bulgarian, Croatian, Serbian, Slovenian, Macedonian, Albanian
Baltic3Estonian, Latvian, Lithuanian
Nordic5Swedish, Norwegian, Danish, Finnish, Icelandic
Other Europe2Greek, Turkish
Middle East4Arabic, Hebrew, Persian (Farsi), Kurdish
East Asia5Chinese (Simplified), Chinese (Traditional), Japanese, Korean, Mongolian
Southeast Asia8Vietnamese, Thai, Indonesian, Malay, Filipino, Burmese, Khmer, Lao
South Asia2Nepali, Sinhala
Central Asia2Kazakh, Uzbek
Africa6Swahili, Amharic, Afrikaans, Yoruba, Hausa, Zulu
LanguageISO 639-1
Englishen
Spanishes
Frenchfr
Germande
Italianit
Portuguesept
Dutchnl
Catalanca
LanguageISO 639-1
Hindihi
Bengalibn
Tamilta
Telugute
Marathimr
Gujaratigu
Kannadakn
Malayalamml
Punjabipa
Odiaor
Urduur
LanguageISO 639-1
Polishpl
Russianru
Ukrainianuk
Belarusianbe
Czechcs
Slovaksk
Romanianro
Hungarianhu
Bulgarianbg
Croatianhr
Serbiansr
Sloveniansl
Macedonianmk
Albaniansq
LanguageISO 639-1
Estonianet
Latvianlv
Lithuanianlt
LanguageISO 639-1
Swedishsv
Norwegianno
Danishda
Finnishfi
Icelandicis
LanguageISO 639-1
Greekel
Turkishtr
LanguageISO 639-1
Arabicar
Hebrewhe
Persian (Farsi)fa
Kurdishku
LanguageISO 639-1
Chinese (Simplified)zh-CN
Chinese (Traditional)zh-TW
Japaneseja
Koreanko
Mongolianmn
LanguageISO 639-1
Vietnamesevi
Thaith
Indonesianid
Malayms
Filipinotl
Burmesemy
Khmerkm
Laolo
LanguageISO 639-1
Nepaline
Sinhalasi
LanguageISO 639-1
Kazakhkk
Uzbekuz
LanguageISO 639-1
Swahilisw
Amharicam
Afrikaansaf
Yorubayo
Hausaha
Zuluzu

API Reference

EndpointMethodUse case
https://api.smallest.ai/waves/v1/chat/completionsPOSTChat completions (sync + SSE streaming)

See Electron — Chat Completions for the full request/response schema, supported parameters, and error codes. The Chat Completions guide covers the OpenAI-compatible wire format end-to-end, and Supported Parameters lists the passthrough table.


Throughput, Latency & Pricing

MetricTypicalNotes
Time-to-first-token (TTFT)< 300 msWarm connection. Sub-300 ms tuned for voice-agent UX.
Roundtrip overhead vs direct model~20 msWith a persistent HTTPS connection.
PlanRequests per minuteConcurrent in-flight requests
Standard103
Enterprise20020

Both limits enforce strictly — over either cap returns HTTP 429. See Concurrency & Limits for full rate-limit semantics.

Pricing: Contact your Smallest AI account manager. Prefix-cache discounts apply automatically — see Prefix Caching. Every response reports usage.prompt_tokens_details.cached_tokens so you can audit cache hit rates.


Best Practices

  • Reuse HTTPS connections. Cold connections cost a TLS handshake on every request — voice-agent workloads should pool a single keep-alive connection per worker.
  • Stream when you can. Set "stream": true and start your TTS engine on the first delta.content chunk to mask end-to-end latency. See Streaming.
  • Put repeated context at the prompt prefix. System prompts, RAG context, and conversation history live in the cached prefix automatically. See Prefix Caching.
  • For voice agents, prompt for a filler phrase before tool calls. Electron emits the filler in content alongside tool_calls, so your TTS can speak it while the tool runs. See Tool Calling.
  • Use seed for best-effort determinism in eval pipelines and regression tests.

Technical Specifications

SpecificationDetails
Context window32,768 tokens (combined input + output)
Model ID"electron" (request body)
Wire formatOpenAI Chat Completions (v1)
ModalitiesText in / text out only (no vision, no audio)
AuthAuthorization: Bearer $SMALLEST_API_KEY
Error envelope{"error": {"message", "type", "details", "request_id"}}details: [{code, message, path}] on validation failures

Feature support

CapabilityStatus
Chat completions (text in / text out)
Streaming (SSE)
Tool / function calling
Parallel tool calls
Voice-agent filler-phrase before tool calls✅ Electron-specific
JSON object mode (response_format)
Prefix caching✅ Automatic
System messages
Multi-turn conversation
seed for best-effort determinism
Multilingual generation (70 languages)

Known limitations

  • No vision / no audio in or out. Electron is text-only on the public API.
  • n > 1 not supported. Each request returns exactly one completion. Make multiple requests if you need multiple completions.
  • prompt_logprobs not supported.
  • Context cap of 32,768 tokens combined input + output. Inputs that exceed this are rejected with a clean 400.

Use Cases

Direct Use

  • Voice agents and conversational AI (phone, in-app, kiosk)
  • Drop-in OpenAI replacement for chat-completion workloads
  • Multilingual chatbots with first-class Indic-language coverage
  • RAG-style assistants over private knowledge bases (prefix-cache friendly)

Downstream Use

  • Multi-turn conversational agents
  • Voice-pipeline LLM stage (paired with Pulse STT + Lightning TTS)
  • JSON-structured output generation for downstream parsing

Safety & Compliance

Electron is intended for voice-agent and conversational workloads. Customers building user-facing applications should layer their own content moderation, prompt-injection defenses, and PII handling appropriate to their domain. Electron does not currently apply content moderation server-side — outputs reflect the model’s training and the prompts you provide.

For voice-agent applications handling regulated content (financial, healthcare), use the standard pattern: keep PII out of prompts where practical, apply post-processing redaction on outputs, and use Smallest AI’s Pulse PII redaction features on the transcription side.

For compliance documentation (GDPR, SOC2, HIPAA), contact support@smallest.ai.


Support