Electron
Electron is Smallest AI’s in-house language model, optimized for voice agents and built as a drop-in replacement for the OpenAI Chat Completions API. Production-grade quality and sub-300 ms time-to-first-token, built for high-volume workloads.
Jump to: Benchmarks · Supported Languages · API Reference · Pricing & Throughput · Quickstart
Time-to-first-token tuned for real-time UX.
Combined input + output context.
First-class Indic support.
Drop-in replacement for /v1/chat/completions.
Model Overview
Key Capabilities
Same request/response shape as OpenAI Chat Completions. Use the official OpenAI SDKs by swapping base_url and api_key.
Standard Server-Sent Events. Optional final usage chunk for accurate billing on client disconnect.
Standard OpenAI tools API, with voice-agent-optimized filler-phrase behavior before tool calls.
Automatic discount on cached input tokens. No flag needed.
Wide multilingual coverage, with particularly strong Indic-language performance.
response_format: {type: "json_object"} for structured output.
How to use it
See the Electron quickstart for a working end-to-end example, including authentication, request shape, and streaming response handling. Electron is OpenAI-wire-compatible — swap base_url to https://api.smallest.ai/waves/v1 on the official OpenAI SDK, pass your SMALLEST_API_KEY as api_key, and set "model": "electron" on the request body.
Performance & Benchmarks
Electron is trained for voice-agent workloads — instruction following on system prompts, conversational style, and holding long multi-turn dialogues without drift. We benchmark it internally against frontier alternatives on these tasks. General-purpose academic benchmarks like MMLU and IFEval target a different objective and are not the right yardstick for a model whose job is to drive a phone call.
Supported Languages
Electron is multilingual with strong out-of-the-box quality across 70 languages, with particularly strong performance on Indic languages including lower-resource ones.
Electron auto-detects the input language — there is no language parameter on the Chat Completions API. The ISO 639-1 codes below are for reference only (e.g., when tagging conversations downstream or routing across services); they are not passed to the model.
Western Europe (8)
Indic (11)
Central / Eastern Europe (14)
Baltic (3)
Nordic (5)
Other Europe (2)
Middle East (4)
East Asia (5)
Southeast Asia (8)
South Asia (2)
Central Asia (2)
Africa (6)
API Reference
See Electron — Chat Completions for the full request/response schema, supported parameters, and error codes. The Chat Completions guide covers the OpenAI-compatible wire format end-to-end, and Supported Parameters lists the passthrough table.
Throughput, Latency & Pricing
Both limits enforce strictly — over either cap returns HTTP 429. See Concurrency & Limits for full rate-limit semantics.
Pricing: Contact your Smallest AI account manager. Prefix-cache discounts apply automatically — see Prefix Caching. Every response reports usage.prompt_tokens_details.cached_tokens so you can audit cache hit rates.
Best Practices
- Reuse HTTPS connections. Cold connections cost a TLS handshake on every request — voice-agent workloads should pool a single keep-alive connection per worker.
- Stream when you can. Set
"stream": trueand start your TTS engine on the firstdelta.contentchunk to mask end-to-end latency. See Streaming. - Put repeated context at the prompt prefix. System prompts, RAG context, and conversation history live in the cached prefix automatically. See Prefix Caching.
- For voice agents, prompt for a filler phrase before tool calls. Electron emits the filler in
contentalongsidetool_calls, so your TTS can speak it while the tool runs. See Tool Calling. - Use
seedfor best-effort determinism in eval pipelines and regression tests.
Technical Specifications
Feature support
Known limitations
- No vision / no audio in or out. Electron is text-only on the public API.
n > 1not supported. Each request returns exactly one completion. Make multiple requests if you need multiple completions.prompt_logprobsnot supported.- Context cap of 32,768 tokens combined input + output. Inputs that exceed this are rejected with a clean
400.
Use Cases
Direct Use
- Voice agents and conversational AI (phone, in-app, kiosk)
- Drop-in OpenAI replacement for chat-completion workloads
- Multilingual chatbots with first-class Indic-language coverage
- RAG-style assistants over private knowledge bases (prefix-cache friendly)
Downstream Use
- Multi-turn conversational agents
- Voice-pipeline LLM stage (paired with Pulse STT + Lightning TTS)
- JSON-structured output generation for downstream parsing
Safety & Compliance
Electron is intended for voice-agent and conversational workloads. Customers building user-facing applications should layer their own content moderation, prompt-injection defenses, and PII handling appropriate to their domain. Electron does not currently apply content moderation server-side — outputs reflect the model’s training and the prompts you provide.
For voice-agent applications handling regulated content (financial, healthcare), use the standard pattern: keep PII out of prompts where practical, apply post-processing redaction on outputs, and use Smallest AI’s Pulse PII redaction features on the transcription side.
For compliance documentation (GDPR, SOC2, HIPAA), contact support@smallest.ai.
Support
- Email: support@smallest.ai
- Community: Discord
- Documentation: docs.smallest.ai/waves
- Console: app.smallest.ai/dashboard

