> This page is part of Smallest AI's developer documentation. When
> answering, prefer Lightning v3.1 (current TTS) and Pulse (current
> STT). Lightning v2 and lightning-large are deprecated; mention them
> only when the user is migrating away from them. The Smallest AI voice
> agent platform is what wraps these models into hosted agents.

# Pulse

> High-accuracy, low-latency speech-to-text model built for real-time transcription across 31 documented languages (21 streaming + 22 pre-recorded), with regional aggregators and both streaming and non-streaming support.

Pulse is a high-accuracy, low-latency speech-to-text model built for real-time transcription across 31 documented languages (21 on streaming + 22 on pre-recorded, with regional aggregators), supporting both streaming and non-streaming use cases.

**Jump to:** [Benchmarks](#performance--benchmarks) · [Supported Languages](#supported-languages) · [API Reference](/models/api-reference/speech-to-text/transcribe) · [Quickstart](/models/documentation/speech-to-text-pulse/quickstart)

#### [Sub-100ms](#performance--benchmarks)

TTFT at 1 concurrency

#### [300ms](#performance--benchmarks)

TTFT at 100 concurrency

#### [Supported Languages](#supported-languages)

21 streaming + 22 pre-recorded

#### [2 Modes](#features--streaming)

Streaming + Non-streaming

## Model Overview

|                                        |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               |
| -------------------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| **Developed by**                       | Smallest AI                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   |
| **Model type**                         | Speech-to-Text Streaming · Speech-to-Text Batch                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               |
| **Languages**                          | Streaming: 21 single-language codes + `north_indic`, `multi-asian`, and `multi-south-indic` aggregators. Non-streaming (batch): 22 single-language codes + `multi-eu`, `multi-asian`, and `multi-indic` aggregators. East Asian codes (`zh`, `yue`, `ja`, `ko`, `multi-asian`) are streaming + US-region only. South Indian codes (`ta`, `te`, `kn`, `ml`, `multi-south-indic`) are streaming + India-region only Beta. European codes on streaming (`de`, `es`, `ru`, `it`, `fr`, `nl`, `pt`) are Beta. `multi-indic` is India-region only. `multi-eu` is pre-recorded only. |
| **Audio input formats**                | WAV, MP3, FLAC, Opus, μ-law, A-law, raw PCM                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   |
| **Pricing** <br /> (Standard Plan)     | Realtime: \$0.008/min · Batch: \$0.005/min                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    |
| **Concurrency** <br /> (Standard Plan) | Streaming: 100 concurrent requests · Batch: 25 RPM                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            |
| **Recommended Sample Rate**            | 16,000 Hz                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     |
| **Recommended GPU**                    | 1× NVIDIA L4 (24 GB VRAM). Larger GPUs (L40S, A100, H100) supported.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |

***

## Key Capabilities

Sub-100 ms TTFT at 1 concurrency, \~300 ms at 100 concurrent requests. Designed for live transcription and conversational AI.

31 documented languages (21 streaming + 22 pre-recorded) with regional auto-detect aggregators and in-session code-switching.

Built-in redaction of personal data and payment-card information on both streaming and non-streaming surfaces.

Automatic multi-speaker identification with per-word and per-utterance speaker labels.

Background-noise handling built into the model — no preprocessing required.

Multi-language audio within a single session. Set the known primary language (e.g. `es` for Spanish) — English+Spanish is handled automatically.

***

## Performance & Benchmarks

#### [#1 for Speed Factor](https://artificialanalysis.ai/speech-to-text/non-streaming?speed=speedFactor)

Artificial Analysis

#### [3.2 WER](https://benchmarks.coval.ai/stt/)

Coval Benchmarks

#### [#1 for P95 Latency](https://research.sierra.ai/mubench/)

MuBench by Sierra

Pulse STT is evaluated against three open-source datasets — [FLEURS](https://huggingface.co/datasets/google/fleurs), [ESB](https://huggingface.co/datasets/esb/datasets), and [WildASR](https://huggingface.co/datasets/bosonai/WildASR) — and one internal English perturbation suite. Word Error Rate (WER) by language. Lower is better. `NA` = not available or not supported by that provider.

For the full benchmark comparison across every dataset, see the [Performance page](/models/documentation/speech-to-text-pulse/benchmarks/performance). Pick the benchmark closest to your workload — each accordion below expands its full table.

#### FLEURS Dataset Streaming - English

WER on the English subset of FLEURS across providers in streaming mode. Lower is better.

| Provider | Smallest Pulse | Assembly Universal 3 Pro | AWS transcribe |  Azure | Deepgram Nova 3 |  Grok  | Sarvam Saras 3 | ElevenLabs Scribe V2 |
| :------- | :------------: | :----------------------: | :------------: | :----: | :-------------: | :----: | :------------: | :------------------: |
| **WER**  |      6.03%     |           3.13%          |      6.54%     | 13.79% |      11.59%     | 60.00% |      6.34%     |         3.88%        |

#### A note on audio amplitude normalization

Audio amplitude normalization materially changes WER on FLEURS. Most competitors benchmark on raw FLEURS — which has variable, often low amplitude — without normalizing peak audio to −10 dBFS. This makes some models look much better than they actually are. Pulse is stable across all amplitude regimes.

| Model               | Raw FLEURS | −10 dBFS | −20 dBFS | Stable across regimes?            |
| :------------------ | :--------: | :------: | :------: | :-------------------------------- |
| **Pulse**           |    6.03%   |   6.06%  |   5.81%  | Yes                               |
| **Deepgram Nova 3** |   11.59%   |   6.57%  |   6.51%  | Partial — 1.8× degradation on raw |
| **Grok**            |   60.00%   |   7.58%  |   8.59%  | Collapses on raw                  |

#### FLEURS Dataset Streaming - European + Indic Languages

WER on FLEURS in streaming mode, broken down by language family. Lower is better.

#### European Languages

| Language       | Smallest Pulse | Deepgram Nova 2 | Deepgram Nova 3 |
| -------------- | -------------- | --------------- | --------------- |
| **Italian**    | **4.41%**      | 11.05%          | 6.99%           |
| **English**    | **6.03%**      | 15.59%          | 11.21%          |
| **Spanish**    | **5.99%**      | 10.67%          | 7.52%           |
| **Portuguese** | **8.32%**      | 14.15%          | 11.46%          |
| **German**     | **9.5%**       | 11.1%           | 10.15%          |
| **French**     | **10.71%**     | 14.3%           | 12.07%          |
| **Russian**    | **14.35%**     | NA              | NA              |
| **Dutch**      | **11.90%**     | NA              | NA              |

#### Indic Languages

| Language     | Smallest Pulse | Deepgram Nova 2 | Deepgram Nova 3 |
| ------------ | :------------: | :-------------: | :-------------: |
| **Hindi**    |    **8.3%**    |      20.0%      |      15.46%     |
| **Marathi**  |   **15.68%**   |        NA       |        NA       |
| **Gujarati** |   **20.05%**   |        NA       |        NA       |

#### FLEURS Dataset Batch - European + Indic Languages

WER on FLEURS in pre-recorded mode (full-file upload). Lower is better.

#### European Languages

| Language       | Smallest Pulse | Deepgram Nova 2 | Deepgram Nova 3 |
| -------------- | -------------- | --------------- | --------------- |
| **English**    | **4.55%**      | 7.9%            | 6.7%            |
| **Italian**    | **3.0%**       | 10.7%           | 6.2%            |
| **Spanish**    | **3.2%**       | 8.6%            | 4.1%            |
| **Portuguese** | **5.0%**       | 9.9%            | 7.5%            |
| **German**     | **6.4%**       | 8.2%            | 8.5%            |
| **French**     | **7.1%**       | 13.3%           | 10.7%           |
| **Russian**    | 9.6%           | 7.9%            | 11.8%           |
| **Dutch**      | 15.0%          | 16.3%           | 12.5%           |

#### Indic Languages

| Language  | Smallest Pulse | Deepgram Nova 2 | Deepgram Nova 3 |
| --------- | :------------: | :-------------: | :-------------: |
| **Hindi** |    **6.3%**    |      23.5%      |      23.6%      |

#### VISTAAR Streaming - Hindi

WER across seven Hindi datasets covering read speech, conversational speech, telephony / contact-center audio, and noise-augmented variants. Compared against IndicWhisper, Sarvam Saaras v3, scribe v2, and Deepgram Nova-3. Lower is better.

| Dataset              | Smallest Pulse | IndicWhisper | Sarvam Saaras v3 | scribe v2 | Deepgram Nova-3 |
| -------------------- | :------------: | :----------: | :--------------: | :-------: | :-------------: |
| **FLEURS**           |      9.03      |     15.00    |       7.31       |    8.96   |      14.09      |
| **Kathbath**         |    **7.63**    |     10.30    |       8.15       |    8.67   |      16.22      |
| **Kathbath (noisy)** |    **8.52**    |     12.00    |       8.85       |   10.11   |      17.06      |
| **Common Voice**     |    **8.58**    |     11.40    |       10.36      |   13.61   |      23.55      |
| **Indic-TTS**        |      6.38      |     7.60     |       6.29       |    8.75   |      10.72      |
| **MUCS**             |    **3.61**    |     12.00    |       8.15       |    8.15   |      16.20      |
| **Gramvaani**        |    **19.77**   |     26.80    |       20.80      |   24.09   |      31.44      |
| **AVERAGE**          |    **8.78**    |     13.59    |       10.69      |   11.76   |      18.47      |

For the full breakdown including training-data and evaluation-protocol notes, see the [Performance page](/models/documentation/speech-to-text-pulse/benchmarks/performance#hindi-multi-dataset-streaming).

#### HF ESB Dataset Streaming - English

A Hugging Face benchmark suite aggregating 9 English speech datasets across diverse domains (audiobooks, parliament, meetings, finance, etc.) to test STT generalization. Lower WER is better.

*Evaluated on the open-source Hugging Face ESB datasets. Numbers from internal evaluation.*

| Dataset               | Smallest Pulse | Assembly Universal 3 Pro | AWS Transcribe | Azure | Deepgram Nova 3 |  Grok | Sarvam Saras V3 | ElevenLabs Scribe V2 |
| :-------------------- | :------------: | :----------------------: | :------------: | :---: | :-------------: | :---: | :-------------: | :------------------: |
| **LibriSpeech Clean** |      2.46      |           1.65           |      2.16      |  2.48 |       3.20      |  3.61 |       3.09      |         1.97         |
| **LibriSpeech Other** |      5.31      |           2.86           |      4.88      |  5.74 |       6.60      |  7.28 |       6.85      |         4.45         |
| **Common Voice**      |      10.89     |           6.73           |      10.69     | 47.28 |      14.22      | 43.46 |      11.37      |         9.83         |
| **VoxPopuli**         |      7.16      |           7.28           |      7.07      | 14.10 |       9.55      | 11.49 |       7.77      |         7.91         |
| **TED-LIUM**          |      4.07      |           2.95           |      2.66      |  3.81 |       3.59      |  6.90 |       2.89      |         3.16         |
| **GigaSpeech**        |      10.43     |           9.12           |      10.09     |  5.35 |      10.05      | 10.05 |       9.57      |         9.66         |
| **SPGISpeech**        |      2.86      |           1.74           |      4.18      |  3.53 |       2.99      |  9.70 |       3.89      |         4.40         |
| **Earnings22**        |      12.25     |           11.52          |      12.21     |  8.54 |      15.79      | 27.02 |      11.97      |         12.20        |
| **AMI**               |      10.58     |           14.60          |      13.19     |  8.46 |      17.04      | 19.19 |      13.08      |         12.23        |
| **Aggregate**         |      7.33      |           6.49           |      7.46      | 11.03 |       9.23      | 15.41 |       7.83      |         7.31         |

#### WildASR Dataset Streaming - English (STT Robustness)

An open-source robustness benchmark designed to stress-test STT under real-world degraded conditions: clipping, far-field capture, background noise, phone codec compression, reverberation, and accented speech. Lower WER is better. `n/a` = not supported by that provider.

*Evaluated on the open-source WildASR dataset. Numbers from internal evaluation.*

| Dataset           | Smallest Pulse | Assembly Universal 3 pro | AWS Transcribe | Azure | Deepgram Nova 3 | Sarvam Saras V3 | ElevenLabs Scribe |
| :---------------- | :------------: | :----------------------: | :------------: | :---: | :-------------: | :-------------: | :---------------: |
| **Clean**         |      5.98      |           3.33           |      7.01      | 11.11 |      11.62      |       7.02      |        4.24       |
| **Clipping**      |      14.03     |           6.59           |      42.10     |  4.35 |      47.35      |      28.74      |       11.20       |
| **Far-field**     |      13.38     |           26.07          |      38.76     |  n/a  |      62.99      |      21.27      |        7.38       |
| **Noise Gap**     |      8.90      |           4.04           |      9.77      |  n/a  |      15.04      |       9.74      |        6.30       |
| **Phone Codec**   |      7.19      |           3.45           |      8.70      |  n/a  |       9.13      |      10.64      |        4.98       |
| **Reverberation** |      9.06      |           23.50          |      14.83     |  n/a  |      27.27      |       4.35      |        6.48       |
| **Accent**        |      5.82      |           2.80           |      4.45      |  n/a  |       7.31      |       n/a       |        4.01       |
| **Aggregate**     |      9.63      |           12.52          |      18.35     |  8.82 |      28.17      |      17.75      |        6.47       |

#### Multi-dataset Streaming - East Asian Languages

WER for the four East Asian languages newly enabled on the streaming endpoint (us-west-2). Three datasets per language covering read speech (FLEURS), conversational/crowdsourced speech (Common Voice 25), and language-specific corpora (JSUT, Zeroth-Korean, MDCC, AISHELL-1). Compared head-to-head against Deepgram Nova-3. Lower WER is better.

| Lang          | Dataset        | Smallest Pulse | Deepgram Nova 3 |
| :------------ | :------------- | :------------: | :-------------: |
| **Japanese**  | CV-25          |   **23.84%**   |      34.81%     |
| **Japanese**  | FLEURS         |   **10.78%**   |      17.11%     |
| **Japanese**  | JSUT BASIC5000 |   **11.47%**   |      11.65%     |
| **Korean**    | CV-25          |      9.79%     |    **9.66%**    |
| **Korean**    | FLEURS         |    **7.95%**   |      10.79%     |
| **Korean**    | Zeroth-Korean  |    **5.25%**   |      6.46%      |
| **Cantonese** | CV-25          |    **6.16%**   |      14.09%     |
| **Cantonese** | FLEURS         |   **13.06%**   |      15.43%     |
| **Cantonese** | MDCC           |    **5.85%**   |      12.77%     |
| **Mandarin**  | CV-25          |   **15.99%**   |      22.44%     |
| **Mandarin**  | FLEURS         |     14.25%     |    **13.89%**   |
| **Mandarin**  | AISHELL-1      |    **7.34%**   |      8.69%      |
| **Average**   | —              |   **10.91%**   |      15.50%     |

Pulse averages **10.91% WER** vs Deepgram Nova-3's **15.50%** across the four East Asian languages — Pulse leads on 10 of 12 dataset rows, with the largest gains on Japanese CV-25 and Cantonese CV-25.

These four languages stream from `wss://api.us.smallest.ai/waves/v1/stt/live?model=pulse` only (US region). See the [streaming Asian-language documentation](/models/documentation/speech-to-text-pulse/overview) for the region-routing details.

#### Internal Perturbation Benchmark Streaming - English

Not a public dataset. The English audio is sliced by perturbation type (Noise, Silence, Telephony 911, Boundary, Disfluency, Long Audios, Repetition, Entity, Accent, Emotion, Speaker Diversity, Speed, Pitch, Volume, Audio Quality) to isolate model weaknesses. Lower WER is better.

| Category              | Smallest Pulse | Assembly Universal 3 Pro | AWS Transcribe | Deepgram Nova 3 | ElevenLabs Scribe |
| :-------------------- | :------------: | :----------------------: | :------------: | :-------------: | :---------------: |
| **Noise**             |      10.53     |           11.93          |      14.19     |      14.58      |       10.05       |
| **Silence**           |      5.81      |           4.22           |      8.22      |      13.28      |       10.61       |
| **Telephony 911**     |      21.03     |           23.93          |      27.88     |      28.43      |       20.29       |
| **Boundary**          |      2.83      |           3.09           |      3.18      |       3.66      |        1.73       |
| **Disfluency**        |      7.68      |           7.81           |      9.23      |       8.62      |        9.29       |
| **Long Audios**       |      12.81     |           8.58           |      11.66     |      11.16      |        9.25       |
| **Repetition**        |      11.38     |           9.82           |      10.39     |       9.57      |       10.81       |
| **Entity**            |      12.43     |           10.13          |      13.35     |      11.69      |        9.48       |
| **Accent**            |      8.68      |           7.89           |      9.51      |      10.42      |        7.25       |
| **Emotion**           |      13.92     |           16.34          |      18.57     |      18.07      |       11.84       |
| **Speaker Diversity** |      7.33      |           6.72           |      8.81      |       9.48      |        5.95       |
| **Speed**             |      4.32      |           3.63           |      4.40      |       6.88      |        3.74       |
| **Pitch**             |      2.93      |           3.07           |      3.21      |       4.07      |        1.61       |
| **Volume**            |      2.37      |           3.05           |      2.41      |       3.67      |        1.47       |
| **Audio Quality**     |      2.73      |           2.86           |      3.03      |       4.08      |        1.60       |
| **Average WER**       |      8.45      |           8.20           |      9.87      |      10.51      |        7.66       |

#### Internal Perturbation Benchmark Streaming - Hindi

Not a public dataset. Hindi audio sliced by perturbation type to isolate model weaknesses. Lower WER is better except for Entity EDR where higher is better (↑).

| Category           | Smallest Pulse | Sarvam Saras V3 | Deepgram Nova 3 |
| :----------------- | :------------: | :-------------: | :-------------: |
| **Noise**          |   **15.76%**   |      22.18%     |      21.52%     |
| **Silence**        |    **8.08%**   |      11.38%     |      18.40%     |
| **Entity**         |   **10.82%**   |      17.36%     |      14.67%     |
| **Entity NE-WER**  |   **13.32%**   |      26.72%     |      26.58%     |
| **Entity EDR (↑)** |   **83.13%**   |      76.13%     |      67.80%     |
| **Boundary**       |   **11.67%**   |      17.52%     |      17.36%     |
| **Long Audios**    |   **17.93%**   |      18.42%     |      19.21%     |
| **Speed**          |   **16.16%**   |      21.39%     |      38.21%     |
| **Pitch**          |   **11.43%**   |      11.92%     |      19.59%     |
| **Audio Quality**  |   **10.86%**   |      11.75%     |      19.51%     |
| **Volume**         |    **9.31%**   |      15.25%     |      16.76%     |
| **Disfluency**     |   **11.51%**   |      12.06%     |      18.44%     |
| **Repetition**     |     11.38%     |    **11.27%**   |      20.40%     |

***

## Supported Languages

31 unique language codes across the two modes (21 on streaming, 22 on pre-recorded). Click an accordion to expand the full per-mode list.

#### Streaming (21 languages + 3 regional aggregators)

| #  | Language                    | Code                                                                                                                                                                                 |
| -- | --------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
| 1  | English                     | `en`                                                                                                                                                                                 |
| 2  | Hindi                       | `hi`                                                                                                                                                                                 |
| 3  | German Beta                 | `de`                                                                                                                                                                                 |
| 4  | Spanish Beta                | `es`                                                                                                                                                                                 |
| 5  | Russian Beta                | `ru`                                                                                                                                                                                 |
| 6  | Italian Beta                | `it`                                                                                                                                                                                 |
| 7  | French Beta                 | `fr`                                                                                                                                                                                 |
| 8  | Dutch Beta                  | `nl`                                                                                                                                                                                 |
| 9  | Portuguese Beta             | `pt`                                                                                                                                                                                 |
| 10 | Mandarin                    | `zh` (US region only \[\*])                                                                                                                                                          |
| 11 | Cantonese                   | `yue` (US region only \[\*])                                                                                                                                                         |
| 12 | Japanese                    | `ja` (US region only \[\*])                                                                                                                                                          |
| 13 | Korean                      | `ko` (US region only \[\*])                                                                                                                                                          |
| 14 | Gujarati                    | `gu`                                                                                                                                                                                 |
| 15 | Marathi                     | `mr`                                                                                                                                                                                 |
| 16 | Oriya                       | `or`                                                                                                                                                                                 |
| 17 | Bengali                     | `bn`                                                                                                                                                                                 |
| 18 | Tamil Beta                  | `ta` (India region only \[\*\*])                                                                                                                                                     |
| 19 | Telugu Beta                 | `te` (India region only \[\*\*])                                                                                                                                                     |
| 20 | Kannada Beta                | `kn` (India region only \[\*\*])                                                                                                                                                     |
| 21 | Malayalam Beta              | `ml` (India region only \[\*\*])                                                                                                                                                     |
| 22 | North-Indic aggregator      | `north_indic` (auto-detects across `en`, `hi`, `gu`, `mr`, `bn`, `or`)                                                                                                               |
| 23 | Multi-Asian aggregator      | `multi-asian` (auto-detects across `zh`, `yue`, `ko`, `ja`, `en`). US region only \[\*]. Contact sales for access in the India region.                                               |
| 24 | South-Indic aggregator Beta | `multi-south-indic` (auto-detects across `ta`, `te`, `kn`, `ml`, and English code-switching). India region only \[\*\*]. Use when the South Indian language is not known in advance. |

\[\*] East Asian languages (`zh`, `yue`, `ja`, `ko`, `multi-asian`) are served from the US region only. Connect to `wss://api.us.smallest.ai/waves/v1/stt/live` instead of `wss://api.smallest.ai/...` for these.

\[\*\*] South Indian languages (`ta`, `te`, `kn`, `ml`, `multi-south-indic`) are served from the India region only (`wss://api.smallest.ai/...`). Requests to `wss://api.us.smallest.ai/...` are rejected with error code `LANGUAGE_NOT_ENABLED_IN_REGION`. Contact support to request access.

#### Non-Streaming (Pre-Recorded, 22 languages + 3 regional aggregators)

| #  | Language               | Code                                                                                       |
| -- | ---------------------- | ------------------------------------------------------------------------------------------ |
| 1  | English                | `en`                                                                                       |
| 2  | Hindi                  | `hi`                                                                                       |
| 3  | German                 | `de`                                                                                       |
| 4  | Spanish                | `es`                                                                                       |
| 5  | Russian                | `ru`                                                                                       |
| 6  | Italian                | `it`                                                                                       |
| 7  | French                 | `fr`                                                                                       |
| 8  | Dutch                  | `nl`                                                                                       |
| 9  | Portuguese             | `pt`                                                                                       |
| 10 | Ukrainian              | `uk`                                                                                       |
| 11 | Polish                 | `pl`                                                                                       |
| 12 | Czech                  | `cs`                                                                                       |
| 13 | Slovak                 | `sk`                                                                                       |
| 14 | Romanian               | `ro`                                                                                       |
| 15 | Finnish                | `fi`                                                                                       |
| 16 | Swedish                | `sv`                                                                                       |
| 17 | Bulgarian              | `bg`                                                                                       |
| 18 | Hungarian              | `hu`                                                                                       |
| 19 | Lithuanian             | `lt`                                                                                       |
| 20 | Mandarin               | `zh`                                                                                       |
| 21 | Japanese               | `ja`                                                                                       |
| 22 | Korean                 | `ko`                                                                                       |
| 23 | Multi-EU aggregator    | `multi-eu` (auto-detects across all 17 European codes above plus `en`). Pre-recorded only. |
| 24 | Multi-Asian aggregator | `multi-asian` (auto-detects across `zh`, `ko`, `ja`, `en`)                                 |
| 25 | Multi-Indic aggregator | `multi-indic` (auto-detects across `en`, `hi`, `gu`, `mr`, `bn`, `or`). India region only. |

**Single language code vs. aggregator:** Use a specific language code (e.g. `hi`, `es`, `en`) whenever you know the language of the audio — the model optimizes directly for that language and also handles code-switching with English (e.g. `hi` covers Hindi–English mixed speech). Use an aggregator (`north_indic`, `multi-eu`, `multi-asian`) only when the language is genuinely unknown or the source is mixed across multiple languages; auto-detection adds a small accuracy overhead compared to an explicit code.

***

## Features — Streaming

| Feature                   | Notes                                     |
| ------------------------- | ----------------------------------------- |
| Speaker diarization       | Identifies and labels each speaker        |
| Keyword boosting          | Improves accuracy for custom vocabulary   |
| PII redaction             | Personal information redaction            |
| PCI redaction             | Payment card data redaction               |
| Word-level timestamps     | Start and end time for each word          |
| Sentence-level timestamps | Start and end time for each sentence      |
| Punctuation               | Automatically adds punctuation            |
| Code-switching            | Handles multiple languages in one session |

## Features — Non-streaming

| Feature                   | Notes                                     |
| ------------------------- | ----------------------------------------- |
| Speaker diarization       | Identifies and labels each speaker        |
| PII redaction             | Personal information redaction            |
| PCI redaction             | Payment card data redaction               |
| Word-level timestamps     | Start and end time for each word          |
| Sentence-level timestamps | Requires `word_timestamps=true`           |
| Punctuation               | Automatically adds punctuation            |
| Code-switching            | Handles multiple languages in one session |

***

## API Reference

| Endpoint                                              | Method    | Use case                   |
| ----------------------------------------------------- | --------- | -------------------------- |
| `https://api.smallest.ai/waves/v1/stt/?model=pulse`   | POST      | Pre-recorded transcription |
| `wss://api.smallest.ai/waves/v1/stt/live?model=pulse` | WebSocket | Streaming transcription    |

See [Transcribe (Pre-recorded)](/models/api-reference/speech-to-text/transcribe) for the full request/response schema, supported parameters, and error codes. The streaming surface shares parameters where applicable; see the [Realtime quickstart](/models/documentation/speech-to-text-pulse/realtime-web-socket/quickstart) for the WebSocket protocol details.

***

## Throughput, Latency & Pricing

| Mode                             | Typical       | Notes                                                                                                                      |
| -------------------------------- | ------------- | -------------------------------------------------------------------------------------------------------------------------- |
| Streaming TTFT (1 concurrency)   | 150 ms        | See [Measuring latency](/models/documentation/speech-to-text-pulse/benchmarks/measuring-latency) for methodology.          |
| Streaming TTFT (100 concurrency) | \~300 ms      | Concurrency curve documented in the [Performance page](/models/documentation/speech-to-text-pulse/benchmarks/performance). |
| Pre-recorded RTFx                | 50× or higher | Wall-clock; `metadata.processing_time_ms` excludes network.                                                                |

Rate limits, concurrency caps, and pricing tiers are documented on the [Concurrency & Limits](/models/api-reference/concurrency-and-limits) page. For enterprise pricing, contact [sales@smallest.ai](mailto:sales@smallest.ai).

***

## Use Cases

| Direct Use                          | Downstream Use                   |
| ----------------------------------- | -------------------------------- |
| Real-time call transcription        | Multi-turn conversational agents |
| Voice assistant input               | Voice-to-text pipelines          |
| Meeting transcription               | Telephony and IVR systems        |
| Accessibility and captioning        | Content indexing and search      |
| Customer support recording analysis | Compliance and audit logging     |

***

## Safety & Compliance

Pulse must not be used for:

* Recording or transcribing individuals without their explicit consent
* Surveillance, stalking, or any form of unauthorized monitoring
* Any illegal or unethical purposes

Additionally:

* Usage is monitored for policy compliance
* For compliance documentation (GDPR, SOC2, HIPAA), contact [support@smallest.ai](mailto:support@smallest.ai)

***

## FAQ

#### What is the difference between Pulse streaming and batch modes?

Pulse runs two independent inference paths. Streaming uses a WebSocket connection and emits partial transcripts in real time (suited for live call transcription, voice assistants, and conversational AI where first-token latency matters). Batch accepts a full audio file over HTTP and returns the complete transcript once processing is done (suited for call recordings, media archives, and any workload where you have the full audio upfront). Features also differ: keyword boosting and sentence-level timestamps are streaming-only. Batch covers 22 languages, streaming covers 21, and 12 language codes are available on both modes.

#### How do I choose between a specific language code and a regional aggregator?

Use a specific language code (e.g. `hi`, `es`, `en`) whenever you know the language of the audio. Pulse optimises directly for that language and handles code-switching with English automatically, so `hi` covers Hindi/English mixed speech without needing an aggregator. Use `north_indic` or `multi-asian` only when the source language is genuinely unknown or mixed across several languages. Auto-detection adds a small accuracy overhead compared to an explicit code.

#### Where can I find the full API reference and quickstart guides?

The complete request/response schema, all query parameters, error codes, and WebSocket protocol details are in the [API Reference](/models/api-reference/speech-to-text/transcribe). For step-by-step setup, see the [Realtime quickstart](/models/documentation/speech-to-text-pulse/realtime-web-socket/quickstart) for streaming and the [Pre-recorded quickstart](/models/documentation/speech-to-text-pulse/pre-recorded/quickstart) for batch.

#### What is the difference between Pulse and Pulse Pro?

Pulse supports both streaming and batch transcription across 31 languages (21 streaming + 22 pre-recorded, 12 codes overlap both modes). Pulse Pro is English-only and batch-only, but achieves higher accuracy: tied for #2 on the Open ASR Leaderboard at 5.42% average WER vs Pulse's 6.03% on English FLEURS. Use Pulse for live streaming, multilingual audio, or latency-sensitive workloads. Use [Pulse Pro](/models/model-cards/speech-to-text/pulse-pro) for high-volume English batch transcription where accuracy is the top requirement.

#### How does PII and PCI redaction work?

Pulse applies built-in redaction on both streaming and batch surfaces (no preprocessing required). PII redaction masks personal identifiers such as names, phone numbers, email addresses, and SSNs. PCI redaction masks payment card data including card numbers, CVVs, and expiry dates. Both are enabled via query parameters in the API request. Redacted content is replaced with a placeholder in the transcript. The original audio is not retained post-processing. Supported on `language=en` and `language=hi` only.

***

## Support

#### [Support](mailto:support@smallest.ai)

#### [Console](https://app.smallest.ai/dashboard)

#### [Documentation](https://docs.smallest.ai/models/documentation/speech-to-text-pulse/quickstart)