This guide shows you how to transcribe streaming audio using Smallest AI’s Pulse STT model via the WebSocket API. The Pulse model provides state-of-the-art low latencies (64ms) for TTFT (Time to First Transcript), making it an ideal choice for speech-to-text conversion during live conversations.

Real-Time Audio Transcription

The Real-Time API allows you to stream audio data and receive transcription results as the audio is processed. This is ideal for live conversations, voice assistants, and scenarios where you need immediate transcription feedback. For these scenarios, where minimizing latency is critical, stream audio in chunks of a few kilobytes over a live connection.

When to Use Real-Time Transcription

• Live conversations: Transcribe phone calls, video conferences, or live events.
• Voice assistants: Build interactive voice applications that respond immediately.
• Streaming workflows: Process audio as it is being captured or generated.
• Low-latency requirements: When you need transcription results with minimal delay.

Endpoint

WSS wss://waves-api.smallest.ai/api/v1/pulse/get_text

Authentication

Head over to the smallest console to generate an API key if not done previously. Also look at Authentication guide for more information about API keys and their usage.

Include your API key in the Authorization header when establishing the WebSocket connection:

1
Authorization: Bearer SMALLEST_API_KEY

Example Connection

1
const API_KEY = "SMALLEST_API_KEY";
2
3
const url = new URL("wss://waves-api.smallest.ai/api/v1/pulse/get_text");
4
url.searchParams.append("language", "en");
5
url.searchParams.append("encoding", "linear16");
6
url.searchParams.append("sample_rate", "16000");
7
url.searchParams.append("word_timestamps", "true");
8
9
const ws = new WebSocket(url.toString(), {
10
  headers: {
11
    Authorization: `Bearer ${API_KEY}`,
12
  },
13
});
14
15
ws.onopen = () => {
16
  console.log("Connected to STT WebSocket");
17
  // Start streaming audio chunks
18
};
19
20
ws.onmessage = (event) => {
21
  const data = JSON.parse(event.data);
22
  console.log("Transcript:", data.transcript);
23
  console.log("Full transcript:", data.full_transcript);
24
  console.log("Is final:", data.is_final);
25
};

Example Response

The server responds with JSON messages containing transcription results:

1
{
2
  "session_id": "sess_12345abcde",
3
  "transcript": "Hello, how are you?",
4
  "is_final": true,
5
  "is_last": false,
6
  "language": "en"
7
}

For detailed information about response fields, see the response format documentation.

Streaming Audio

Send raw audio bytes as binary WebSocket messages. The recommended chunk size is 4096 bytes:

1
const audioChunk = new Uint8Array(4096);
2
ws.send(audioChunk);

When you’re done streaming, send an end signal:

1
{
2
  "type": "end"
3
}

Next Steps

• Learn about supported audio formats for WebSocket streaming.
• Review complete code examples for Python, Node.js, and Browser JavaScript.
• Follow best practices for optimal streaming performance.
• Troubleshoot common issues in the troubleshooting guide.