Skip to navigation

End-of-Turn Detection

Pulse 2.0’s built-in end-of-turn detection head-to-head vs LiveKit, Deepgram Flux and others.

View as Markdown

Pulse 2.0 adds built-in end-of-turn (EOT) detection on top of everything Pulse’s streaming surface supports. Evaluated on livekit/eot-bench, English validation split (400 turns, 705 hold spans, 400 EOT spans). Every model streamed through its own live server and was scored against the same reference spans.

Sorted by false cutoffs at 300 ms, matching LiveKit’s own comparison table. Lower is better on every column; – means the model can’t reach that operating point.

ModelFalse cutoffs @ 300 msFalse cutoffs @ 600 msLatency @ 5% cutoffLatency @ 10% cutoff
LiveKit Turn Detector v19.9%4.5%543 ms295 ms
Deepgram Flux12.9%9.9%1151 ms548 ms
ultraVAD27.7%11.9%899 ms663 ms
LiveKit v1-mini27.8%12.1%1070 ms698 ms
Pulse EoT v1 (ours)28.4%8.8%784 ms572 ms
SmartTurn v3.235.2%14.8%1051 ms739 ms
AssemblyAI49.4%14.6%1049 ms713 ms
Soniox–5.5%647 ms512 ms
Cartesia Ink 2––1056 ms911 ms
OpenAI GPT Realtime 2––1143 ms824 ms
VAD baseline55.6%21.7%1600 ms1000 ms

Pulse EoT v1 ranks 3rd of 11 on false cutoffs at 600 ms and 3rd/4th on latency at the 5%/10% budgets - second only to LiveKit v1 among self-hosted models. Against Deepgram Flux specifically: it wins on false cutoffs at 600 ms (8.8% vs 9.9%) and latency at 5% (784 ms vs 1151 ms), and loses on false cutoffs at 300 ms and latency at 10%.

Signal-quality diagnostic

AUC / AP over the full span, independent of any operating-point choice:

ModelAUCAP
LiveKit Turn Detector v10.96860.9414
Pulse EoT v1 (ours)0.96400.9250
Cartesia Ink 20.95490.9091
Deepgram Flux0.94140.8783
Soniox0.90630.8303
AssemblyAI0.89640.7846
LiveKit v1-mini0.89020.8131
ultraVAD0.88440.7966
OpenAI GPT Realtime 20.85840.7436
SmartTurn v3.20.84460.7383

2nd of 10 on raw signal quality. The gap between 2nd on discrimination and mid-pack on false cutoffs at the 300 ms budget is a timing effect, not a signal-quality one - the model knows the turn has ended, it just says so a little late.

Detect rate (correctly identifying a true turn-end at all, independent of timing) is best-in-class: 95.8% at the 5% false-cutoff operating point, vs LiveKit v1’s 91.0%.