WhisperLiveKit/benchmarks/m5
Quentin Fuxa 7aa3b764bd MLX benchmark: 1.7B SimulStreaming on M5 (WER 4.07%, RTF 0.944)
LibriSpeech test-clean, 500 utterances.
1.7B is borderline real-time on M5 (RTF 0.944).
0.6B (3.30% WER, 0.263 RTF) is the practical choice for MacBook.
2026-03-15 14:00:00 +01:00
..
bench_0.6b_simul_500.json MLX benchmark: 0.6B SimulStreaming on M5 MacBook (WER 3.30%, RTF 0.263) 2026-03-15 13:00:00 +01:00
bench_1.7b_simul_500.json MLX benchmark: 1.7B SimulStreaming on M5 (WER 4.07%, RTF 0.944) 2026-03-15 14:00:00 +01:00