STT Benchmark Results
Median WER/CER and latency grouped by audio set, language, noise level, and STT model. WER clean excludes the digits and proper-name stress samples. Live audio files are not published; synthetic ones are. Runs = (number of unique samples) × (repetitions). Self-bias marks rows where the STT vendor also generated the audio (e.g. ElevenLabs Scribe on ElevenLabs TTS) — the number is computed but must not be read as a fair comparison.
Live Voice
| Audio set | Lang | STT model | Noise | Self-bias | TTS provider | TTS model | Voice | WER clean | WER full | CER | Latency / 10s | Peak RAM (MB) | Runs |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| elevenlabs_rachel_mixed | en | mlx-whisper-large-v3 | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 1.25% | 4.91% | 2.14% | 1.21 s | 3559.20 | 10 |
| elevenlabs_rachel_mixed | en | parakeet-tdt-0.6b-v3-mlx | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 1.25% | 4.91% | 3.13% | 0.29 s | 4643.84 | 10 |
| elevenlabs_rachel_mixed | en | parakeet-tdt-0.6b-v3 | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 1.25% | 4.91% | 3.21% | 0.86 s | 2963.92 | 10 |
| elevenlabs_rachel_mixed | en | fish-audio-asr | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 1.25% | 4.91% | 2.07% | 0.41 s | 49.19 | 30 |
| elevenlabs_rachel_mixed | en | deepgram-nova-3 | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 2.50% | 6.16% | 3.40% | 1.07 s | 49.75 | 30 |
| elevenlabs_rachel_mixed | en | deepgram-nova-3-multi | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 2.50% | 6.16% | 3.82% | 1.01 s | 49.86 | 30 |
| elevenlabs_rachel_mixed | en | deepgram-nova-2 | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 3.66% | 7.41% | 4.67% | 0.92 s | 50.19 | 30 |
| elevenlabs_rachel_mixed | en | mlx-whisper-small | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 4.03% | 6.44% | 3.44% | 0.35 s | 899.75 | 10 |
| elevenlabs_rachel_mixed | en | mlx-whisper-medium | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 4.03% | 6.44% | 2.55% | 0.71 s | 2605.25 | 10 |
| elevenlabs_rachel_mixed | en | mlx-whisper-large-v3-turbo | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 4.91% | 7.94% | 3.18% | 0.60 s | 4170.17 | 10 |
| elevenlabs_rachel_mixed | en | transformers-moonshine-base | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 5.56% | 6.44% | 3.38% | 2.07 s | 989.05 | 10 |
| elevenlabs_rachel_mixed | en | elevenlabs-scribe-v1 | — | ⚠ vendor | elevenlabs | eleven_flash_v2_5 | rachel | 5.83% | 6.99% | 9.02% | 1.04 s | 48.69 | 10 |
| elevenlabs_rachel_mixed | en | sensevoice-small | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 7.83% | 9.88% | 7.54% | 0.37 s | 3910.67 | 10 |
| elevenlabs_rachel_mixed | en | elevenlabs-scribe-v1-experimental | — | ⚠ vendor | elevenlabs | eleven_flash_v2_5 | rachel | 0.00% | 0.00% | 2.13% | 0.88 s | 49.08 | 10 |
| elevenlabs_rachel_mixed | ru | elevenlabs-scribe-v1-experimental | — | ⚠ vendor | elevenlabs | eleven_flash_v2_5 | rachel | 5.98% | 6.97% | 5.28% | 0.96 s | 48.89 | 10 |
| elevenlabs_rachel_mixed | ru | elevenlabs-scribe-v1 | — | ⚠ vendor | elevenlabs | eleven_flash_v2_5 | rachel | 6.97% | 8.39% | 5.89% | 1.33 s | 48.00 | 10 |
| elevenlabs_rachel_mixed | ru | mlx-whisper-medium | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 9.11% | 13.94% | 9.39% | 0.91 s | 2604.64 | 10 |
| elevenlabs_rachel_mixed | ru | mlx-whisper-large-v3-turbo | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 10.55% | 16.26% | 8.92% | 0.72 s | 4164.38 | 10 |
| elevenlabs_rachel_mixed | ru | fish-audio-asr | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 10.71% | 11.48% | 9.05% | 0.47 s | 48.47 | 30 |
| elevenlabs_rachel_mixed | ru | deepgram-nova-3-multi | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 12.02% | 13.39% | 7.72% | 1.08 s | 49.84 | 30 |
| elevenlabs_rachel_mixed | ru | deepgram-nova-2 | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 12.14% | 16.76% | 8.82% | 1.21 s | 50.17 | 30 |
| elevenlabs_rachel_mixed | ru | deepgram-nova-3 | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 12.69% | 17.07% | 9.41% | 1.06 s | 48.69 | 30 |
| elevenlabs_rachel_mixed | ru | mlx-whisper-small | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 12.86% | 14.84% | 12.61% | 0.38 s | 897.23 | 10 |
| elevenlabs_rachel_mixed | ru | gigaam-v2-rnnt | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 12.91% | 16.52% | 18.37% | 0.57 s | 3722.89 | 10 |
| elevenlabs_rachel_mixed | ru | parakeet-tdt-0.6b-v3-mlx | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 12.91% | 16.52% | 11.32% | 0.33 s | 4639.78 | 10 |
| elevenlabs_rachel_mixed | ru | parakeet-tdt-0.6b-v3 | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 12.91% | 16.52% | 7.68% | 0.94 s | 2748.19 | 10 |
| elevenlabs_rachel_mixed | ru | mlx-whisper-large-v3 | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 13.39% | 14.84% | 8.10% | 1.54 s | 7173.80 | 10 |
| elevenlabs_rachel_mixed | ru | gigaam-v2-ctc | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 14.84% | 17.07% | 18.37% | 0.49 s | 2550.48 | 10 |
| elevenlabs_rachel_mixed | ru | t-one | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 15.14% | 22.23% | 18.37% | 0.70 s | 2988.55 | 10 |
| elevenlabs_rachel_mixed | ru | sensevoice-small | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 100.00% | 100.00% | 99.30% | 0.38 s | 3905.19 | 10 |
| elevenlabs_sarah_noise | hy | elevenlabs-scribe-v1 | clean | ⚠ vendor | elevenlabs | eleven_v3 | sarah | 2.27% | 2.27% | 0.94% | 3.63 s | 64.80 | 3 |
| elevenlabs_sarah_noise | hy | elevenlabs-scribe-v1 | moderate | ⚠ vendor | elevenlabs | eleven_v3 | sarah | 2.27% | 2.27% | 1.89% | 2.59 s | 64.83 | 3 |
| elevenlabs_sarah_noise | hy | elevenlabs-scribe-v1 | heavy | ⚠ vendor | elevenlabs | eleven_v3 | sarah | 2.27% | 2.27% | 2.20% | 3.21 s | 61.19 | 3 |
| elevenlabs_sarah_noise | hy | elevenlabs-scribe-v1-experimental | clean | ⚠ vendor | elevenlabs | eleven_v3 | sarah | 2.27% | 2.27% | 0.94% | 3.92 s | 64.70 | 3 |
| elevenlabs_sarah_noise | hy | elevenlabs-scribe-v1-experimental | moderate | ⚠ vendor | elevenlabs | eleven_v3 | sarah | 2.27% | 2.27% | 1.89% | 3.22 s | 64.81 | 3 |
| elevenlabs_sarah_noise | hy | elevenlabs-scribe-v1-experimental | heavy | ⚠ vendor | elevenlabs | eleven_v3 | sarah | 2.27% | 2.27% | 2.20% | 4.34 s | 60.77 | 3 |
| elevenlabs_sarah_noise | hy | deepgram-nova-3 | moderate | — | elevenlabs | eleven_v3 | sarah | 43.18% | 43.18% | 36.16% | 1.55 s | 59.80 | 3 |
| elevenlabs_sarah_noise | hy | deepgram-nova-3 | clean | — | elevenlabs | eleven_v3 | sarah | 47.73% | 47.73% | 40.88% | 1.08 s | 63.62 | 3 |
| elevenlabs_sarah_noise | hy | groq-whisper-large-v3-turbo | moderate | — | elevenlabs | eleven_v3 | sarah | 54.55% | 54.55% | 18.87% | 0.20 s | 63.30 | 3 |
| elevenlabs_sarah_noise | hy | deepgram-nova-3 | heavy | — | elevenlabs | eleven_v3 | sarah | 54.55% | 54.55% | 33.65% | 0.53 s | 60.67 | 3 |
| elevenlabs_sarah_noise | hy | groq-whisper-large-v3 | clean | — | elevenlabs | eleven_v3 | sarah | 59.09% | 59.09% | 22.01% | 0.56 s | 62.83 | 3 |
| elevenlabs_sarah_noise | hy | groq-whisper-large-v3-turbo | clean | — | elevenlabs | eleven_v3 | sarah | 63.64% | 63.64% | 20.44% | 0.22 s | 63.25 | 3 |
| elevenlabs_sarah_noise | hy | groq-whisper-large-v3 | heavy | — | elevenlabs | eleven_v3 | sarah | 75.00% | 75.00% | 27.04% | 0.46 s | 63.19 | 3 |
| elevenlabs_sarah_noise | hy | groq-whisper-large-v3-turbo | heavy | — | elevenlabs | eleven_v3 | sarah | 77.27% | 77.27% | 26.41% | 0.19 s | 63.38 | 3 |
| elevenlabs_sarah_noise | hy | groq-whisper-large-v3 | moderate | — | elevenlabs | eleven_v3 | sarah | 95.45% | 95.45% | 87.42% | 0.46 s | 63.17 | 3 |
| elevenlabs_sarah_noise | hy | deepgram-nova-3-multi | heavy | — | elevenlabs | eleven_v3 | sarah | 100.00% | 100.00% | 90.88% | 0.41 s | 61.39 | 3 |
| elevenlabs_sarah_noise | hy | deepgram-nova-3-multi | clean | — | elevenlabs | eleven_v3 | sarah | 111.36% | 111.36% | 98.11% | 0.73 s | 63.17 | 3 |
| elevenlabs_sarah_noise | hy | fish-audio-asr | heavy | — | elevenlabs | eleven_v3 | sarah | 118.18% | 118.18% | 91.82% | 0.61 s | 58.91 | 3 |
| elevenlabs_sarah_noise | hy | deepgram-nova-3-multi | moderate | — | elevenlabs | eleven_v3 | sarah | 127.27% | 127.27% | 103.77% | 0.54 s | 60.86 | 3 |
| elevenlabs_sarah_noise | hy | fish-audio-asr | clean | — | elevenlabs | eleven_v3 | sarah | 136.36% | 136.36% | 92.14% | 0.77 s | 60.17 | 3 |
| elevenlabs_sarah_noise | hy | fish-audio-asr | moderate | — | elevenlabs | eleven_v3 | sarah | 136.36% | 136.36% | 90.88% | 0.66 s | 58.86 | 3 |
| elevenlabs_sarah_noise | ru | elevenlabs-scribe-v1 | clean | ⚠ vendor | elevenlabs | eleven_v3 | sarah | 20.34% | 20.34% | 20.00% | 0.65 s | 61.02 | 3 |
| elevenlabs_sarah_noise | ru | elevenlabs-scribe-v1-experimental | clean | ⚠ vendor | elevenlabs | eleven_v3 | sarah | 20.34% | 20.34% | 20.22% | 0.62 s | 61.00 | 3 |
| elevenlabs_sarah_noise | ru | fish-audio-asr | moderate | — | elevenlabs | eleven_v3 | sarah | 22.03% | 22.03% | 18.89% | 0.51 s | 62.28 | 3 |
| elevenlabs_sarah_noise | ru | elevenlabs-scribe-v1 | moderate | ⚠ vendor | elevenlabs | eleven_v3 | sarah | 23.73% | 23.73% | 21.56% | 0.68 s | 63.69 | 3 |
| elevenlabs_sarah_noise | ru | elevenlabs-scribe-v1-experimental | moderate | ⚠ vendor | elevenlabs | eleven_v3 | sarah | 23.73% | 23.73% | 21.78% | 0.66 s | 63.81 | 3 |
| elevenlabs_sarah_noise | ru | groq-whisper-large-v3-turbo | clean | — | elevenlabs | eleven_v3 | sarah | 25.42% | 25.42% | 24.89% | 0.17 s | 61.53 | 3 |
| elevenlabs_sarah_noise | ru | groq-whisper-large-v3-turbo | moderate | — | elevenlabs | eleven_v3 | sarah | 25.42% | 25.42% | 24.67% | 0.13 s | 62.36 | 3 |
| elevenlabs_sarah_noise | ru | groq-whisper-large-v3 | clean | — | elevenlabs | eleven_v3 | sarah | 25.42% | 25.42% | 24.89% | 0.25 s | 61.06 | 3 |
| elevenlabs_sarah_noise | ru | groq-whisper-large-v3 | moderate | — | elevenlabs | eleven_v3 | sarah | 25.42% | 25.42% | 24.89% | 0.25 s | 61.98 | 3 |
| elevenlabs_sarah_noise | ru | fish-audio-asr | clean | — | elevenlabs | eleven_v3 | sarah | 25.42% | 25.42% | 22.67% | 0.57 s | 61.28 | 3 |
| elevenlabs_sarah_noise | ru | deepgram-nova-3 | clean | — | elevenlabs | eleven_v3 | sarah | 30.51% | 30.51% | 25.11% | 0.57 s | 62.00 | 3 |
| elevenlabs_sarah_noise | ru | deepgram-nova-3 | moderate | — | elevenlabs | eleven_v3 | sarah | 30.51% | 30.51% | 26.00% | 0.53 s | 63.58 | 3 |
| elevenlabs_sarah_noise | ru | deepgram-nova-3-multi | moderate | — | elevenlabs | eleven_v3 | sarah | 32.20% | 32.20% | 30.00% | 0.48 s | 63.12 | 3 |
| elevenlabs_sarah_noise | ru | deepgram-nova-2 | clean | — | elevenlabs | eleven_v3 | sarah | 32.20% | 32.20% | 28.00% | 0.77 s | 57.92 | 3 |
| elevenlabs_sarah_noise | ru | deepgram-nova-2 | moderate | — | elevenlabs | eleven_v3 | sarah | 32.20% | 32.20% | 28.89% | 0.59 s | 59.47 | 3 |
| elevenlabs_sarah_noise | ru | deepgram-nova-3-multi | clean | — | elevenlabs | eleven_v3 | sarah | 33.90% | 33.90% | 30.44% | 0.50 s | 62.06 | 3 |
| live | en | mlx-whisper-large-v3 | — | — | — | — | — | 1.25% | 4.91% | 2.14% | 1.15 s | 1073.56 | 10 |
| live | en | parakeet-tdt-0.6b-v3-mlx | — | — | — | — | — | 1.25% | 4.91% | 3.13% | 0.29 s | 927.56 | 10 |
| live | en | parakeet-tdt-0.6b-v3 | — | — | — | — | — | 1.25% | 4.91% | 3.21% | 0.93 s | 1138.11 | 10 |
| live | en | mlx-whisper-small | — | — | — | — | — | 4.03% | 6.44% | 3.44% | 0.35 s | 901.70 | 10 |
| live | en | mlx-whisper-medium | — | — | — | — | — | 4.03% | 6.44% | 2.55% | 0.73 s | 1976.50 | 10 |
| live | en | groq-whisper-large-v3-turbo | — | — | — | — | — | 4.91% | 7.94% | 2.46% | 0.36 s | 48.64 | 10 |
| live | en | mlx-whisper-large-v3-turbo | — | — | — | — | — | 4.91% | 7.94% | 3.18% | 0.58 s | 2422.30 | 10 |
| live | en | transformers-moonshine-base | — | — | — | — | — | 5.56% | 6.44% | 3.38% | 2.57 s | 1030.08 | 10 |
| live | en | elevenlabs-scribe-v1 | — | — | — | — | — | 7.08% | 8.63% | 11.10% | 1.07 s | 48.81 | 10 |
| live | en | sensevoice-small | — | — | — | — | — | 7.83% | 9.88% | 7.54% | 0.44 s | 3659.48 | 10 |
| live | en | fish-audio-asr | — | — | — | — | — | 14.96% | 16.15% | 10.44% | 0.30 s | 48.72 | 30 |
| live | en | deepgram-nova-3-multi | — | — | — | — | — | 17.91% | 21.88% | 10.68% | 0.68 s | 49.97 | 30 |
| live | en | deepgram-nova-2 | — | — | — | — | — | 18.51% | 20.47% | 10.41% | 0.72 s | 50.09 | 30 |
| live | en | deepgram-nova-3 | — | — | — | — | — | 20.87% | 23.61% | 11.58% | 0.65 s | 49.70 | 30 |
| live | en | elevenlabs-scribe-v1-experimental | — | — | — | — | — | 0.00% | 0.00% | 2.03% | 0.98 s | 49.20 | 10 |
| live | ru | elevenlabs-scribe-v1-experimental | — | — | — | — | — | 5.98% | 6.97% | 5.28% | 1.04 s | 47.91 | 10 |
| live | ru | mlx-whisper-medium | — | — | — | — | — | 9.11% | 13.94% | 9.39% | 0.86 s | 1970.03 | 10 |
| live | ru | elevenlabs-scribe-v1 | — | — | — | — | — | 9.56% | 14.81% | 10.36% | 1.03 s | 48.02 | 10 |
| live | ru | mlx-whisper-large-v3-turbo | — | — | — | — | — | 10.55% | 16.26% | 8.92% | 0.74 s | 2414.72 | 10 |
| live | ru | groq-whisper-large-v3-turbo | — | — | — | — | — | 10.71% | 11.96% | 8.90% | 0.39 s | 48.66 | 10 |
| live | ru | mlx-whisper-small | — | — | — | — | — | 12.86% | 14.84% | 12.61% | 0.43 s | 894.48 | 10 |
| live | ru | gigaam-v2-rnnt | — | — | — | — | — | 12.91% | 16.52% | 18.37% | 0.62 s | 3785.67 | 10 |
| live | ru | parakeet-tdt-0.6b-v3 | — | — | — | — | — | 12.91% | 16.52% | 7.68% | 1.01 s | 825.36 | 10 |
| live | ru | mlx-whisper-large-v3 | — | — | — | — | — | 13.39% | 14.84% | 8.10% | 1.38 s | 3532.17 | 10 |
| live | ru | parakeet-tdt-0.6b-v3-mlx | — | — | — | — | — | 14.84% | 17.07% | 13.31% | 0.28 s | 3389.97 | 10 |
| live | ru | gigaam-v2-ctc | — | — | — | — | — | 16.52% | 18.99% | 18.79% | 0.59 s | 2987.58 | 10 |
| live | ru | deepgram-nova-2 | — | — | — | — | — | 18.57% | 21.43% | 15.72% | 0.95 s | 50.06 | 30 |
| live | ru | deepgram-nova-3-multi | — | — | — | — | — | 21.54% | 25.18% | 15.28% | 0.81 s | 49.92 | 30 |
| live | ru | fish-audio-asr | — | — | — | — | — | 22.86% | 26.32% | 16.80% | 0.41 s | 48.48 | 30 |
| live | ru | deepgram-nova-3 | — | — | — | — | — | 23.96% | 31.01% | 16.99% | 0.85 s | 48.94 | 30 |
| live | ru | t-one | — | — | — | — | — | 28.46% | 30.62% | 20.78% | 3.16 s | 2880.08 | 10 |
| live | ru | sensevoice-small | — | — | — | — | — | 100.00% | 100.00% | 99.30% | 0.42 s | 3659.05 | 10 |
| silero_v4_ru_xenia_48k | ru | mlx-whisper-large-v3 | — | — | silero | v4_ru | xenia | 16.26% | 18.57% | 18.49% | 1.93 s | 4343.11 | 10 |
| silero_v4_ru_xenia_48k | ru | mlx-whisper-large-v3-turbo | — | — | silero | v4_ru | xenia | 16.26% | 20.00% | 18.81% | 1.14 s | 3317.81 | 10 |
| silero_v4_ru_xenia_48k | ru | gigaam-v2-rnnt | — | — | silero | v4_ru | xenia | 16.88% | 19.38% | 20.54% | 0.62 s | 3371.06 | 10 |
| silero_v4_ru_xenia_48k | ru | gigaam-v2-ctc | — | — | silero | v4_ru | xenia | 16.88% | 20.80% | 20.68% | 0.66 s | 2184.78 | 10 |
| silero_v4_ru_xenia_48k | ru | deepgram-nova-3-multi | — | — | silero | v4_ru | xenia | 17.69% | 22.50% | 19.19% | 1.90 s | 52.88 | 30 |
| silero_v4_ru_xenia_48k | ru | mlx-whisper-medium | — | — | silero | v4_ru | xenia | 17.95% | 20.74% | 18.55% | 1.19 s | 2542.75 | 10 |
| silero_v4_ru_xenia_48k | ru | deepgram-nova-3 | — | — | silero | v4_ru | xenia | 18.19% | 22.12% | 19.12% | 2.14 s | 50.84 | 30 |
| silero_v4_ru_xenia_48k | ru | parakeet-tdt-0.6b-v3-mlx | — | — | silero | v4_ru | xenia | 19.38% | 21.43% | 17.95% | 0.36 s | 4493.45 | 10 |
| silero_v4_ru_xenia_48k | ru | parakeet-tdt-0.6b-v3 | — | — | silero | v4_ru | xenia | 19.38% | 21.43% | 18.37% | 1.25 s | 2358.77 | 10 |
| silero_v4_ru_xenia_48k | ru | deepgram-nova-2 | — | — | silero | v4_ru | xenia | 19.62% | 22.50% | 21.44% | 2.23 s | 53.09 | 30 |
| silero_v4_ru_xenia_48k | ru | mlx-whisper-small | — | — | silero | v4_ru | xenia | 21.36% | 22.79% | 19.32% | 0.53 s | 895.81 | 10 |
| silero_v4_ru_xenia_48k | ru | t-one | — | — | silero | v4_ru | xenia | 21.43% | 22.97% | 20.42% | 0.84 s | 1887.78 | 10 |
| silero_v4_ru_xenia_48k | ru | fish-audio-asr | — | — | silero | v4_ru | xenia | 22.79% | 23.93% | 18.96% | 1.06 s | 48.41 | 30 |
| silero_v4_ru_xenia_48k | ru | sensevoice-small | — | — | silero | v4_ru | xenia | 100.00% | 100.00% | 99.23% | 0.56 s | 3270.36 | 10 |
Synthetic Audio
| Audio set | Lang | STT model | Noise | Self-bias | TTS provider | TTS model | Voice | WER clean | WER full | CER | Latency / 10s | Peak RAM (MB) | Runs |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| elevenlabs_rachel_mixed | en | mlx-whisper-large-v3 | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 1.25% | 4.91% | 2.14% | 1.21 s | 3559.20 | 10 |
| elevenlabs_rachel_mixed | en | parakeet-tdt-0.6b-v3-mlx | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 1.25% | 4.91% | 3.13% | 0.29 s | 4643.84 | 10 |
| elevenlabs_rachel_mixed | en | parakeet-tdt-0.6b-v3 | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 1.25% | 4.91% | 3.21% | 0.86 s | 2963.92 | 10 |
| elevenlabs_rachel_mixed | en | fish-audio-asr | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 1.25% | 4.91% | 2.07% | 0.41 s | 49.19 | 30 |
| elevenlabs_rachel_mixed | en | deepgram-nova-3 | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 2.50% | 6.16% | 3.40% | 1.07 s | 49.75 | 30 |
| elevenlabs_rachel_mixed | en | deepgram-nova-3-multi | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 2.50% | 6.16% | 3.82% | 1.01 s | 49.86 | 30 |
| elevenlabs_rachel_mixed | en | deepgram-nova-2 | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 3.66% | 7.41% | 4.67% | 0.92 s | 50.19 | 30 |
| elevenlabs_rachel_mixed | en | mlx-whisper-small | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 4.03% | 6.44% | 3.44% | 0.35 s | 899.75 | 10 |
| elevenlabs_rachel_mixed | en | mlx-whisper-medium | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 4.03% | 6.44% | 2.55% | 0.71 s | 2605.25 | 10 |
| elevenlabs_rachel_mixed | en | mlx-whisper-large-v3-turbo | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 4.91% | 7.94% | 3.18% | 0.60 s | 4170.17 | 10 |
| elevenlabs_rachel_mixed | en | transformers-moonshine-base | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 5.56% | 6.44% | 3.38% | 2.07 s | 989.05 | 10 |
| elevenlabs_rachel_mixed | en | elevenlabs-scribe-v1 | — | ⚠ vendor | elevenlabs | eleven_flash_v2_5 | rachel | 5.83% | 6.99% | 9.02% | 1.04 s | 48.69 | 10 |
| elevenlabs_rachel_mixed | en | sensevoice-small | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 7.83% | 9.88% | 7.54% | 0.37 s | 3910.67 | 10 |
| elevenlabs_rachel_mixed | en | elevenlabs-scribe-v1-experimental | — | ⚠ vendor | elevenlabs | eleven_flash_v2_5 | rachel | 0.00% | 0.00% | 2.13% | 0.88 s | 49.08 | 10 |
| elevenlabs_rachel_mixed | ru | elevenlabs-scribe-v1-experimental | — | ⚠ vendor | elevenlabs | eleven_flash_v2_5 | rachel | 5.98% | 6.97% | 5.28% | 0.96 s | 48.89 | 10 |
| elevenlabs_rachel_mixed | ru | elevenlabs-scribe-v1 | — | ⚠ vendor | elevenlabs | eleven_flash_v2_5 | rachel | 6.97% | 8.39% | 5.89% | 1.33 s | 48.00 | 10 |
| elevenlabs_rachel_mixed | ru | mlx-whisper-medium | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 9.11% | 13.94% | 9.39% | 0.91 s | 2604.64 | 10 |
| elevenlabs_rachel_mixed | ru | mlx-whisper-large-v3-turbo | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 10.55% | 16.26% | 8.92% | 0.72 s | 4164.38 | 10 |
| elevenlabs_rachel_mixed | ru | fish-audio-asr | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 10.71% | 11.48% | 9.05% | 0.47 s | 48.47 | 30 |
| elevenlabs_rachel_mixed | ru | deepgram-nova-3-multi | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 12.02% | 13.39% | 7.72% | 1.08 s | 49.84 | 30 |
| elevenlabs_rachel_mixed | ru | deepgram-nova-2 | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 12.14% | 16.76% | 8.82% | 1.21 s | 50.17 | 30 |
| elevenlabs_rachel_mixed | ru | deepgram-nova-3 | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 12.69% | 17.07% | 9.41% | 1.06 s | 48.69 | 30 |
| elevenlabs_rachel_mixed | ru | mlx-whisper-small | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 12.86% | 14.84% | 12.61% | 0.38 s | 897.23 | 10 |
| elevenlabs_rachel_mixed | ru | gigaam-v2-rnnt | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 12.91% | 16.52% | 18.37% | 0.57 s | 3722.89 | 10 |
| elevenlabs_rachel_mixed | ru | parakeet-tdt-0.6b-v3-mlx | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 12.91% | 16.52% | 11.32% | 0.33 s | 4639.78 | 10 |
| elevenlabs_rachel_mixed | ru | parakeet-tdt-0.6b-v3 | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 12.91% | 16.52% | 7.68% | 0.94 s | 2748.19 | 10 |
| elevenlabs_rachel_mixed | ru | mlx-whisper-large-v3 | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 13.39% | 14.84% | 8.10% | 1.54 s | 7173.80 | 10 |
| elevenlabs_rachel_mixed | ru | gigaam-v2-ctc | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 14.84% | 17.07% | 18.37% | 0.49 s | 2550.48 | 10 |
| elevenlabs_rachel_mixed | ru | t-one | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 15.14% | 22.23% | 18.37% | 0.70 s | 2988.55 | 10 |
| elevenlabs_rachel_mixed | ru | sensevoice-small | — | — | elevenlabs | eleven_flash_v2_5 | rachel | 100.00% | 100.00% | 99.30% | 0.38 s | 3905.19 | 10 |
| elevenlabs_sarah_noise | hy | elevenlabs-scribe-v1 | clean | ⚠ vendor | elevenlabs | eleven_v3 | sarah | 2.27% | 2.27% | 0.94% | 3.63 s | 64.80 | 3 |
| elevenlabs_sarah_noise | hy | elevenlabs-scribe-v1 | moderate | ⚠ vendor | elevenlabs | eleven_v3 | sarah | 2.27% | 2.27% | 1.89% | 2.59 s | 64.83 | 3 |
| elevenlabs_sarah_noise | hy | elevenlabs-scribe-v1 | heavy | ⚠ vendor | elevenlabs | eleven_v3 | sarah | 2.27% | 2.27% | 2.20% | 3.21 s | 61.19 | 3 |
| elevenlabs_sarah_noise | hy | elevenlabs-scribe-v1-experimental | clean | ⚠ vendor | elevenlabs | eleven_v3 | sarah | 2.27% | 2.27% | 0.94% | 3.92 s | 64.70 | 3 |
| elevenlabs_sarah_noise | hy | elevenlabs-scribe-v1-experimental | moderate | ⚠ vendor | elevenlabs | eleven_v3 | sarah | 2.27% | 2.27% | 1.89% | 3.22 s | 64.81 | 3 |
| elevenlabs_sarah_noise | hy | elevenlabs-scribe-v1-experimental | heavy | ⚠ vendor | elevenlabs | eleven_v3 | sarah | 2.27% | 2.27% | 2.20% | 4.34 s | 60.77 | 3 |
| elevenlabs_sarah_noise | hy | deepgram-nova-3 | moderate | — | elevenlabs | eleven_v3 | sarah | 43.18% | 43.18% | 36.16% | 1.55 s | 59.80 | 3 |
| elevenlabs_sarah_noise | hy | deepgram-nova-3 | clean | — | elevenlabs | eleven_v3 | sarah | 47.73% | 47.73% | 40.88% | 1.08 s | 63.62 | 3 |
| elevenlabs_sarah_noise | hy | groq-whisper-large-v3-turbo | moderate | — | elevenlabs | eleven_v3 | sarah | 54.55% | 54.55% | 18.87% | 0.20 s | 63.30 | 3 |
| elevenlabs_sarah_noise | hy | deepgram-nova-3 | heavy | — | elevenlabs | eleven_v3 | sarah | 54.55% | 54.55% | 33.65% | 0.53 s | 60.67 | 3 |
| elevenlabs_sarah_noise | hy | groq-whisper-large-v3 | clean | — | elevenlabs | eleven_v3 | sarah | 59.09% | 59.09% | 22.01% | 0.56 s | 62.83 | 3 |
| elevenlabs_sarah_noise | hy | groq-whisper-large-v3-turbo | clean | — | elevenlabs | eleven_v3 | sarah | 63.64% | 63.64% | 20.44% | 0.22 s | 63.25 | 3 |
| elevenlabs_sarah_noise | hy | groq-whisper-large-v3 | heavy | — | elevenlabs | eleven_v3 | sarah | 75.00% | 75.00% | 27.04% | 0.46 s | 63.19 | 3 |
| elevenlabs_sarah_noise | hy | groq-whisper-large-v3-turbo | heavy | — | elevenlabs | eleven_v3 | sarah | 77.27% | 77.27% | 26.41% | 0.19 s | 63.38 | 3 |
| elevenlabs_sarah_noise | hy | groq-whisper-large-v3 | moderate | — | elevenlabs | eleven_v3 | sarah | 95.45% | 95.45% | 87.42% | 0.46 s | 63.17 | 3 |
| elevenlabs_sarah_noise | hy | deepgram-nova-3-multi | heavy | — | elevenlabs | eleven_v3 | sarah | 100.00% | 100.00% | 90.88% | 0.41 s | 61.39 | 3 |
| elevenlabs_sarah_noise | hy | deepgram-nova-3-multi | clean | — | elevenlabs | eleven_v3 | sarah | 111.36% | 111.36% | 98.11% | 0.73 s | 63.17 | 3 |
| elevenlabs_sarah_noise | hy | fish-audio-asr | heavy | — | elevenlabs | eleven_v3 | sarah | 118.18% | 118.18% | 91.82% | 0.61 s | 58.91 | 3 |
| elevenlabs_sarah_noise | hy | deepgram-nova-3-multi | moderate | — | elevenlabs | eleven_v3 | sarah | 127.27% | 127.27% | 103.77% | 0.54 s | 60.86 | 3 |
| elevenlabs_sarah_noise | hy | fish-audio-asr | clean | — | elevenlabs | eleven_v3 | sarah | 136.36% | 136.36% | 92.14% | 0.77 s | 60.17 | 3 |
| elevenlabs_sarah_noise | hy | fish-audio-asr | moderate | — | elevenlabs | eleven_v3 | sarah | 136.36% | 136.36% | 90.88% | 0.66 s | 58.86 | 3 |
| elevenlabs_sarah_noise | ru | elevenlabs-scribe-v1 | clean | ⚠ vendor | elevenlabs | eleven_v3 | sarah | 20.34% | 20.34% | 20.00% | 0.65 s | 61.02 | 3 |
| elevenlabs_sarah_noise | ru | elevenlabs-scribe-v1-experimental | clean | ⚠ vendor | elevenlabs | eleven_v3 | sarah | 20.34% | 20.34% | 20.22% | 0.62 s | 61.00 | 3 |
| elevenlabs_sarah_noise | ru | fish-audio-asr | moderate | — | elevenlabs | eleven_v3 | sarah | 22.03% | 22.03% | 18.89% | 0.51 s | 62.28 | 3 |
| elevenlabs_sarah_noise | ru | elevenlabs-scribe-v1 | moderate | ⚠ vendor | elevenlabs | eleven_v3 | sarah | 23.73% | 23.73% | 21.56% | 0.68 s | 63.69 | 3 |
| elevenlabs_sarah_noise | ru | elevenlabs-scribe-v1-experimental | moderate | ⚠ vendor | elevenlabs | eleven_v3 | sarah | 23.73% | 23.73% | 21.78% | 0.66 s | 63.81 | 3 |
| elevenlabs_sarah_noise | ru | groq-whisper-large-v3-turbo | clean | — | elevenlabs | eleven_v3 | sarah | 25.42% | 25.42% | 24.89% | 0.17 s | 61.53 | 3 |
| elevenlabs_sarah_noise | ru | groq-whisper-large-v3-turbo | moderate | — | elevenlabs | eleven_v3 | sarah | 25.42% | 25.42% | 24.67% | 0.13 s | 62.36 | 3 |
| elevenlabs_sarah_noise | ru | groq-whisper-large-v3 | clean | — | elevenlabs | eleven_v3 | sarah | 25.42% | 25.42% | 24.89% | 0.25 s | 61.06 | 3 |
| elevenlabs_sarah_noise | ru | groq-whisper-large-v3 | moderate | — | elevenlabs | eleven_v3 | sarah | 25.42% | 25.42% | 24.89% | 0.25 s | 61.98 | 3 |
| elevenlabs_sarah_noise | ru | fish-audio-asr | clean | — | elevenlabs | eleven_v3 | sarah | 25.42% | 25.42% | 22.67% | 0.57 s | 61.28 | 3 |
| elevenlabs_sarah_noise | ru | deepgram-nova-3 | clean | — | elevenlabs | eleven_v3 | sarah | 30.51% | 30.51% | 25.11% | 0.57 s | 62.00 | 3 |
| elevenlabs_sarah_noise | ru | deepgram-nova-3 | moderate | — | elevenlabs | eleven_v3 | sarah | 30.51% | 30.51% | 26.00% | 0.53 s | 63.58 | 3 |
| elevenlabs_sarah_noise | ru | deepgram-nova-3-multi | moderate | — | elevenlabs | eleven_v3 | sarah | 32.20% | 32.20% | 30.00% | 0.48 s | 63.12 | 3 |
| elevenlabs_sarah_noise | ru | deepgram-nova-2 | clean | — | elevenlabs | eleven_v3 | sarah | 32.20% | 32.20% | 28.00% | 0.77 s | 57.92 | 3 |
| elevenlabs_sarah_noise | ru | deepgram-nova-2 | moderate | — | elevenlabs | eleven_v3 | sarah | 32.20% | 32.20% | 28.89% | 0.59 s | 59.47 | 3 |
| elevenlabs_sarah_noise | ru | deepgram-nova-3-multi | clean | — | elevenlabs | eleven_v3 | sarah | 33.90% | 33.90% | 30.44% | 0.50 s | 62.06 | 3 |
| live | en | mlx-whisper-large-v3 | — | — | — | — | — | 1.25% | 4.91% | 2.14% | 1.15 s | 1073.56 | 10 |
| live | en | parakeet-tdt-0.6b-v3-mlx | — | — | — | — | — | 1.25% | 4.91% | 3.13% | 0.29 s | 927.56 | 10 |
| live | en | parakeet-tdt-0.6b-v3 | — | — | — | — | — | 1.25% | 4.91% | 3.21% | 0.93 s | 1138.11 | 10 |
| live | en | mlx-whisper-small | — | — | — | — | — | 4.03% | 6.44% | 3.44% | 0.35 s | 901.70 | 10 |
| live | en | mlx-whisper-medium | — | — | — | — | — | 4.03% | 6.44% | 2.55% | 0.73 s | 1976.50 | 10 |
| live | en | groq-whisper-large-v3-turbo | — | — | — | — | — | 4.91% | 7.94% | 2.46% | 0.36 s | 48.64 | 10 |
| live | en | mlx-whisper-large-v3-turbo | — | — | — | — | — | 4.91% | 7.94% | 3.18% | 0.58 s | 2422.30 | 10 |
| live | en | transformers-moonshine-base | — | — | — | — | — | 5.56% | 6.44% | 3.38% | 2.57 s | 1030.08 | 10 |
| live | en | elevenlabs-scribe-v1 | — | — | — | — | — | 7.08% | 8.63% | 11.10% | 1.07 s | 48.81 | 10 |
| live | en | sensevoice-small | — | — | — | — | — | 7.83% | 9.88% | 7.54% | 0.44 s | 3659.48 | 10 |
| live | en | fish-audio-asr | — | — | — | — | — | 14.96% | 16.15% | 10.44% | 0.30 s | 48.72 | 30 |
| live | en | deepgram-nova-3-multi | — | — | — | — | — | 17.91% | 21.88% | 10.68% | 0.68 s | 49.97 | 30 |
| live | en | deepgram-nova-2 | — | — | — | — | — | 18.51% | 20.47% | 10.41% | 0.72 s | 50.09 | 30 |
| live | en | deepgram-nova-3 | — | — | — | — | — | 20.87% | 23.61% | 11.58% | 0.65 s | 49.70 | 30 |
| live | en | elevenlabs-scribe-v1-experimental | — | — | — | — | — | 0.00% | 0.00% | 2.03% | 0.98 s | 49.20 | 10 |
| live | ru | elevenlabs-scribe-v1-experimental | — | — | — | — | — | 5.98% | 6.97% | 5.28% | 1.04 s | 47.91 | 10 |
| live | ru | mlx-whisper-medium | — | — | — | — | — | 9.11% | 13.94% | 9.39% | 0.86 s | 1970.03 | 10 |
| live | ru | elevenlabs-scribe-v1 | — | — | — | — | — | 9.56% | 14.81% | 10.36% | 1.03 s | 48.02 | 10 |
| live | ru | mlx-whisper-large-v3-turbo | — | — | — | — | — | 10.55% | 16.26% | 8.92% | 0.74 s | 2414.72 | 10 |
| live | ru | groq-whisper-large-v3-turbo | — | — | — | — | — | 10.71% | 11.96% | 8.90% | 0.39 s | 48.66 | 10 |
| live | ru | mlx-whisper-small | — | — | — | — | — | 12.86% | 14.84% | 12.61% | 0.43 s | 894.48 | 10 |
| live | ru | gigaam-v2-rnnt | — | — | — | — | — | 12.91% | 16.52% | 18.37% | 0.62 s | 3785.67 | 10 |
| live | ru | parakeet-tdt-0.6b-v3 | — | — | — | — | — | 12.91% | 16.52% | 7.68% | 1.01 s | 825.36 | 10 |
| live | ru | mlx-whisper-large-v3 | — | — | — | — | — | 13.39% | 14.84% | 8.10% | 1.38 s | 3532.17 | 10 |
| live | ru | parakeet-tdt-0.6b-v3-mlx | — | — | — | — | — | 14.84% | 17.07% | 13.31% | 0.28 s | 3389.97 | 10 |
| live | ru | gigaam-v2-ctc | — | — | — | — | — | 16.52% | 18.99% | 18.79% | 0.59 s | 2987.58 | 10 |
| live | ru | deepgram-nova-2 | — | — | — | — | — | 18.57% | 21.43% | 15.72% | 0.95 s | 50.06 | 30 |
| live | ru | deepgram-nova-3-multi | — | — | — | — | — | 21.54% | 25.18% | 15.28% | 0.81 s | 49.92 | 30 |
| live | ru | fish-audio-asr | — | — | — | — | — | 22.86% | 26.32% | 16.80% | 0.41 s | 48.48 | 30 |
| live | ru | deepgram-nova-3 | — | — | — | — | — | 23.96% | 31.01% | 16.99% | 0.85 s | 48.94 | 30 |
| live | ru | t-one | — | — | — | — | — | 28.46% | 30.62% | 20.78% | 3.16 s | 2880.08 | 10 |
| live | ru | sensevoice-small | — | — | — | — | — | 100.00% | 100.00% | 99.30% | 0.42 s | 3659.05 | 10 |
| silero_v4_ru_xenia_48k | ru | mlx-whisper-large-v3 | — | — | silero | v4_ru | xenia | 16.26% | 18.57% | 18.49% | 1.93 s | 4343.11 | 10 |
| silero_v4_ru_xenia_48k | ru | mlx-whisper-large-v3-turbo | — | — | silero | v4_ru | xenia | 16.26% | 20.00% | 18.81% | 1.14 s | 3317.81 | 10 |
| silero_v4_ru_xenia_48k | ru | gigaam-v2-rnnt | — | — | silero | v4_ru | xenia | 16.88% | 19.38% | 20.54% | 0.62 s | 3371.06 | 10 |
| silero_v4_ru_xenia_48k | ru | gigaam-v2-ctc | — | — | silero | v4_ru | xenia | 16.88% | 20.80% | 20.68% | 0.66 s | 2184.78 | 10 |
| silero_v4_ru_xenia_48k | ru | deepgram-nova-3-multi | — | — | silero | v4_ru | xenia | 17.69% | 22.50% | 19.19% | 1.90 s | 52.88 | 30 |
| silero_v4_ru_xenia_48k | ru | mlx-whisper-medium | — | — | silero | v4_ru | xenia | 17.95% | 20.74% | 18.55% | 1.19 s | 2542.75 | 10 |
| silero_v4_ru_xenia_48k | ru | deepgram-nova-3 | — | — | silero | v4_ru | xenia | 18.19% | 22.12% | 19.12% | 2.14 s | 50.84 | 30 |
| silero_v4_ru_xenia_48k | ru | parakeet-tdt-0.6b-v3-mlx | — | — | silero | v4_ru | xenia | 19.38% | 21.43% | 17.95% | 0.36 s | 4493.45 | 10 |
| silero_v4_ru_xenia_48k | ru | parakeet-tdt-0.6b-v3 | — | — | silero | v4_ru | xenia | 19.38% | 21.43% | 18.37% | 1.25 s | 2358.77 | 10 |
| silero_v4_ru_xenia_48k | ru | deepgram-nova-2 | — | — | silero | v4_ru | xenia | 19.62% | 22.50% | 21.44% | 2.23 s | 53.09 | 30 |
| silero_v4_ru_xenia_48k | ru | mlx-whisper-small | — | — | silero | v4_ru | xenia | 21.36% | 22.79% | 19.32% | 0.53 s | 895.81 | 10 |
| silero_v4_ru_xenia_48k | ru | t-one | — | — | silero | v4_ru | xenia | 21.43% | 22.97% | 20.42% | 0.84 s | 1887.78 | 10 |
| silero_v4_ru_xenia_48k | ru | fish-audio-asr | — | — | silero | v4_ru | xenia | 22.79% | 23.93% | 18.96% | 1.06 s | 48.41 | 30 |
| silero_v4_ru_xenia_48k | ru | sensevoice-small | — | — | silero | v4_ru | xenia | 100.00% | 100.00% | 99.23% | 0.56 s | 3270.36 | 10 |