Python
WhisperX
Whisper plus word timestamps and diarization
by m-bain · BSD-2-Clause
Speech (STT / TTS)STT with alignmentBSD-2-ClauseRuns locallyPythonIntermediate
From the README
Install
pip install whisperx
- ⚡️ Batched inference for 70x realtime transcription using whisper large-v2
- 🪶 faster-whisper backend, requires
- 🎯 Accurate word-level timestamps using wav2vec2 alignment
- 👯♂️ Multispeaker ASR using speaker diarization from pyannote-audio (speaker ID labels)
- 🗣️ VAD preprocessing, reduces hallucination & batching with no WER degradation
Excerpts from the project README on GitHub. Copyright and licensing remain with the respective authors.
A high count usually means the project is heavily examined. A low count usually means it is little examined — not that it is safe.
No public activity signals for this tool — it has no open repository we can measure.
🐳 Docker pulls
📦 PyPI downloads / month
📦 npm downloads / month
🚀 Latest release ·
What is WhisperX?
WhisperX adds accurate word-level timestamps and speaker diarization on top of Whisper, ideal for subtitles and multi-speaker transcripts.
Why people choose WhisperX
- Accurate word-level timestamps
- Speaker diarization built in
- Great for subtitles and meeting transcripts
WhisperX at a glance
| Category | Speech (STT / TTS) |
| Type | STT with alignment |
| License | BSD-2-Clause |
| Runs locally | Yes |
| Built with | Python |
| Skill level | Intermediate |
| Best for | subtitles and multi-speaker transcripts |
Latest releases
Open-source alternatives to WhisperX
Other open-source speech (stt / tts) tools worth comparing:
WhisperOpenAI's open speech-to-text baseline
faster-whisperWhisper, much faster and lighter
PiperFast, local neural text-to-speech
Coqui TTSDeep-learning TTS with voice cloning
BarkText-to-audio with voices and effects
F5-TTSZero-shot voice cloning that actually convinces
KokoroTiny 82M TTS with astonishing quality
whisper.cppWhisper in pure C/C++, runs anywhere
OpenVoiceClone a voice and control its emotion
StyleTTS 2Human-level speech synthesis
pyannote.audioKnow who spoke when
Silero VADDetect speech in audio, instantlyWhisperX head-to-head
WhisperX vs WhisperWhisperX vs faster-whisperWhisperX vs PiperWhisperX vs Coqui TTSWhisperX vs BarkWhisperX vs F5-TTSWhisperX vs KokoroWhisperX vs VozoWhisperX vs whisper.cppWhisperX vs OpenVoiceWhisperX vs StyleTTS 2WhisperX vs pyannote.audioWhisperX vs Silero VAD
FAQ
Is WhisperX free?
WhisperX is free and open-source (BSD-2-Clause license), so you can use, self-host and modify it at no cost.
Can I run WhisperX locally?
Yes. WhisperX is designed to run on your own machine or server, keeping your data private.
What is the best alternative to WhisperX?
Popular open-source alternatives include Whisper, faster-whisper, Piper. See the comparisons above to choose.
Explore more open-source AI
Browse the full directory of open-source AI tools, models and projects — updated daily.
Browse all tools →