microsoft/VibeVoice
Repository · https://github.com/microsoft/vibevoice
Open-Source Frontier Voice AI
First seen by Oriel on .
AI summary
VibeVoice is an open-source voice AI model family for long-form and streaming speech recognition and synthesis, using low-frame-rate speech tokenizers and a next-token diffusion framework.
- VibeVoice-ASR processes up to 60 minutes of audio in one pass and produces speaker labels, timestamps, and transcription, with customized hotwords and support for over 50 languages.
- The streaming ASR variant emits transcription as audio arrives, while VibeVoice-ASR-BitNet targets CPU inference and reports real-time performance on three or more CPU threads.
- VibeVoice-TTS was designed to generate up to 90 minutes of speech with as many as four speakers, but its code was removed from the repository after misuse concerns.
- VibeVoice-Realtime is a 0.5B text-to-speech model with streaming text input, about 300 milliseconds of first-audio latency, and generation of roughly 10 minutes of speech.
- The project warns that outputs may be biased, inaccurate, or misused for deepfakes, and says the models are for research and development rather than commercial or real-world use without further testing.
#speech recognition #text-to-speech #voice ai #diffusion models
Generated by gpt-5.6-sol. Check the original for details.
Metric trends
Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained
Stars
Total repository stars at each observation.
- GitHub Trending: 56,333, latest observation ; +960 over observed period since
Stars gained (1d)
Daily star gain reported by GitHub Trending. A change compares two daily values; it is not additional stars between observations.
- GitHub Trending: 223, latest observation ; +9 over observed period since
Forks
Total repository forks at each observation.
- GitHub Trending: 6,343, latest observation ; +102 over observed period since
Aliases
| Source | External ID | URL |
|---|---|---|
| GitHub Trending | microsoft/vibevoice | https://github.com/microsoft/VibeVoice Read discussion |