Oriel — AI & technology worth noticing, every day.

microsoft/VibeVoice

Repository · https://github.com/microsoft/vibevoice

Open-Source Frontier Voice AI

First seen by Oriel on .

AI summary

VibeVoice is an open-source voice AI model family for long-form and streaming speech recognition and synthesis, using low-frame-rate speech tokenizers and a next-token diffusion framework.

  • VibeVoice-ASR processes up to 60 minutes of audio in one pass and produces speaker labels, timestamps, and transcription, with customized hotwords and support for over 50 languages.
  • The streaming ASR variant emits transcription as audio arrives, while VibeVoice-ASR-BitNet targets CPU inference and reports real-time performance on three or more CPU threads.
  • VibeVoice-TTS was designed to generate up to 90 minutes of speech with as many as four speakers, but its code was removed from the repository after misuse concerns.
  • VibeVoice-Realtime is a 0.5B text-to-speech model with streaming text input, about 300 milliseconds of first-audio latency, and generation of roughly 10 minutes of speech.
  • The project warns that outputs may be biased, inaccurate, or misused for deepfakes, and says the models are for research and development rather than commercial or real-world use without further testing.

#speech recognition #text-to-speech #voice ai #diffusion models

Generated by gpt-5.6-sol. Check the original for details.

Metric trends

Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained

Stars

Total repository stars at each observation.

  • GitHub Trending: 56,333, latest observation ; +960 over observed period since

Stars gained (1d)

Daily star gain reported by GitHub Trending. A change compares two daily values; it is not additional stars between observations.

  • GitHub Trending: 223, latest observation ; +9 over observed period since

Forks

Total repository forks at each observation.

  • GitHub Trending: 6,343, latest observation ; +102 over observed period since

Aliases

SourceExternal IDURL
GitHub Trendingmicrosoft/vibevoicehttps://github.com/microsoft/VibeVoice Read discussion