🚀 Say hello to unmute.sh — a modular voice AI system built on our in-house low latency text-to-speech and speech-to-text engines. It works in English 🇬🇧 and French 🇫🇷 and you can customize the voice and personality. 🎙️Try it live and tell us what you think!

I'll present a dive into Moshi 🟢 and our translation model Hibiki 🇫🇷♻️🇬🇧 as part of the next @convai-rg.bsky.social reading group 👨‍🏫📗. 📅 13th of March 🕰️ 11am ET, 4pm in Paris. I'll discuss Mimi 🗜️ and multi-stream audio modeling 🔊. Join on Zoom, replay on YT. ⬛ ⬛ 🟧 🟧 🟨 🟨 🟩 🟩 🟩 ⬛ ⬛ 🟧 🟧 🟨 🟨 🟩 🟩 🟩 ⬛ ⬛

Afraid of missing out on French pop culture references because you don't speak the language? Fear no more and try our Hibiki speech-to-speech translation model— no more FOMO! 🇫🇷✨ #Translation #AI

Even Kavinsky 🎧🪩 can't break Hibiki! Just like Moshi, Hibiki is robust to extreme background conditions 💥🔊.

We just released Hibiki 🟢, a real time speech-to-speech translation 🇫🇷 -> 🇬🇧. It preserves the voice of the user, and the smaller variant can run on iPhone as showed by Neil in this video. Find the code on github github.com/kyutai-labs/... and the weights on HF and give it a spin!

Very impressive to hear this Japanese 🇯🇵 version of moshi 🟢. I don't speak the language so I cannot understand what it's trying to tell me but at least it sounds great 😅 github.com/nu-dialogue/...

Getting our latest LLM to run on the edge was pretty fun, it had been a while since I last used swift and it's still a pretty enjoyable language!

Super proud of our first publicly released text model, helium-1 preview, a 2B model trained on 6 languages. It should be a great fit for on-device applications. Already available in candle/transformers, can't wait to see what the community builds with it! #OpenSource #AI #FTW!

Last week we've received a new M4pro mac mini so I've benched it with various matmul variants and the results are pretty impressive for a tiny form factor. Even with a naive approach it reaches ~5.2TFlops in f32 (so probably more than 10TFlops in bf16), and that's just using the GPU, no NPU for now.