Integrate VibeASR.cpp into audio.cpp

[0xShug0]

Hi! I’m the maintainer of audio.cpp, a unified C++/GGML runtime supporting 50+ audio models across ASR, TTS, music generation, voice conversion, and more.

I wondering if you’d be interested in bringing it into audio.cpp. I think it would be a great fit, and having the original author involved is especially valuable since you understand the implementation and model behavior best.

Would be great to have VibeASR.cpp as part of audio.cpp!

[XsquirrelC]

Hi, thanks for the interest! Could you share more about how the integration would work — submodule, code port, or something else?

[0xShug0]

Hi, thanks for the interest! Could you share more about how the integration would work — submodule, code port, or something else?

I think the right integration path is to port it as an audio.cpp model or community model. One blocker is that VibeASR.cpp depends on custom ggml changes, and one of those changes modifies existing ggml_conv_1d behavior which affects almost all models in audio.cpp. It would be less risky if the ggml changes could be made purely additive, for example by adding new ops/types instead of modifying the behavior of existing vendored ggml paths. That’s why I reached out to your team first: you’ll have a better view of how to separate the model-specific speed path from broader ggml behavior changes. I’d appreciate two separate PRs if you’re interested: one focused on the additive ggml changes, and another for the model integration.