Palash DebnathandClaude Fable 5
030d5ea01f
* docs(engines): a guide for every engine + index; fix two engine-metadata bugs 21 new pages under docs/engines/ (10 TTS, 10 ASR, index README) — every registered engine now has one: what it's for, platform support, model env vars, quirks with issue refs. Linked from both READMEs' engine sections. Code fixes found while verifying facts against the registries: - KittenTTS docstring claimed default voice 'Jasper'; the code default is expr-voice-2-f - the isolated-ASR sidecar read only ASR_MODEL_FW while the download preflight read ASR_MODEL_FASTER — set one and the other quietly used a different model; both now resolve ASR_MODEL_FW-override → ASR_MODEL_FASTER - moonshine's install hint named 'useful-moonshine', a package the backend never imports; now moonshine-onnx / moonshine-voice Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> * docs(changelog): entries for the engine guides + sidecar model fix (#1556) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> * docs(engines): second-harvest fixes — TLS guidance, matrix/code alignment, CN counts - README matrix aligned to gpu_compat (the code is the source of truth): CosyVoice macOS is CPU not MPS, IndexTTS and GGUF gain their real CUDA/CPU/MPS cells - gpt-sovits guide: prefer https/tunnel for non-loopback servers, plaintext warning; first-use download guidance on both OmniVoice pages - preflight empty-env fallback matches the sidecar (ASR_MODEL_FASTER='' no longer resolves a different repo) - nano installs via uv pip; kitten log level wording; index links install guides incl. the Gatekeeper step; README_CN engine counts 16/11 Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> * docs(readme-cn): the all-engines-local claim now excludes the remote client Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> --------- Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
3.1 KiB
VoiceStudio — MLX-Audio Engine (Apple Silicon)
MLX-Audio (Blaizzy/mlx-audio) wraps 14+ TTS engines — Kokoro, CSM, Dia, Qwen3-TTS, Chatterbox, MeloTTS, OuteTTS, and more — behind a single adapter that runs on Apple's MLX framework. It is Apple Silicon only: the engine is not shipped on Linux, Windows, or Intel Macs, and a stray wheel on those platforms never reports as available (#390).
When to pick it
- You're on an M-series Mac and want small, fast models tuned for it.
- You want one of the specific hosted models (Kokoro for small multilingual, CSM for cloning, Qwen3-TTS for voice design, Dia for dialogue, …).
Setup
pip install mlx-audio
Then select the engine via Model Catalogue → Engines or
OMNIVOICE_TTS_BACKEND=mlx-audio.
Model selection
One backend hosts many models. The curated set:
| Key | Model | Niche |
|---|---|---|
kokoro (default) |
mlx-community/Kokoro-82M-bf16 |
small multilingual |
csm |
mlx-community/csm-1b-8bit |
voice cloning |
qwen3-tts |
mlx-community/Qwen3-TTS-12Hz-1.7B-VoiceDesign-4bit |
voice design |
dia |
mlx-community/Dia-1.6B |
dialogue |
chatterbox |
mlx-community/Chatterbox-TTS-4bit |
expressive |
melotts |
mlx-community/MeloTTS-English-v3-MLX |
lightweight VITS |
outetts |
mlx-community/Llama-OuteTTS-1.0-1B-4bit |
LM-based |
Pick a model in the Model Catalogue → Engines curated picker
(#981) or set
OMNIVOICE_MLX_AUDIO_MODEL to either a curated key (kokoro) or any full
HF repo id. The env var overrides the persisted UI choice.
Behaviour notes
- Output is 24 kHz mono for most hosted models.
- Cloning works only with the
csmmodel — it is the only curated model confirmed to accept a reference clip. Other models silently ignore reference audio, so the engine reports cloning support only when CSM is selected (dub/batch jobs gate on this). - Voice design (text description → voice) is available through the Qwen3-TTS VoiceDesign model.
- Language support is per-model (Kokoro ~8 languages, others vary). An unsupported language for Kokoro produces a clear error naming what it does support (#977) — leave language on Auto or switch to a multilingual engine.
Platform notes
This engine is exempt from cross-platform parity as a platform-only capability behind explicit opt-in: it exists only where Apple's MLX runtime exists. On any other platform the engine picker shows it unavailable with the reason.
Troubleshooting
- Unavailable on an M-series Mac:
pip install mlx-audiointo VoiceStudio's Python environment; in a packaged app build, MLX's native libraries may fail to load — the engine reports unavailable rather than crashing. - Other issues: install/troubleshooting.md.
See also: benchmarks.md, languages.md, downloading-models.md, disk usage.