| --- |
| license: other |
| license_name: stability-ai-community-license |
| license_link: https://stability.ai/license |
| library_name: stable-audio-3 |
| tags: |
| - audio |
| - audio-generation |
| - text-to-audio |
| - audio-to-audio |
| - inpainting |
| - stable-audio-3 |
| - stability-ai |
| - safetensors |
| pipeline_tag: text-to-audio |
| --- |
| |
| # Stable Audio 3 — bundled mirror |
|
|
| Self-contained inference bundle for the [MAESTRO](https://github.com/AEmotionStudio/MAESTRO) desktop app. |
| One-to-one mirror of Stability AI's [Stable Audio 3 collection](https://huggingface.co/collections/stabilityai/stable-audio-3) and the [extras collection](https://huggingface.co/collections/stabilityai/stable-audio-3-extra) (base checkpoints + standalone autoencoders), bundled into a single browseable HF repo so the MAESTRO panel can pick the variant a user wants without juggling eight separate downloads. |
|
|
| ## License — Stability AI Community License |
|
|
| All weights in this repository are released by Stability AI under the **[Stability AI Community License](https://stability.ai/license)**: |
|
|
| > Free for organizations with **under $1M annual revenue**. Commercial use of the models and outputs is permitted within that threshold; redistribution, fine-tuning, and derivative works are explicitly allowed. **Outputs are yours.** Above the revenue threshold, contact Stability AI for an Enterprise License. |
|
|
| The upstream [`stable-audio-3` source code](https://github.com/Stability-AI/stable-audio-3) is released separately under **MIT**. |
|
|
| ### Gated subdirs |
|
|
| Three subdirs mirror upstream repos that are **gated** on huggingface.co — you must accept Stability AI's terms (and the Gemma terms-of-use, since the text encoder is T5-Gemma) before this mirror's gating allows access: |
|
|
| - `small-music/` (mirror of [`stabilityai/stable-audio-3-small-music`](https://huggingface.co/stabilityai/stable-audio-3-small-music)) |
| - `small-sfx/` (mirror of [`stabilityai/stable-audio-3-small-sfx`](https://huggingface.co/stabilityai/stable-audio-3-small-sfx)) |
| - `medium/` (mirror of [`stabilityai/stable-audio-3-medium`](https://huggingface.co/stabilityai/stable-audio-3-medium)) |
|
|
| The base checkpoints and SAME autoencoders are open. |
|
|
| ## Contents |
|
|
| | Subdir | Role | Params | Max duration | Upstream | |
| |---|---|---|---|---| |
| | `small-music/` | Post-trained text → audio (music) | 433 M | 120 s | `stabilityai/stable-audio-3-small-music` *(gated)* | |
| | `small-sfx/` | Post-trained text → audio (SFX) | 433 M | 120 s | `stabilityai/stable-audio-3-small-sfx` *(gated)* | |
| | `medium/` | Post-trained text → audio (music + SFX) | 1.4 B | 380 s | `stabilityai/stable-audio-3-medium` *(gated)* | |
| | `small-music-base/` | Base ckpt for LoRA fine-tuning | 433 M | 120 s | `stabilityai/stable-audio-3-small-music-base` | |
| | `small-sfx-base/` | Base ckpt for LoRA fine-tuning | 433 M | 120 s | `stabilityai/stable-audio-3-small-sfx-base` | |
| | `medium-base/` | Base ckpt for LoRA fine-tuning | 1.4 B | 380 s | `stabilityai/stable-audio-3-medium-base` | |
| | `same-s/` | SAME-Small standalone autoencoder | ~50 M | — | `stabilityai/SAME-S` | |
| | `same-l/` | SAME-Large standalone autoencoder | ~200 M | — | `stabilityai/SAME-L` | |
|
|
| Every subdir contains `model.safetensors` + `model_config.json` (plus the post-trained / base variants include the bundled T5-Gemma text encoder + SAME pretransform; SAME repos are AE-only). |
|
|
| ## Capabilities |
|
|
| All six generative variants share a single inference surface in MAESTRO with four modes: |
|
|
| - **Text → Audio** — prompt-only generation, stereo 44.1 kHz |
| - **Audio → Audio** — style transfer / restyling with an adjustable `init_noise_level` |
| - **Inpaint** — multi-region regeneration of a source clip; non-region time is preserved verbatim |
| - **Continue** — extend an existing clip past its end |
|
|
| Generation knobs exposed: prompt, negative prompt, duration, steps, CFG scale, APG scale, seed, batch size, sampler type (`dpmpp-3m-sde` / `dpmpp-2m` / `euler` / `heun`), distribution shift (`logSNR` / `flux` / `identity`), precision (fp16 / fp32), chunked decode, and a user-loadable stackable LoRA stack. |
|
|
| > **Medium variants** require **[Flash Attention 2](https://github.com/Dao-AILab/flash-attention)** for the SAME-Large decoder path. Without `flash-attn` installed, Medium generation degrades to static-glitch output. Small variants do not require it. |
|
|
| ## Format |
|
|
| - **All weights are `safetensors`.** No `.pt` / `.ckpt` / `.bin` in this mirror. |
| - Mirror is **bf16** — re-saved via `safetensors.torch.save_model` (preserves shared RotaryEmbedding buffers that bare `save_file` would corrupt). Bytewise this halves disk size vs the fp32 upstream. The MAESTRO runner upcasts to fp32 transiently during `load_state_dict` then casts to fp16 (`model_half=True`) for inference — runtime VRAM is unchanged from the fp32 mirror, but disk + I/O + initial safetensors-read CPU spike are all halved. |
| - Approximate disk sizes per subdir: small variants ~1.14 GB each, medium variants ~4.61 GB each, SAME-S ~0.22 GB, SAME-L ~1.70 GB. Total mirror footprint ≈ 15.7 GB. |
|
|
| ## Usage |
|
|
| ### Inside MAESTRO |
|
|
| The MAESTRO desktop app's `AI > Create > Stable Audio 3` panel handles the download + variant selection. The bundled runner at `backend/ai/models/stable_audio_3.py` reads the per-variant subdir name from the manifest and feeds it into the vendored `stable_audio_3` package at `backend/ai/stable_audio_3_vendor/`. |
|
|
| ### Standalone |
|
|
| The repo can also be consumed directly by Stability AI's upstream [`stable-audio-3` package](https://github.com/Stability-AI/stable-audio-3): |
|
|
| ```python |
| from stable_audio_3.loading_utils import load_diffusion_cond |
| from stable_audio_3.model import StableAudioModel |
| import json |
| from huggingface_hub import snapshot_download |
| |
| # Pull one variant (e.g. small-sfx) |
| local = snapshot_download( |
| repo_id="AEmotionStudio/stable-audio-3-mirrors", |
| allow_patterns=["small-sfx/**"], |
| ) |
| |
| with open(f"{local}/small-sfx/model_config.json") as f: |
| cfg = json.load(f) |
| |
| inner = load_diffusion_cond(cfg, f"{local}/small-sfx/model.safetensors", |
| device="cuda", model_half=True) |
| inner.use_lora = False |
| inner.lora_names = [] |
| model = StableAudioModel(inner, cfg, "cuda", model_half=True) |
| |
| audio = model.generate( |
| prompt="heavy rain on a tin roof with distant thunder", |
| duration=10, |
| steps=8, |
| cfg_scale=1.0, |
| ) |
| ``` |
|
|
| ## Attribution |
|
|
| - **Models:** Stability AI — *Stable Audio 3* ([blog](https://stability.ai/news/stable-audio-3-open), upstream code: [`Stability-AI/stable-audio-3`](https://github.com/Stability-AI/stable-audio-3)). |
| - **Text encoder:** Google T5-Gemma (bundled in each generative subdir). |
| - **Autoencoder:** Stability AI SAME — *Semantic-Acoustic Music Encoder*. |
|
|
| This mirror exists to bundle the family + extras into a single browseable HF repo for the MAESTRO desktop app. It does not modify the weights; report quality or licensing issues to the upstream repos. |
|
|
