yue vs sensenova-u1
Two of the top projects in Open models, side by side: who leads on each score part and who each one suits, then setup, license, activity and what each review found.
yue
Lyrics-to-song model that writes an editable melody and chord score first
sensenova-u1
Open 8B multimodal model for image generation, editing and visual Q&A
Verdict
yue ranks higher, 80 to 67. Of the 4 score parts we measure for both, yue leads on 2, sensenova-u1 on 1 and 1 is even.
- Adoptionyue leads by 19 points, 76 to 57: a wide gap.
- FreshnessEven at 100.
- Maintenanceyue leads by 36 points, 91 to 55: a wide gap.
- Agent-readysensenova-u1 leads by 30 points, 30 to 0: a wide gap.
Pick yue if you are
Researchers and musicians running local song generation on a 24 GB NVIDIA GPU
- Editable ABC score between prompt and audio lets you inspect and change melody and chords
- Staged Python API: plan, generate_semantic, synthesize, decode; artifacts saved per run
Pick sensenova-u1 if you are
Engineers running open multimodal models for image generation and editing
- One checkpoint covers text-to-image, editing, interleaved generation and VQA
- Native 4K generation and bounding-box or reference-based visual control in U1.5
| What we compare | yue | sensenova-u1 |
|---|---|---|
| Score parts, out of 100 | ||
| Adoption | 76, popular | 57, popular |
| Freshness | 100, active | 100, active |
| Maintenance | 91, healthy | 55, fair |
| Agent-ready | 0, none | 30, minimal |
| Facts from GitHub and the README | ||
| Stars | 13.6k | 6.9k |
| License | Apache-2.0 (permissive) | Apache-2.0 (permissive) |
| Last commit | Nov 2026 | Nov 2026 |
| Last release | Sep 2026 | None published |
| Language | Python | Python |
| Docker | No | No |
| GPU | Required | Not stated |
| arm64 or Apple Silicon | Mentioned | Not stated |
yue
YuE2 generates full songs with vocals and accompaniment from lyrics and a style prompt. It first plans an editable ABC score (melody and chords), then renders semantic tokens and acoustic latents to 48 kHz stereo audio with an AR–NAR Mixture-of-Transformers and a VAE. The repo also covers zero-shot covers via SheetSage2 transcription, score editing, and an agent skill. Code is Apache-2.0; model weights are CC BY-NC 4.0 with an additional creator permission.
Who it is for: Researchers and musicians running local song generation on a 24 GB NVIDIA GPU
Strengths
- Editable ABC score between prompt and audio lets you inspect and change melody and chords
- Staged Python API: plan, generate_semantic, synthesize, decode; artifacts saved per run
- Zero-shot covers via SheetSage2 transcription with the same checkpoint, no cover fine-tuning
- Reports WildSongBench results against Suno, Mureka and others, with a reproduction guide
Weaknesses
- Needs Linux, Python 3.12 and an NVIDIA BF16 GPU with 24 GB VRAM
- Weights are CC BY-NC 4.0; commercial company use requires a separate license
- Editing renders a new recording; the original waveform is not preserved
- Benchmark numbers are automatic metrics from the authors; gaps between top means are not significant
- GPU required
- Needs Hugging Face model downloads, SheetSage2 (separate environment, for covers), PyTorch
- Models: YuE2-3B, YuE2-Vae, YuE2-Vae-legacy, SheetSage2, MERT-v2
sensenova-u1
SenseNova-U1 and U1.5 are open-weight native multimodal models (8B-MoT, plus an A3B variant) that handle text-to-image, image editing, interleaved image-text generation and visual question answering in one model. The repo ships Python inference scripts for Transformers, optional GGUF checkpoint loading, 8-step LoRA checkpoints, a ComfyUI workflow and full-parameter fine-tuning code. Production serving is documented separately with LightLLM and LightX2V.
Who it is for: Engineers running open multimodal models for image generation and editing
Strengths
- One checkpoint covers text-to-image, editing, interleaved generation and VQA
- Native 4K generation and bounding-box or reference-based visual control in U1.5
- 8-step LoRA and GGUF checkpoints reduce latency and VRAM use
- Training code, technical reports and a ComfyUI workflow are included
Weaknesses
- README admits dense text, hands, small faces and multi-turn edits can still fail
- Official GGUF weights for U1.5 are not out yet; current GGUFs are community-made
- No tagged release; weights are distributed via Hugging Face and ModelScope
- Needs PyTorch, Transformers, LightLLM (production serving), LightX2V (production serving), gguf and diffusers (optional GGUF)
- Models: SenseNova-U1.5-8B-MoT, SenseNova-U1-8B-MoT, SenseNova-U1-A3B-MoT, safetensors LoRA, GGUF Q8
More in Open models
Building with these?
We help teams pick an open-source AI stack and run it in production. Client work never changes a rank.