yue vs sensenova-u1

Two of the top projects in Open models, side by side: who leads on each score part and who each one suits, then setup, license, activity and what each review found.

#66th of 119 in Open models

yue

Lyrics-to-song model that writes an editable melody and chord score first

#1717th of 119 in Open models

sensenova-u1

Open 8B multimodal model for image generation, editing and visual Q&A

Verdict

yue ranks higher, 80 to 67. Of the 4 score parts we measure for both, yue leads on 2, sensenova-u1 on 1 and 1 is even.

  • Adoptionyue leads by 19 points, 76 to 57: a wide gap.
  • FreshnessEven at 100.
  • Maintenanceyue leads by 36 points, 91 to 55: a wide gap.
  • Agent-readysensenova-u1 leads by 30 points, 30 to 0: a wide gap.

Pick yue if you are

Researchers and musicians running local song generation on a 24 GB NVIDIA GPU

  • Editable ABC score between prompt and audio lets you inspect and change melody and chords
  • Staged Python API: plan, generate_semantic, synthesize, decode; artifacts saved per run

Pick sensenova-u1 if you are

Engineers running open multimodal models for image generation and editing

  • One checkpoint covers text-to-image, editing, interleaved generation and VQA
  • Native 4K generation and bounding-box or reference-based visual control in U1.5
yue vs sensenova-u1: score parts and facts
What we compareyuesensenova-u1
Score parts, out of 100
Adoption76, popular57, popular
Freshness100, active100, active
Maintenance91, healthy55, fair
Agent-ready0, none30, minimal
Facts from GitHub and the README
Stars13.6k6.9k
LicenseApache-2.0 (permissive)Apache-2.0 (permissive)
Last commitNov 2026Nov 2026
Last releaseSep 2026None published
LanguagePythonPython
DockerNoNo
GPURequiredNot stated
arm64 or Apple SiliconMentionedNot stated

yue

YuE2 generates full songs with vocals and accompaniment from lyrics and a style prompt. It first plans an editable ABC score (melody and chords), then renders semantic tokens and acoustic latents to 48 kHz stereo audio with an AR–NAR Mixture-of-Transformers and a VAE. The repo also covers zero-shot covers via SheetSage2 transcription, score editing, and an agent skill. Code is Apache-2.0; model weights are CC BY-NC 4.0 with an additional creator permission.

Who it is for: Researchers and musicians running local song generation on a 24 GB NVIDIA GPU

Strengths

  • Editable ABC score between prompt and audio lets you inspect and change melody and chords
  • Staged Python API: plan, generate_semantic, synthesize, decode; artifacts saved per run
  • Zero-shot covers via SheetSage2 transcription with the same checkpoint, no cover fine-tuning
  • Reports WildSongBench results against Suno, Mureka and others, with a reproduction guide

Weaknesses

  • Needs Linux, Python 3.12 and an NVIDIA BF16 GPU with 24 GB VRAM
  • Weights are CC BY-NC 4.0; commercial company use requires a separate license
  • Editing renders a new recording; the original waveform is not preserved
  • Benchmark numbers are automatic metrics from the authors; gaps between top means are not significant
  • GPU required
  • Needs Hugging Face model downloads, SheetSage2 (separate environment, for covers), PyTorch
  • Models: YuE2-3B, YuE2-Vae, YuE2-Vae-legacy, SheetSage2, MERT-v2

sensenova-u1

SenseNova-U1 and U1.5 are open-weight native multimodal models (8B-MoT, plus an A3B variant) that handle text-to-image, image editing, interleaved image-text generation and visual question answering in one model. The repo ships Python inference scripts for Transformers, optional GGUF checkpoint loading, 8-step LoRA checkpoints, a ComfyUI workflow and full-parameter fine-tuning code. Production serving is documented separately with LightLLM and LightX2V.

Who it is for: Engineers running open multimodal models for image generation and editing

Strengths

  • One checkpoint covers text-to-image, editing, interleaved generation and VQA
  • Native 4K generation and bounding-box or reference-based visual control in U1.5
  • 8-step LoRA and GGUF checkpoints reduce latency and VRAM use
  • Training code, technical reports and a ComfyUI workflow are included

Weaknesses

  • README admits dense text, hands, small faces and multi-turn edits can still fail
  • Official GGUF weights for U1.5 are not out yet; current GGUFs are community-made
  • No tagged release; weights are distributed via Hugging Face and ModelScope
  • Needs PyTorch, Transformers, LightLLM (production serving), LightX2V (production serving), gguf and diffusers (optional GGUF)
  • Models: SenseNova-U1.5-8B-MoT, SenseNova-U1-8B-MoT, SenseNova-U1-A3B-MoT, safetensors LoRA, GGUF Q8

More in Open models

Building with these?

We help teams pick an open-source AI stack and run it in production. Client work never changes a rank.