#3737th of 80 in Open modelsFor image, video and design, video and animation

lingbot-world

Image-to-video world model with camera or action control, built on Wan2.2

Stars
4.6k
License
Apache-2.0
Last commit
Jul 2026
Language
Python

Missed the latest GitHub check; these facts may be older.

Overview

LingBot-World generates interactive video from an input image and text prompt, steered by camera poses or action inputs, with minute-level horizons. Weights are released for Base (Cam), Base (Act) and Fast variants at 480P and 720P, run through torchrun scripts on top of Wan2.2. The README states this repository is no longer maintained and points to lingbot-world-v2.

Who it is for: Researchers and engineers with multi-GPU rigs experimenting with world models

Strengths

  • Three open-weight variants: Base (Cam), Base (Act) and Fast, at 480P and 720P
  • Fast variant uses chunked causal inference with KV caching; README claims under 1 s latency at 16 FPS
  • Camera control accepts poses.npy and intrinsics.npy, which can be estimated from video with ViPE
  • Community 4-bit NF4 quantized checkpoint exists for limited GPU memory, inference only

Weaknesses

  • Repository is marked no longer maintained; development moved to lingbot-world-v2
  • Reference commands assume 8 GPUs with FSDP and Ulysses parallelism
  • Setup defers to Wan2.2 docs and needs flash-attn built from source
  • Quantized variant shows minor loss in visual fidelity and temporal consistency

What it needs

  • GPU required
  • Needs PyTorch >= 2.4.0, flash-attn, Wan2.2 codebase, ViPE (optional, for camera poses)
  • Models: LingBot-World-Base (Cam), LingBot-World-Base (Act), LingBot-World-Fast, NF4 4-bit quantized Base (Cam), community

Also in Open models

See all 80
Also in Open models
RankProjectScore
1ruviewWiFi CSI sensing on ESP32 for presence, breathing, heart rate and pose104.1k stars+6,757 (+6.9%) in 30 daysMIT94 out of 100
2layaSingle-pass multilingual classifier returning typed decisions with calibrated odds Live demo ↗ (opens in a new tab)35.5k stars+3,001 (+9.2%) in 30 daysApache-2.088 out of 100
3rf-detrReal-time transformer models for object detection, segmentation and keypoints Live demo ↗ (opens in a new tab)10.1k stars+280 (+2.9%) in 30 daysApache-2.081 out of 100
#4timesfmPretrained time-series foundation model for zero-shot forecasting from Google Research35.4k stars+1,097 (+3.2%) in 30 daysApache-2.078 out of 100
#5open_clipPyTorch library for training and running CLIP-style image-text models14.3k starscustom license78 out of 100