#3232nd of 68 in Training and fine-tuning
lightly
PyTorch library for self-supervised vision pretraining and latent world models
- Stars
- 3.8k
- License
- MIT
- Last commit
- Nov 2026
- Last release
- Nov 2026
- Language
- Python
3,710 on 25 Apr 20263,831 on 14 Nov 2026
From GitHub's daily star counts.
Checked on GitHub.
Overview
LightlySSL is a Python framework of modular building blocks (loss functions, model heads, transforms) for self-supervised pretraining of computer vision models. It ships PyTorch and PyTorch Lightning examples for about 25 methods, including SimCLR, MoCo, BYOL, DINO, DINOv2, MAE and LeJEPA, plus LeWM for training world models and planning with them. Custom backbones are supported, and distributed training goes through PyTorch Lightning.
Who it is for: ML engineers pretraining vision backbones with self-supervised methods
Strengths
- Covers MoCo (2019) through LeJEPA and Pixio (2025), each with docs and Colab notebooks
- Modular losses and heads that can be mixed with custom backbones
- PyTorch and PyTorch Lightning examples, including distributed, for every listed model
- Adds LeWM for training a world model from frames and actions, with a tutorial
Weaknesses
- Computer vision only; no text or speech pretraining
- Docker support and one-command pretraining are in the commercial edition
- Library only: no UI, serving layer or pretrained model hub
- LeWM requires PyTorch 2.0+ and the timm extra
What it needs
- Needs PyTorch 2.0+, timm, PyTorch Lightning
- Models: MoCo, SimCLR, BYOL, SwAV, DINO
What changed
- v1.6.0 ↗ (opens in a new tab)Breaking
“The API client is removed. If you still need ApiWorkflowClient, pin lightly<1.6 (#1939). These modules and commands are gone:”
From the release notes. No flag means the note does not say so, not that the upgrade is safe.
Also in Training and fine-tuning
See all 68| Rank | Project | Score |
|---|---|---|
| 1 | peftPython library for LoRA and other parameter-efficient fine-tuning of Transformers models | 89 out of 100 |
| 2 | unslothDesktop and web app to run and fine-tune local models | 88 out of 100 |
| 3 | trlPost-training library with SFT, DPO, GRPO and KTO trainers | 88 out of 100 |
| #4 | deepspeedPyTorch library for distributed training of very large models with ZeRO | 87 out of 100 |
| #5 | megatron-lmDistributed training library for large transformer models on NVIDIA GPUs | 86 out of 100 |