#6060th of 68 in Training and fine-tuning

ml-hypersim

Synthetic indoor-scene dataset with per-pixel labels, plus a V-Ray rendering toolkit

Stars
2.1k
License
custom license
Last commit
Sep 2026
Language
Python
Stars, last 29 weeks+82
25 Apr 2026: 1,993 stars2 May 2026: 1,993 stars9 May 2026: 1,994 stars16 May 2026: 1,996 stars23 May 2026: 1,997 stars30 May 2026: 1,997 stars6 Jun 2026: 2,000 stars13 Jun 2026: 2,005 stars20 Jun 2026: 2,009 stars27 Jun 2026: 2,011 stars4 Jul 2026: 2,016 stars11 Jul 2026: 2,022 stars18 Jul 2026: 2,024 stars25 Jul 2026: 2,026 stars1 Aug 2026: 2,030 stars8 Aug 2026: 2,031 stars15 Aug 2026: 2,034 stars22 Aug 2026: 2,039 stars29 Aug 2026: 2,042 stars5 Sept 2026: 2,046 stars12 Sept 2026: 2,046 stars19 Sept 2026: 2,050 stars26 Sept 2026: 2,059 stars3 Oct 2026: 2,060 stars10 Oct 2026: 2,061 stars17 Oct 2026: 2,063 stars24 Oct 2026: 2,066 stars31 Oct 2026: 2,071 stars7 Nov 2026: 2,072 stars14 Nov 2026: 2,075 stars

1,993 on 25 Apr 20262,075 on 14 Nov 2026

From GitHub's daily star counts.

Checked on GitHub.

Overview

Hypersim is a photorealistic synthetic dataset of 77,400 images across 461 indoor scenes (74,619 in the public release), with depth, normals, semantic instance labels, 3D bounding boxes and camera poses. Images are split into diffuse reflectance, diffuse illumination and a non-diffuse residual. The repo also includes the Hypersim Toolkit, Python tools for generating similar datasets from V-Ray scenes.

Who it is for: Researchers training scene-understanding models on synthetic indoor data

Strengths

  • Per-pixel depth, normals, NYU40 semantics, instances and 9-DOF boxes for every image
  • Lossless HDR HDF5 images with color = reflectance * illumination + residual
  • Standard scene-level train/val/test split (v1) included as CSV
  • Toolkit can generate new labeled datasets from V-Ray scenes

Weaknesses

  • Full dataset is roughly 1.9TB across a few hundred ZIP files
  • Ground truth meshes require purchasing scene assets from TurboSquid
  • Toolkit depends on V-Ray, which is under Chaos Group's own terms
  • Some asset reuse across scenes leaks objects between train and test splits

What it needs

  • Needs V-Ray Standalone, V-Ray AppSDK, curl, unzip, Python

Also in Training and fine-tuning

See all 68
Also in Training and fine-tuning
RankProjectScore
1peftPython library for LoRA and other parameter-efficient fine-tuning of Transformers models Live demo ↗ (opens in a new tab)21.9k starsApache-2.089 out of 100
2unslothDesktop and web app to run and fine-tune local models Live demo ↗ (opens in a new tab)79.7k starsApache-2.088 out of 100
3trlPost-training library with SFT, DPO, GRPO and KTO trainers19.8k starsApache-2.088 out of 100
#4deepspeedPyTorch library for distributed training of very large models with ZeRO43.3k starsApache-2.087 out of 100
#5megatron-lmDistributed training library for large transformer models on NVIDIA GPUs18.4k starscustom license86 out of 100