#2525th of 41 in Learning and cookbooks

transformers-tutorials

Colab notebooks for running and fine-tuning Hugging Face Transformers models

Stars
11.8k
License
MIT
Last commit
Sep 2026
Language
Jupyter Notebook
Stars, last 29 weeks+309
31 Mar 2026: 11,458 stars7 Apr 2026: 11,471 stars14 Apr 2026: 11,486 stars21 Apr 2026: 11,503 stars28 Apr 2026: 11,526 stars5 May 2026: 11,533 stars12 May 2026: 11,549 stars19 May 2026: 11,555 stars26 May 2026: 11,563 stars2 Jun 2026: 11,576 stars9 Jun 2026: 11,579 stars16 Jun 2026: 11,590 stars23 Jun 2026: 11,600 stars30 Jun 2026: 11,612 stars7 Jul 2026: 11,625 stars14 Jul 2026: 11,632 stars21 Jul 2026: 11,638 stars28 Jul 2026: 11,646 stars4 Aug 2026: 11,701 stars11 Aug 2026: 11,709 stars18 Aug 2026: 11,719 stars25 Aug 2026: 11,723 stars1 Sept 2026: 11,724 stars8 Sept 2026: 11,727 stars15 Sept 2026: 11,734 stars22 Sept 2026: 11,738 stars29 Sept 2026: 11,741 stars6 Oct 2026: 11,745 stars13 Oct 2026: 11,753 stars20 Oct 2026: 11,767 stars

11,458 on 31 Mar 202611,767 on 20 Oct 2026

From GitHub's daily star counts.

Checked on GitHub.

Overview

A collection of Jupyter notebooks by Niels Rogge showing inference and fine-tuning with Hugging Face Transformers in PyTorch. Coverage is mostly vision and document models (DETR, LayoutLM v1-v3, Donut, MaskFormer, Perceiver), plus some BERT, audio and GPT-J notebooks. Each demo links to a Colab notebook and the source paper.

Who it is for: Engineers learning Transformers fine-tuning for vision and document tasks

Strengths

  • Every demo has an Open in Colab badge, so no local setup is needed
  • Covers document AI in depth: LayoutLM v1-v3, LayoutXLM, Donut, DiT, MarkupLM
  • Includes both inference and fine-tuning notebooks, some using HF Trainer or PyTorch Lightning
  • MIT licensed, with a recent commit on 2026-09-17

Weaknesses

  • PyTorch only; no TensorFlow or JAX notebooks
  • Many notebooks use older APIs (e.g. DetrFeatureExtractor) and may need version pinning
  • Mostly older architectures; no modern LLM fine-tuning notebooks in the visible README
  • No releases and no packaged library; notebooks only

What it needs

  • GPU optional
  • Needs Hugging Face Transformers, PyTorch, Google Colab
  • Models: DETR, LayoutLM, LayoutLMv2, LayoutLMv3, Donut

Also in Learning and cookbooks

See all 41
Also in Learning and cookbooks
RankProjectScore
1ai-engineering-from-scratchHands-on AI engineering curriculum with 542 lessons across 20 phases71.9k starsMIT89 out of 100
2generative-ai-for-beginners21-lesson course on building generative AI apps in Python and TypeScript121.8k starsMIT81 out of 100
3ai-agents-for-beginners18-lesson course on building AI agents with Microsoft Agent Framework77.6k starsMIT78 out of 100
#4llms-from-scratchCode for the book on building a GPT-style LLM in PyTorch107k starscustom license77 out of 100
#5ml-for-beginners12-week, 26-lesson classic machine learning course using Scikit-learn Live demo ↗ (opens in a new tab)91.6k starsMIT76 out of 100