AnakinScraper OSS is a Go server exposing sync, async and batch REST endpoints that fetch a URL and return HTML, cleaned HTML and markdown. Each job runs a handler chain: plain HTTP fetch, then a Camoufox anti-detect Firefox service, then an optional external API such as anakin.io. Per-domain configs, failure-pattern detection, Thompson Sampling proxy selection and optional Gemini JSON extraction are included, plus a React dashboard.
Who it is for: Developers self-hosting a scraping API to feed RAG pipelines and agents
Strengths
Runs as a single Go binary with in-memory jobs; PostgreSQL is optional
Handler chain falls back from HTTP to Camoufox browser to external API automatically
Per-domain configs with failure and required patterns trigger retries on the next handler
Includes React dashboard, CLI support and an OpenClaw skill wrapper
Weaknesses
AGPL-3.0 license requires open-sourcing modifications offered as a hosted service
JavaScript-heavy sites need the separate Python Camoufox browser service
Structured JSON extraction depends on a Google Gemini API key
Anonymous telemetry is on by default and must be disabled with TELEMETRY=off
What it needs
no GPU
Compose
Needs PostgreSQL (optional), Camoufox browser service (optional), Gemini API (optional), anakin.io API (optional), Go 1.25+