Discover great AI tools
📢 NoticeWebsite launched:DeepToSeek AI tools directory is live. Submit great tools and get featured!
Home / Open Source Radar / RAG & Knowledge / firecrawl

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

Stars202.5k
Forks10.6k
LanguageTypeScript
LicenseAGPL-3.0

About this project

firecrawl is an open-source retrieval and knowledge project on GitHub: Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥. It lives in retrieval and knowledge management, the layer that lets a model answer from your own documents instead of from training data alone.

On GitHub the repository is tagged ai, ai-agents, ai-crawler, ai-scraping, ai-search, crawler, data-extraction, html-to-markdown, llm, markdown, scraper and scraping, which is a fair summary of what it covers. There is normally an ingestion pipeline, an embedding and vector index, and a query layer on top. Most of the engineering effort goes into chunking, ranking and keeping the index fresh as documents change.

It is written mainly in TypeScript and released under AGPL-3.0, a copyleft license — if you distribute it or run it as a public service, your derivative code has to be released. It is actively maintained: the most recent commit landed on November 17, 2026.

To try it, clone the repository and follow its README; that file is the canonical install guide. Because it runs on your own infrastructure, budget time for environment setup: dependencies, model weights and configuration usually take longer than the first successful run.

Key facts as recorded on GitHub: 202,522 stars; 10,604 forks; primary language TypeScript; license AGPL-3.0; last commit on November 17, 2026; topics ai, ai-agents, ai-crawler, ai-scraping, ai-search, crawler.