crawl4ai
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.
firecrawl ist ein Open-Source-Projekt aus der Kategorie KI-Agenten von firecrawl (firecrawl/firecrawl auf GitHub). Es hat 189.612 Sterne auf GitHub und 10.047 Forks, wird unter der Lizenz AGPL-3.0 veröffentlicht und wurde zuletzt am 8. Oktober 2026 auf GitHub aktualisiert.
Turn any website into clean, agent-ready data with one API.
Know what you want the agent to accomplish before touching any code.
Clone the repo and read the README's requirements section.
Install what's needed and add API keys or configuration.
Run the quickstart example, then iterate from there.
Turns messy HTML into clean, LLM-friendly markdown.
Handles dynamic, JS-heavy pages — not just static HTML.
Search the web as part of the same pipeline.
Pull typed data out of pages, not just text.
Designed as infrastructure for AI agents.
Run it yourself under AGPL-3.0, or use the hosted cloud.
Download the source and move into the project folder.
git clone https://github.com/firecrawl/firecrawl.git
cd firecrawlPull in the Node packages the project needs.
npm installStart it with the project's documented command (often a dev server).
npm run dev # check README for the exact scriptIt is an open-source project at firecrawl/firecrawl with 10047 forks. Check the contributors tab and recent commits to judge how active maintenance is.
The code is AGPL-3.0: free to use and modify, but if you run a modified version as a network service you must share your source changes.
No — the AGPL-3.0 repo is self-hostable; firecrawl.dev is the managed option if you'd rather not run infrastructure.
Yes — rendering dynamic pages is one of its core features, unlike raw HTTP fetchers.
Clone the repo and follow the README quickstart — the docs at https://firecrawl.dev walk through setup.
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.
Turn messy documents into clean, structured data for language models.
Production-ready agentic RAG behind a clean REST API.
Convert PDFs, DOCX, and HTML into clean, AI-ready documents.
Alibaba's in-page GUI agent: control any web interface with natural language, from one script tag
A portable AI agent runtime for the JVM — write one @Agent, run it on any Java AI stack.
Die anderen Projekte der Kategorie KI-Agenten mit den meisten Sternen im LibreAI-Katalog — die realistische Auswahl, falls firecrawl nicht das Richtige ist.
A personal AI that really does things — on any OS, with your data staying yours.
An agentic skills framework & software development methodology that works.
Agent harness optimization system with skills, memory and security for Claude Code, Codex and more
The agent that grows with you — a Python framework for adaptive AI agents.
DeepSeek's plugin-based agent harness where everything is a plugin.
Verwandte Projekte der Kategorie KI-Agenten im Katalog, die firecrawl bei den Sternen am nächsten stehen — zum Weiterstöbern auf beiden Seiten.
DeepSeek's plugin-based agent harness where everything is a plugin.
The open-source platform for building and running autonomous AI agents, hosted or self-hosted
The agent that grows with you — a Python framework for adaptive AI agents.
f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-host for your organization with complete…
Agent harness optimization system with skills, memory and security for Claude Code, Codex and more
Skills and plugins that teach coding agents to write less, better code.
Kostenlos und offen — hol dir den Quellcode, gib dem Repository einen Stern und leg los.