LibreAI / AI Agents / crawl4ai
// agents · unclecode/crawl4ai

crawl4ai

Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.

★ 84.7k stars⑂ 8.8k forksApache-2.0updated 2026-09
▦ visual — this project's README ships no embeddable screenshot,
so here's a placeholder. The guide below is complete regardless.
// project facts

Project facts

crawl4ai is an open-source ai agents project by unclecode (unclecode/crawl4ai on GitHub). It has 84,698 GitHub stars and 8,763 forks, is released under the Apache-2.0 license, and was last updated on GitHub on 25 September 2026.

GitHub stars
84,698
Forks
8,763
License
Apache-2.0
Last updated on GitHub
25 September 2026
Category
AI Agents
Listing
Full install guide
Official site
Official site
// how it works

How it works

  1. Define the job

    Research, coding, browsing, or ops — agents work best with a clear goal.

  2. Pick a framework

    From no-code builders to code-first SDKs, match complexity to the task.

  3. Give it tools

    Web search, code execution, and APIs are what make agents useful.

  4. Run and supervise

    Watch the trace, approve consequential actions, iterate.

// features

Why people love it

LLM-powered

Large language models drive its smartest features, locally or via API.

Markdown-native

Plain-text Markdown keeps your content portable forever.

Memory

Long-term memory across sessions, not goldfish chat.

Multi-agent teams

Specialized agents collaborate on bigger jobs.

Tool use

Agents call real tools: browsers, terminals, APIs.

Evaluations

Benchmarks keep agent quality measurable.

Advertisement
// run it

Run it yourself

  1. Step 1 — Clone the repo

    Download the source and move into the project folder.

    git clone https://github.com/unclecode/crawl4ai.git
    cd crawl4ai
  2. Step 2 — Check the README

    Every project documents its own setup; start with install requirements.

    cat README.md | head -60
  3. Step 3 — Run it

    Follow the project's launch command — Docker, pip, npm, or a binary release.

    # see README for the exact launch command
// use cases

What you can build

Advertisement
// faq

Questions, answered

Who maintains crawl4ai?

It is an open-source project at unclecode/crawl4ai with 8,763 forks. Check the repo's contributors and recent commits to see how active maintenance is.

Is crawl4ai free for commercial use?

Apache 2.0 licensed — commercial use allowed with attribution.

How do I keep them safe?

Sandboxing, approval gates, and least-privilege credentials.

Do I need to code?

Builders exist, but code-first frameworks go further.

What does it cost to run?

Model API bills dominate; self-hosted stacks cut that sharply.

// keep exploring

Similar tools

AI Agents

agent-squad

Flexible and powerful framework for managing multiple AI agents and handling complex conversations

★ 7.8k starsApache-2.0
View guide →
AI Agents

ruoyi-ai

Enterprise-grade AI agent framework with multi-provider LLM management, secure knowledge bases and high-precision RAG, visual workflow orchestration, and mul…

★ 5.7k starsMIT
View guide →
AI Agents

TradingAgents-astock

A股多Agent投研框架 — 适配A股数据源(龙虎榜/游资/解禁等),7位分析师基于A股规则的辩论决策,基于TradingAgents深度改造,适配大A。A-share multi-agent investment research framework — 7 AI analysts, bull/bear deb…

★ 3.6k starsApache-2.0
View guide →
AI Agents

firecrawl

Turn any website into clean, agent-ready data with one API.

★ 189.6k starsAGPL-3.0
View guide →
AI Agents

docling

Convert PDFs, DOCX, and HTML into clean, AI-ready documents.

★ 68.5k starsMIT
View guide →
AI Agents

page-agent

Alibaba's in-page GUI agent: control any web interface with natural language, from one script tag

★ 29.4k starsMIT
View guide →
// alternatives

Alternatives in AI Agents

The most-starred other AI Agents projects in the LibreAI catalogue — the realistic shortlist if crawl4ai is not the right fit.

Get crawl4ai

Free and open — grab the source, star the repo, and start creating.