LibreAI / Local LLM / webclaw
// local-llm ยท 0xMassi/webclaw

webclaw

Fast Rust scraper that turns web pages into clean data for LLMs.

๐Ÿ’Ž Hidden gemโ˜… 2.4k starsโ‘‚ 235 forksAGPL-3.0updated 2026-09
โ–ฆ visual โ€” this project's README ships no embeddable screenshot,
so here's a placeholder. The guide below is complete regardless.
// project facts

Project facts

webclaw is an open-source local llm project by 0xMassi (0xMassi/webclaw on GitHub). It has 2,366 GitHub stars and 235 forks, is released under the AGPL-3.0 license, and was last updated on GitHub on 23 September 2026.

Repository
0xMassi/webclaw
GitHub stars
2,366
Forks
235
License
AGPL-3.0
Last updated on GitHub
23 September 2026
Category
Local LLM
Listing
Hidden gem โ€” a shorter page for a lesser-known project
Official site
Official site
// how it works

How it works

  1. Install webclaw

    Get the Rust-built binary or build from source.

  2. Point at a page

    Give it a URL to scrape or crawl.

  3. Extract

    Get clean markdown or structured data back.

  4. Feed your LLM

    Pipe results to agents via CLI, API, or MCP.

// features

Why people love it

Rust speed

Fast extraction with low resource use.

Local-first

Runs on your machine, no cloud required.

HTML to markdown

Clean page conversion for LLMs.

Crawling

Follow links across whole sites.

REST API

Integrate extraction into any stack.

MCP server

Give AI agents direct scraping tools.

Advertisement
// run it

Run it yourself

  1. Step 1 โ€” Clone the repo

    Download the source and move into the project folder.

    git clone https://github.com/0xMassi/webclaw.git
    cd webclaw
  2. Step 2 โ€” Check the README

    Every project documents its own setup; start with install requirements.

    cat README.md | head -60
  3. Step 3 โ€” Run it

    Follow the project's launch command โ€” Docker, pip, npm, or a binary release.

    # see README for the exact launch command
// use cases

What you can build

Advertisement
// faq

Questions, answered

How is it different from Firecrawl?

It is local-first and open source, so no per-page API fees.

What does AGPL-3.0 mean for me?

Commercial use is allowed, but network use of modified versions requires sharing source.

Can it handle JavaScript sites?

Check the docs for rendering capabilities.

Is there really an MCP server?

Yes, agents can call it through the Model Context Protocol.

Do I need Rust installed?

Only if building from source; binaries avoid that.

// keep exploring

Similar tools

Local LLM

vLLM

A high-throughput and memory-efficient inference and serving engine for LLMs

โ˜… 93.1k starsApache-2.0
View guide โ†’
Local LLM

Web LLM

High-performance In-browser LLM Inference Engine

โ˜… 19.2k starsApache-2.0
View guide โ†’
Local LLM

Cactus

Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots

โ˜… 6.1k starsCustom (check repo)
View guide โ†’
Local LLM

WebMCP

Early proposal and implementation for connecting LLMs to web pages.

โ˜… 883 starsMIT
View guide โ†’
Local LLM

BrowserAI

Run local LLMs like Llama and DeepSeek right inside your web browser.

โ˜… 1.5k starsMIT
View guide โ†’
Local LLM

MNN

Alibaba's lightweight, blazing-fast inference engine for on-device LLMs and edge AI.

โ˜… 16.2k starsApache-2.0
View guide โ†’
// alternatives

Alternatives in Local LLM

The most-starred other Local LLM projects in the LibreAI catalogue โ€” the realistic shortlist if webclaw is not the right fit.

Get webclaw

Free and open โ€” grab the source, star the repo, and start creating.