---
title: "Crawl4AI LLM-Friendly Web Crawler"
description: "Run web crawling and scraping workflows with Crawl4AI, an open-source crawler built to produce LLM-ready markdown and structured extraction output. It supports async crawling, browser automation hooks, deep crawls, CLI usage, and Python-based data pipelines."
verification: "security_reviewed"
source: "https://github.com/unclecode/crawl4ai"
category:
  - "Research & Scraping"
framework:
  - "Multi-Framework"
tool_ecosystem:
  github_repo: "unclecode/crawl4ai"
  github_stars: 63963
---

# Crawl4AI LLM-Friendly Web Crawler

Run web crawling and scraping workflows with Crawl4AI, an open-source crawler built to produce LLM-ready markdown and structured extraction output. It supports async crawling, browser automation hooks, deep crawls, CLI usage, and Python-based data pipelines.

## Installation

Choose whichever fits your setup:

1. Copy this skill folder into your local skills directory.
2. Clone the repo and symlink or copy the skill into your agent workspace.
3. Add the repo as a git submodule if you manage shared skills centrally.
4. Install it through your internal provisioning or packaging workflow.
5. Download the folder directly from GitHub and place it in your skills collection.

## Source

- [Agent Skill Exchange](https://agentskillexchange.com/skills/crawl4ai-llm-friendly-web-crawler/)