icon

Crawl4AI

šŸš€šŸ¤– Crawl4AI is an open-source, LLM-friendly web crawler and scraper supporting multiple LLM API keys. Perfect for AI pipelines, RAG, and knowledge base construction.

PlatformZeabur
Deployed2
Publisherleechenghsiu
Deployed2 times
Publisherleechenghsiu
Created2025-06-13
Services
service icon
Tags
CrawlerAIWeb

Crawl4AI

šŸš€šŸ¤– Crawl4AI is an open-source, LLM-friendly web crawler and scraper supporting multiple LLM API keys. Perfect for AI pipelines, RAG, and knowledge base construction.

  • GitHub: https://github.com/unclecode/crawl4ai
  • Documentation: https://docs.crawl4ai.com/
  • Zeabur Environment Variable Guide: https://zeabur.com/docs/configuration/env

Features

  • Supports multiple LLM APIs (OpenAI, Anthropic, Deepseek, Groq, Together, Mistral, Gemini)
  • One-click Docker deployment
  • Interactive playground
  • High performance and scalability

Quick Start

  1. Fill in the required LLM API keys (optional)
  2. After deployment, visit /playground for the interactive crawler UI

Reference

License

Apache-2.0