ClaudeWave
hmshb
hmshb

scraping-agent-ai

View on GitHub

AI-powered web scraping agent built with LangGraph, LangSmith, Firecrawl, and Anthropic AI. Automates intelligent crawling, structured data extraction, and LLM-powered content formatting. Efficiently handles anti-bot mechanisms, error recovery, and batch processing. ๐Ÿš€

Subagents17 stars5 forksโ— PythonMITUpdated 1y ago
ClaudeWave Trust Score
62/100
ยท OK
Passed
  • โœ“Open-source license (MIT)
  • โœ“Clear description
  • โœ“Topics declared
  • โœ“Mature repo (>1y old)
Flags
  • !Stale (last commit >426d ago)
Last scanned: 4/14/2026
Install in Claude Desktop
Method detected: Manual
{
  "mcpServers": {
    "scraping-agent-ai": {
      "command": "node",
      "args": ["/path/to/scraping-agent-ai/dist/index.js"]
    }
  }
}
1. Copy the snippet above.
2. Paste into ~/Library/Application Support/Claude/claude_desktop_config.json (Mac) or %APPDATA%\Claude\claude_desktop_config.json (Windows).
3. Replace any <placeholder> values with your API keys or paths.
4. Restart Claude Desktop. The MCP server appears automatically.
๐Ÿ’ก Clone https://github.com/hmshb/scraping-agent-ai and follow its README for install instructions.
Use cases
๐Ÿค– Automation๐Ÿง  AI / ML๐Ÿ“จ Communication

Subagents overview

README preview not available. Visit the repo on GitHub for full documentation.
agentic-aiaiai-agentai-agentsanthropic-claudebotsfirecrawlgenerative-ailangchainlanggraphllmsnlpscraperscrapping-phpscrapping-pythonwebweb-scraperweb-scrapingworkflow

More Subagents