AI-powered web scraping agent built with LangGraph, LangSmith, Firecrawl, and Anthropic AI. Automates intelligent crawling, structured data extraction, and LLM-powered content formatting. Efficiently handles anti-bot mechanisms, error recovery, and batch processing. 🚀
- ✓Open-source license (MIT)
- ✓Clear description
- ✓Topics declared
- ✓Mature repo (>1y old)
- !Stale (last commit >426d ago)
{
"mcpServers": {
"scraping-agent-ai": {
"command": "node",
"args": ["/path/to/scraping-agent-ai/dist/index.js"]
}
}
}~/Library/Application Support/Claude/claude_desktop_config.json (Mac) or %APPDATA%\Claude\claude_desktop_config.json (Windows).<placeholder> values with your API keys or paths.Subagents overview
What people ask about scraping-agent-ai
What is hmshb/scraping-agent-ai?
+
hmshb/scraping-agent-ai is subagents for the Claude AI ecosystem. AI-powered web scraping agent built with LangGraph, LangSmith, Firecrawl, and Anthropic AI. Automates intelligent crawling, structured data extraction, and LLM-powered content formatting. Efficiently handles anti-bot mechanisms, error recovery, and batch processing. 🚀 It has 19 GitHub stars and was last updated 1y ago.
How do I install scraping-agent-ai?
+
You can install scraping-agent-ai by cloning the repository (https://github.com/hmshb/scraping-agent-ai) or following the README instructions on GitHub. ClaudeWave also provides quick install blocks on this page.
Is hmshb/scraping-agent-ai safe to use?
+
Our security agent has analyzed hmshb/scraping-agent-ai and assigned a Trust Score of 62/100 (tier: OK). See the full breakdown of passed checks and flags on this page.
Who maintains hmshb/scraping-agent-ai?
+
hmshb/scraping-agent-ai is maintained by hmshb. The last recorded GitHub activity is from 1y ago, with 0 open issues.
Are there alternatives to scraping-agent-ai?
+
Yes. On ClaudeWave you can browse similar subagents at /categories/agents, sorted by popularity or recent activity.
Deploy scraping-agent-ai to your cloud
Ship this repo to production in minutes. Each platform spins up its own environment with editable env vars.
Maintain this repo? Add a badge to your README
Drop the badge into your GitHub README to show it's tracked on ClaudeWave. Each badge links back to this page and reflects the live Trust Score.
[](https://claudewave.com/repo/hmshb-scraping-agent-ai)<a href="https://claudewave.com/repo/hmshb-scraping-agent-ai"><img src="https://claudewave.com/api/badge/hmshb-scraping-agent-ai" alt="Featured on ClaudeWave — hmshb/scraping-agent-ai" width="320" height="64" /></a>More Subagents
The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
Java 面试 & 后端通用面试指南，覆盖计算机基础、数据库、分布式、高并发、系统设计与 AI 应用开发
Production-ready platform for agentic workflow development.
The agent engineering platform
The agent that grows with you
The ultimate space for work and life — to find, build, and collaborate with agent teammates that grow with you. We are taking agent harness to the next level — enabling multi-agent collaboration, effortless agent team design, and introducing agents as the unit of work interaction.