← Beacon · open-source AI agent registry

Best Langchain Web Scraping AI agents

24 actively-maintained langchain web scraping agents · ranked by maintenance health · 33,699+ indexed

Looking for the best open-source langchain web scraping AI agent? Beacon indexes 33,699+ agents and MCP servers from GitHub and ranks them by real maintenance health — freshness, stars, and activity — so abandoned repos don't top the list. Save time: one search returns ranked, linkable agents in under a second (vs hours on GitHub). Below are 24 langchain web scraping agents you can install today — free, no API key.

Search all langchain web scraping agents →

Use from your editor: BEACON_REGISTRY_URL=https://registry-ruby.vercel.app npx -y beacon-mcp — ask your AI to find a langchain web scraping agent.

For autonomous agents (API)

Free, keyless discovery — paste into your agent workflow:

GET https://registry-ruby.vercel.app/api/v1/search?q=langchain+web+scraping&limit=10
POST https://registry-ruby.vercel.app/api/v1/discover
  Body: {"query": "langchain web scraping", "limit": 10}

llms.txt · Why agents use Beacon

Top 24 langchain web scraping agents

Markitdown ★ 165,299
autogenautogen-extensionlangchainmarkdownmicrosoft-office
Langchain ★ 141,666
agentsaiai-agentsanthropicchatgpt
Deer Flow ★ 76,917
agentagenticagentic-frameworkagentic-workflowai
Headroom ★ 58,875
agentaianthropicclaude-codecompression
Flowise ★ 54,506
agentic-aiagentic-workflowagentsartificial-intelligencechatbot
Langgraph ★ 37,177
agentsaiai-agentschatgptdeepagents
Agentgpt ★ 36,263
agentagentgptagentsagiai
Langfuse ★ 31,040
analyticsautogenevaluationlangchainlarge-language-models
Agents Course ★ 29,945
agentic-aiagentscoursehuggingfacelangchain
Gpt Researcher ★ 28,278
agentaiautomationdeepresearchllms
Mlflow ★ 27,004
agentopsagentsaiai-governanceapache-spark
Deepagents ★ 26,177
aideepagentslangchainlanggraphbatteries-included
Genai Agents ★ 23,124
agentic-aiagentsaiai-agentsautonomous-agents
Maxkb ★ 22,076
agentagentic-aichatbotdeepseek-r1knowledgebase
Nemoclaw ★ 21,760
ai-agentshermesnvidiaopenclawopenshell
Opik ★ 20,577
evaluationhacktoberfesthacktoberfest2025langchainllama-index
Langchainjs ★ 17,925
agentengineeringplatformlangchain
Generative Ai ★ 17,224
agentsgcpgeminigemini-apigen-ai
agentsaichatbotlangchainlanggraph
Surfsense ★ 15,224
agentagentsaichrome-extensionextension
Botpress ★ 14,783
agentaibotpresschatbotchatgpt
Langchain4j ★ 12,587
anthropicchatgptchromaembeddingsgemini
Gptcache ★ 8,094
aigcautogptbabyagichatbotchatgpt
Webiny Js ★ 8,013
ai-assisted-developmentawsaws-lambdacmsgraphql

Frequently asked questions

What is the best open-source langchain web scraping agent?

Top-ranked langchain web scraping agents on Beacon include Markitdown, Langchain, Deer Flow, ranked by maintenance health — recent activity, GitHub stars, and open-issue load — not stars alone.

Are these langchain web scraping agents free to use?

Yes. Every langchain web scraping agent listed is open-source and free. Beacon is a free directory — no API key or signup to browse or search.

How do I use a langchain web scraping agent from my editor or AI assistant?

Run 'npx -y beacon-mcp' to add Beacon as an MCP server in Cursor, Claude Desktop, Cline, or Windsurf, then ask your AI to find a langchain web scraping agent.

How does Beacon save time finding a langchain web scraping agent?

Instead of searching GitHub and reading dozens of READMEs, call GET https://registry-ruby.vercel.app/api/v1/search?q=langchain+web+scraping — sub-second results ranked by health, stars, and activity.

Can autonomous AI agents discover langchain web scraping tools programmatically?

Yes. Agents read https://registry-ruby.vercel.app/llms.txt and call POST /api/v1/discover with {"query": "langchain web scraping"} — no API key required.

Related searches