Resource detail

ai-crawler-py

Crawl a website starting from a URL, find relevant pages, an

GlobalFree

Visit official siteMore like this

At a glance

ai-crawler-py

Pricing

Free

Access

No login

Platforms

Web

Chinese support

Last checked

2026-08-28

Popularity

82/100

Related resources

Selected by use case

LangChain

构建 LLM 应用、RAG 和 Agent 的开源框架。

GlobalFreeAgent+1

Updated 2026-08-28

Visit official site

LangGraph

LangChain 团队的图结构 Agent 编排框架，适合生产。

GlobalFreeAgent+1

Updated 2026-08-28

Visit official site

CrewAI

A multi-agent collaboration framework that assigns roles for complex tasks.

OverseasFreemiumOpen source+2

Updated 2026-07-09

Visit official site

AutoGen

Microsoft's multi-agent conversation framework for research and prototyping.

OverseasFreeOpen source+2

Updated 2026-07-09

Visit official site

OpenAI Agents SDK

OpenAI's lightweight agent framework with built-in handoffs and tracing.

OverseasFreeOpen source+2

Updated 2026-07-09

Visit official site

Claude Agent SDK

Anthropic's agent development kit with capabilities shared by Claude Code.

OverseasFreeOpen source+2

Updated 2026-07-09

Visit official site