Web scraping, crawling, URL mapping and SERP data for AI apps in one API
XCrawl is a web data API for developers who feed live web content into LLMs, RAG pipelines and AI agents. The Scrape API turns a public URL into Markdown, structured JSON, HTML, a link list or a screenshot. The Crawl API collects a whole site or a section with depth and scope rules, the Map API lists the URLs a domain exposes, and the Search API returns structured results from Google, Bing, DuckDuckGo and other engines. JavaScript rendering, proxy rotation and retries run server-side. Official Python and Node.js SDKs, a CLI, an MCP server and an n8n community node are available. New accounts start with 1,000 free credits.