XCrawl
Web data API for AI builders: scrape, crawl, map and search the web, returning clean JSON or Markdown.
About XCrawl
XCrawl gives developers one API for getting live web data into AI apps. Scrape a URL into Markdown, JSON, HTML or a screenshot, crawl a whole site with depth and scope rules, map every URL on a domain, or pull structured search results. Python and Node.js SDKs, a CLI, an MCP server and an n8n node are available.
Does ChatGPT recommend your AI tool?
If you're building in Data Extraction, run a free AI-visibility scan on your own product — we ask ChatGPT across 5 prompt angles and score how often you get named. ~30 seconds, no signup, no card.
Key Features
Tags
Is XCrawl your tool?
This is the page shoppers and AI assistants read when they look up XCrawl. The one-time $79 Verified tier adds:
- Our 12-point AI-visibility scan of XCrawl, emailed to you: which ChatGPT prompts named you, which named a competitor instead, and the wording the model used.
- The 🛡️ Verified badge on this page and next to your name in the category and newest-tool lists.
One-time $79, no subscription, nothing to fill in again. Your link back to your site is marked rel="sponsored", as Google requires for paid listings.
Secure Stripe checkout — Apple Pay, Google Pay, Link or card. Nothing to fill in again.
Complete Your Data Extraction Stack
Other data extraction tools in our catalog:
Consensus
Try FreeAI search across 200M research papers
Source real evidence behind your analysis
1Password
Try FreeSecrets and credential manager
Keep API keys and .env secrets out of your repo
Gamma
Try FreeAI presentation builder
Turn ideas into polished decks instantly
💰 Affiliate disclosure: We may earn a commission if you sign up through these links at no extra cost to you.
Stay updated on Data Extraction tools — join our weekly newsletter
One concise email with fresh launches, trending picks, and featured standouts.
More Data Extraction tools
GetXAPI
Third-party X/Twitter read API at $0.001 per call with 64 endpoints, webhooks and a hosted MCP server
Hubertino
Scrape Google Maps into a lead spreadsheet with phone, website, email and socials, billed per business delivered
JobsPipe
Job postings from 30+ ATS platforms normalised into one deduplicated JSON schema, with a free tier and an MCP surface
xfetch
X/Twitter read API with 31 REST endpoints and 6 hosted MCP tools returning normalized JSON, credit-billed and never charged for failed calls
Xquik
Xquik is the world's fastest and cheapest X Twitter scraper service with the most complete X data.
YouTube Transcript Generator
Free YouTube transcript generator with timestamps, search, copy, download, and AI summary.
Agent connectivity: not yet verified