Docs · Web API
Web API
Any public web page as HTML, markdown or plain text, even past bot checks and captchas.
Overview
Send a URL and get the page back, even from sites that try to block bots. There are three ways to call it.
Auto (scrape) tries the cheapest step first and steps up only when the site blocks it. You pay for the step that worked.
One step at a fixed price: a plain request (fetch), a real browser (render), a browser on separate IPs (unblock), a residential IP (residential) or a browser on a residential IP (render-residential).
Your own steps (custom): list the steps to try, in order, and pay for the one that got the page.
The web scraping guide explains each step, what it costs and how failures work.
Source: any public URL.
Endpoints
Call it
Each endpoint is a web address. Request it with GET, put your API key in the x-api-key header, and you get JSON back. For example, Scrape a page (Auto):
curl "https://api.lurkapi.com/v1/web/scrape?url=https%3A%2F%2Fsiteproxy.ruqli.workers.dev%3A443%2Fhttps%2Fbooks.toscrape.com%2F&format=markdown" \-H "x-api-key: YOUR_API_KEY"Use it in Claude
Connect LurkAPI to Claude and ask in plain English. Each endpoint is a tool Claude can call:
| Tool | Endpoint |
|---|---|
web_scrape | Scrape a page (Auto) |
web_fetch | Fetch a page (plain request) |
web_render | Render a page (browser) |
web_unblock | Unblock a page (separate IPs) |
web_residential | Fetch a page from a residential IP |
web_render_residential | Render a page from a residential IP |
web_custom | Scrape a page with your own steps |
From the blog
All posts
· 3 min read
How to scrape Twitter and social media like an API
One GET request, one JSON schema across X, Instagram, TikTok, YouTube, Reddit and LinkedIn. Clean data starting at $0.59 per 1,000 calls.

· 5 min read
Social media API benchmark: 1,000 live calls, timed and priced
1,000 live calls across Instagram, TikTok, X, YouTube and Reddit: 993 returned data in 0.73 s at the median, at $0.06 per 1,000 results. Script and rows inside.

· 4 min read
Apify Instagram, TikTok and Twitter scrapers: cost per 1,000
Apify charges $2.30 per 1,000 Instagram posts and $0.40 per 1,000 tweets. LurkAPI returns the same data for $0.08 and $0.05.