The web, without the bullshit.

Anticrawl converts webpages into structured Markdown so AI systems and developer tools can ingest web content without scraping complexity.


Works Everywhere

Any public URL, any language, any site. News articles, documentation, blog posts, wikis — if a browser can read it, Anticrawl can convert it.

Instant Results

Paste a URL, get Markdown in under a second. No waiting for headless browsers to spin up or pages to render.

One API Call

Send a URL, get Markdown back. That's the whole integration. Works with any language, any framework, any workflow.

Structured Metadata

Every response includes title, author, description, and word count as YAML frontmatter — ready for search indexes, databases, or AI context.


API Reference

Integrate Anticrawl into your workflow with a single API call.

POST/api/generate

Convert any public web page into clean Markdown with YAML frontmatter. Send a URL and get back structured, readable content — stripped of ads, navigation, and scripts.

Authentication

All requests require a Bearer token in the Authorization header. Generate an API key from your dashboard.

Authorization: Bearer your_api_key

Request body

Send a JSON object with the target URL. Alternatively, use a GET request with ?url= as a query parameter.

urlstringrequired

The full URL to convert (must start with http:// or https://)


Quick start

curl -X POST https://anticrawl.nikhilnigam.in/api/generate \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -d '{"url": "https://example.com"}'

Response

On success, the API returns text/markdown with YAML frontmatter containing the page title, author, description, source URL, and word count.

200text/markdown
---
title: Example Domain
author: ""
sourceUrl: https://example.com
domain: example.com
description: "This domain is for use in illustrative examples..."
wordCount: 42
---

# Example Domain

This domain is for use in illustrative examples in documents.

Error handling

Errors return JSON with a success: false flag and a human-readable error message.

JSONError response
{
  "success": false,
  "error": "Missing required parameter: url"
}

Status codes

200Markdown returned successfully
400Missing or invalid URL parameter
401Missing or invalid API key
403No credits remaining
502Failed to fetch or convert the target URL