Overview | Geonode

Fully Managed Infrastructure

Zero-Config Web Extraction Pipeline

Proxy rotation, anti-bot bypass, CAPTCHA solving, and browser rendering — handled for you.

Proxy Pool30M+ Residential

Success Rate99.8% SLA

Latency< 1.4s P50

RenderingChromium / JS

Engine Capabilities

Choose the right API

5 specialized endpoints

Extract

Extract Markdown or HTML content from a webpage.

Best for:

Extracting a known webpage
Getting content for AI and RAG applications
Processing JavaScript-rendered pages

Explore Extract

Batch

Process multiple known URLs in one asynchronous job.

Best for:

Large URL lists
Product catalog extraction
Processing many pages together

Explore Batch

Crawl

Discover and extract multiple linked pages starting from a website URL.

Best for:

Crawling documentation websites
Extracting website content across pages
Collecting content without knowing every URL beforehand

Explore Crawl

Map

Discover the URLs available on a website without extracting all page content.

Best for:

Website URL discovery
Exploring website structure
Finding URLs for later extraction

Explore Map

Search

Submit search queries and retrieve relevant web results.

Best for:

Discovering websites and pages
Finding sources for research
Starting search-to-extraction workflows

Explore Search

Specifications

API Comparison

Review technical entry points, payloads, and ideal workload profiles across the suite.

API	Main input	Main output	Best use
Extract	Webpage URL	Extracted content	One known page
Batch	Multiple URLs	Collection of extraction results	Known URL lists
Crawl	Starting website URL	Crawled pages and content	Multi-page website extraction
Map	Website URL	Discovered URLs	Website discovery
Search	Search query	Search results	Finding relevant websites

Architecture

How the APIs work together

Compose discrete endpoints into automated discovery and bulk ingestion loops.

STEP 01

Search Engine

Execute targeted queries using the Search API to query search indices and find relevant root domains.

Input: "best travel insurance"Output: 10 root URLs

STEP 02

Map Discovery

Feed discovered domains into the Map API to crawl site structures and map target sub-pages without scraping payload.

Input: https://site.comOutput: 2,400 page URLs

STEP 03

Extract or Batch

Send selected URLs to Extract for rapid sync tests or dispatch large lists to Batch for high-scale harvesting.

Payload: Clean MarkdownReady for Vector DB / RAG

Implementation

Instant Request Example

curl -X POST "https://scraper.geonode.io/v1/extract" \
  -H "X-Api-Key: YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "url": "https://example.com/product/1042",
    "render_js": true,
    "formats": ["markdown"],
    "wait_for": ".reviews-container"
  }'

Developer Resources

Start building with Web Data

Everything you need to initiate high-throughput extraction pipelines in production.

Get your API keyGenerate instant keys and manage quota restrictions directly in your dashboard settings.Make your first API requestFollow the 5-minute Quick Start guide to send requests and inspect Markdown returns.Explore API ReferenceDetailed parameter definitions, response headers, and schema definitions for all 5 APIs.Use the Web Data DashboardMonitor active batch pipelines, inspect latency percentiles, and debug scraping logs live.