Overview

Web Data

Use this page for a map of Scraper API endpoints.

If you need an API key or base URL, see Authentication & Base URL. New to the product? Start with the Quick Start Guide.

API categories

CategoryPurpose
ExtractionExtract content from webpages
BatchProcess multiple URLs in one job
CrawlDiscover and extract pages across a website
MapDiscover URLs from a website
SearchRun search jobs and retrieve results
UsageRetrieve concurrency usage
SystemService health and status

Endpoints

System

MethodEndpointDescription
GET/healthCheck API health status

Extraction

MethodEndpointDescription
POST/v1/extractExtract content from a webpage
GET/v1/extract/{job_id}Retrieve an extraction job
GET/v1/extract/jobsList extraction jobs

Batch

MethodEndpointDescription
POST/v1/batchStart a batch job
GET/v1/batch/{job_id}Retrieve a batch job
DELETE/v1/batch/{job_id}Cancel a batch job
GET/v1/batch/jobsList batch jobs

Crawl

MethodEndpointDescription
POST/v1/crawlStart a crawl job
GET/v1/crawl/{job_id}Retrieve a crawl job
DELETE/v1/crawl/{job_id}Cancel a crawl job
GET/v1/crawl/jobsList crawl jobs

Map

MethodEndpointDescription
POST/v1/mapDiscover URLs from a website
GET/v1/map/{job_id}Retrieve a map job
GET/v1/map/jobsList map jobs
MethodEndpointDescription
POST/v1/searchStart a search job
GET/v1/search/{job_id}Retrieve a search job
GET/v1/search/jobsList search jobs

Usage

MethodEndpointDescription
GET/v1/usage/concurrencyRetrieve concurrency usage

Next steps

Open the category pages below for request and response details:

Was this page helpful?