Overview

Web Data ยท Batch

Batch API

Extract content from multiple known URLs through a single asynchronous job.

At a glance

From request to clean content

Submit a request, let Geonode handle proxies and rendering, and get structured output for your apps and pipelines.

Capabilities

What is Batch?

Batch processes many URLs in one asynchronous request.

You receive a job ID and poll for status and results.

Each URL can succeed or fail independently inside the batch.

Fit

When to use it

Product catalog extraction
Large article or documentation collections
Known lists of URLs
Scheduled or repeated extraction workloads

Architecture

How it works

A typical batch request follows these steps.

01

Prepare a list of URLs.

02

Configure the batch request.

03

Submit the batch and receive a job ID.

04

Monitor processing.

05

Retrieve results when complete.

Documentation

Explore Batch guides

Jump into setup, workflows, jobs, and troubleshooting.

Was this page helpful?

Quick links

Need assistance?

Connect with our scraping infrastructure engineers 24/7 or read community recipes.