Overview

Web Data

Use this section to extract web content, discover URLs, run search jobs, and connect Geonode to AI tools with MCP.

Getting Started

Start here if you are new to the Scraper API.

Products

Choose the API that matches your workflow.

  • Extraction — extract Markdown or HTML from a webpage
  • Batch — process multiple URLs in one job
  • Crawl — discover and extract pages across a website
  • Map — discover URLs under a base URL
  • Search — submit search queries and retrieve results

Dashboard Guides

Use the Geonode Dashboard when you want to run jobs without writing code.

SDKs & Integrations

Call the Scraper API from code, the terminal, agents, or n8n.

  • Python SDK — geonode-scraper-sdk on PyPI
  • TypeScript SDK — @geonode_scraper/scraper-sdk on npm
  • CLI — gscraper (geonode-scraper-cli)
  • LangChain — tools for LangChain agents
  • CrewAI — tools for CrewAI agents
  • n8n — community node and trigger
  • Tools Core — shared runtime behind LangChain and CrewAI

MCP

You can also use Geonode through MCP to connect the Scraper API to AI assistants and IDEs. See the MCP Guides to get started.

API Reference

Use the API reference when you need endpoint details, parameters, and responses.

  • API Reference — base URL, auth, and endpoint map
  • Extraction — extract content endpoints
  • Batch — batch job endpoints
  • Crawl — crawl job endpoints
  • Map — map job endpoints
  • Search — search job endpoints

Next Steps

  • Start with the Quick Start Guide to authenticate
  • Pick a product guide above for your use case

Was this page helpful?

On this page