Simplescraper

Using Simplescraper's MCP Server ​

Model Context Protocol (MCP) is a standardized way for AI applications like Claude, Cursor and ChatGPT to interact with web apps like Simplescraper.

By connecting to Simplescraper's MCP server, you can automatically scrape websites, manage recipes and analyze scraped data using any AI application or AI agents.

Simplescraper's MCP server URL:

https://mcp.simplescraper.io/mcp


Quick Setup ​


Claude Desktop ​

  1. Open Claude Desktop settings
  2. Navigate to Settings (bottom-left) → Integrations
  3. Click "Add MCP Server"
  4. Enter these details:
    • Name: Simplescraper
    • URL: https://mcp.simplescraper.io/mcp
  5. Complete the authentication flow to connect your Simplescraper account
  6. Start using natural language to control your scrapes!

Claude Integrations availability

Integrations are currently available on the Max plan, with broader availability coming soon.


Cursor IDE ​

Cursor supports MCP with OAuth authentication. When you add the server, Cursor will open a browser window for you to log in with your Simplescraper account.

Global Setup (All Projects):

  1. Create ~/.cursor/mcp.json in your home directory
  2. Add this configuration:
json
{
  "mcpServers": {
    "simplescraper": {
      "url": "https://mcp.simplescraper.io/mcp"
    }
  }
}
  1. When you toggle the server on in Cursor, it will prompt you to authenticate with your Simplescraper account

Project-Specific Setup:

For tools specific to a project, create a .cursor/mcp.json file in your project directory:

  1. Create .cursor/mcp.json in your project root
  2. Use the same JSON configuration as above
  3. The server will only be available in that project

Via Cursor Settings UI:

  1. Open Cursor Settings (Ctrl/Cmd + ,)
  2. Navigate to MCP in the sidebar
  3. Click "Add Server"
  4. Enter:
    • Name: Simplescraper
    • URL: https://mcp.simplescraper.io/mcp
  5. When prompted, log in with your Simplescraper account

Do not add an Authorization header manually

Cursor handles authentication automatically through OAuth. Adding "headers": {"Authorization": "Bearer ..."} with your API key will prevent the login flow from working. Use the config above with just the URL.



Other AI Applications ​

Most AI applications that support MCP will have a similar setup process. Look for MCP or "Tools" settings and add our server URL: https://mcp.simplescraper.io/mcp


Available Capabilities ​

Each tool below shows an example prompt you can type into Claude (or another MCP client) to invoke it. The prompts are illustrative, not strict — natural variations work.


Recipe Management ​

list_recipes — Find recipes by domain, keyword, or recent activity.

"List all my recipes that scrape from linkedin.com"

get_recipe — View full details of a specific recipe including selectors.

"Show me the selectors in my Amazon price tracker recipe"

create_recipe — Build new scrape recipes with CSS selectors.

"Create a recipe for nytimes.com that grabs headlines and timestamps"

update_recipe — Modify existing recipes (name, URL, or selectors).

"The price selector on my Amazon scraper needs updating to .new-price-class"


Data Extraction ​

run_recipe — Execute a scrape to get fresh data. Consumes credits.

"Run my Twitter profile scraper now and show me the new data"

smart_extract — Use AI to extract data from a URL without writing CSS selectors.

"Extract product names, prices, and ratings from https://example.com/products"

get_latest_results — Retrieve the most recent scraped data for a recipe.

"Show me the latest results from my Twitter profile scraper"

get_results — Fetch results by a specific results_id (typically from history).

"Get the data from results ID abc123"

get_results_history — View past scrape runs for a recipe.

"When did my Amazon scraper last run, and how many times this week?"


Batch Operations ​

update_batch_urls — Add or replace the list of URLs for batch (crawler) scraping.

"Add these 10 product URLs to my product details scraper"


URL Discovery ​

extract_urls — Parse a site's sitemap to discover all page URLs. Free, does not deduct credits.

"Get me a list of all pages on stripe.com"


Advanced Usage Examples ​


URL Discovery and Batch Scraping ​

"Find all product pages on example.com/shop, add them to my product scraper recipe, 
and run the scrape."

Claude will parse the sitemap, filter URLs to match your description (e.g. paths containing /product/), update the batch URL list, and execute the recipe.


Complex Workflows ​

"Check my Amazon price tracker recipe. If prices have changed by more than 10% 
since the last run, create a summary report of the changes."

Multi-Step Operations ​

"Find all recipes that haven't run in the last week, run them, 
and summarize any that return errors."

Data Transformation ​

"Get the latest results from my job listings scraper and format them 
as a markdown table sorted by salary."

Getting Help ​