Simplescraper

Batch scraping in the browser ​

Scrape up to 5,000 URLs using a single recipe, directly in your browser. Batch scraping is ideal for:

  • Scraping detail pages - extract data from individual pages after collecting their URLs from a list
  • Processing your own URL list - paste URLs you've gathered from another source
  • Scraping logged-in content at scale - your browser session gives you access to protected pages

For scheduled or background batch scraping, see Crawling lists of URLs (Cloud).

Prerequisites ​

Before you start, you'll need:

  1. The Simplescraper extension installed
  2. A saved recipe that works on the pages you want to scrape
  3. A list of URLs - either your own, or from another Simplescraper recipe that scrapes a list of links. We'll cover both approaches below.

Method 1: Import URLs from a previous scrape ​

This method chains two recipes together - first scrape a list of URLs, then scrape each URL with your detail recipe.

Step 1: Run your list recipe ​

  1. Navigate to the page containing your list of items
  2. Open the Simplescraper extension
  3. Go to My Recipes and click on your list recipe
  4. Click Run Recipe

The scrape will extract all items from your list, including their URLs in the results.

Step 2: Open your detail recipe ​

Once the list scrape completes:

  1. Go to My Recipes
  2. Click on your detail page recipe

Step 3: Import the URLs ​

  1. Click the Batch URLs tab
  2. Click Import from Results
  3. Select the list recipe you just ran (it should be the most recent one)
  4. Click Next
  5. Choose the property containing the URLs (Simplescraper will auto-detect URL fields)
  6. Click Import URLs

Your URLs are now loaded into the Batch URLs tab.

Step 4: Run the batch scrape ​

  1. Go to the Run Recipe tab
  2. Check that Use batch URLs is selected (you'll see the count of URLs)
  3. Click Run Recipe

Simplescraper will navigate to each URL in sequence, extract the data, and display results as it goes. You can watch the progress and see data appear in real-time.

Method 2: Paste or upload URLs ​

If you already have a list of URLs from another source:

Paste URLs directly ​

  1. Open your recipe and go to the Batch URLs tab
  2. Paste your URLs into the text area (one per line)

Upload a CSV file ​

  1. Go to the Batch URLs tab
  2. Click Upload CSV
  3. Select your file containing URLs

Run the batch ​

  1. Go to the Run Recipe tab
  2. Ensure Use batch URLs is selected
  3. Click Run Recipe

Download results ​

Once the scrape completes, download your results as CSV, JSON, or copy to clipboard.

Need help? ​

Click the chat button in the bottom-right corner to get in touch.