Scrape behind a login

Scrape the pages you sign in to.

Your scrapers sign in as you do, even when they run in the cloud.

No credit card · 100 free credits to start
patagonica.com/admin/sales
OverviewSalesInventoryCustomers
Sales this week
Signed in
ProductUnits soldRevenue
Trailhead 40L Pack42$5,418.00
Ridgeline Rain Shell31$5,859.00
Basecamp Stove58$3,422.00
Ridge Hiker Boot27$4,428.00
Summit Two Tent12$2,988.00
Canyon Water Bottle96$2,784.00
Simplescraper
ProductUnits soldRevenue
Trailhead 40L Pack42$5,418.00
Ridgeline Rain Shell31$5,859.00
Basecamp Stove58$3,422.00
Ridge Hiker Boot27$4,428.00
Summit Two Tent12$2,988.00
Canyon Water Bottle96$2,784.00
CookiesAdd cookies

Scrape in your own browser

The Chrome extension scrapes with the sign-in you already have, so any page you can open, you can scrape.

Keep your sign-in for cloud runs

Add the cookies from the tab you are signed in on, and scheduled and API runs see the site as you do.

Save one login for a whole site

A saved login works for every scraper on that site. The password is encrypted and not visible to Simplescraper.

What people use it for

Read a members area

Scrape listings, prices or directories that only show once you sign in.

Export a table from a dashboard

Pull a report out of a web dashboard or portal you use, and refresh it every day.

Track a supplier's prices and stock

Scrape the trade portal a supplier gives you and keep the figures in a sheet.

When to use cookies or a saved login

Start with cookies, which share no password. Use a saved login when the site signs you out too quickly, or when it does not use cookies to keep you signed in.

CookiesSaved login
Your password is sharedNo. Only your signed-in session is savedYes, encrypted and not visible to Simplescraper
Keeps workingUntil the site signs you outUntil you change the password
Best forSites with two-step sign-inSites that sign you out quickly, and long-running schedules

How to scrape behind a login

1

Sign in as you normally would

Open the site in Chrome, sign in and save a scraper with the Simplescraper extension.

2

Add your cookies or a login

While you are on the site, click 'Add cookies' in the scraper's 'Settings'. Or add a credential for the site in the dashboard.

3

Run it in the cloud

Run it now, on a schedule or from the API, and it opens the pages signed in.

FAQ

How do I scrape password-protected websites?

In your browser, the Simplescraper extension scrapes any page you can open, because it uses your own sign-in. For runs in the cloud, add your cookies to the scraper, or save your username and password as a credential that every scraper on that site can use.

Which method is better - credentials or cookies?

Start with cookies, because no password is shared, but they stop working when the site signs you out. A saved login keeps working until you change the password, so it suits sites that sign you out quickly and long-running schedules. For sites with two-step sign-in, use cookies.

Is my login information secure?

A saved password is encrypted, stored securely and not visible to Simplescraper. With cookies, no password is saved at all, only the session you signed in with.

What if my login stops working?

Cookies stop working when the site signs you out. Sign in again, open the scraper's 'Settings' in the extension and refresh the cookies. If you change your password on the site, change it in the credential too.

Which websites can I scrape behind login?

Most sites you sign in to, such as business tools, members areas and private dashboards.

Scrape your first page behind a login.

New accounts start with 100 credits.

Start free
No credit card · or read the login guide