Scrape the pages you sign in to.
Your scrapers sign in as you do, even when they run in the cloud.
| Product | Units sold | Revenue |
|---|---|---|
| Trailhead 40L Pack | 42 | $5,418.00 |
| Ridgeline Rain Shell | 31 | $5,859.00 |
| Basecamp Stove | 58 | $3,422.00 |
| Ridge Hiker Boot | 27 | $4,428.00 |
| Summit Two Tent | 12 | $2,988.00 |
| Canyon Water Bottle | 96 | $2,784.00 |
Scrape in your own browser
The Chrome extension scrapes with the sign-in you already have, so any page you can open, you can scrape.
Keep your sign-in for cloud runs
Add the cookies from the tab you are signed in on, and scheduled and API runs see the site as you do.
Save one login for a whole site
A saved login works for every scraper on that site. The password is encrypted and not visible to Simplescraper.
What people use it for
Read a members area
Scrape listings, prices or directories that only show once you sign in.
Export a table from a dashboard
Pull a report out of a web dashboard or portal you use, and refresh it every day.
Track a supplier's prices and stock
Scrape the trade portal a supplier gives you and keep the figures in a sheet.
When to use cookies or a saved login
Start with cookies, which share no password. Use a saved login when the site signs you out too quickly, or when it does not use cookies to keep you signed in.
| Cookies | Saved login | |
|---|---|---|
| Your password is shared | No. Only your signed-in session is saved | Yes, encrypted and not visible to Simplescraper |
| Keeps working | Until the site signs you out | Until you change the password |
| Best for | Sites with two-step sign-in | Sites that sign you out quickly, and long-running schedules |
How to scrape behind a login
Sign in as you normally would
Open the site in Chrome, sign in and save a scraper with the Simplescraper extension.
Add your cookies or a login
While you are on the site, click 'Add cookies' in the scraper's 'Settings'. Or add a credential for the site in the dashboard.
Run it in the cloud
Run it now, on a schedule or from the API, and it opens the pages signed in.
FAQ
How do I scrape password-protected websites?
In your browser, the Simplescraper extension scrapes any page you can open, because it uses your own sign-in. For runs in the cloud, add your cookies to the scraper, or save your username and password as a credential that every scraper on that site can use.
Which method is better - credentials or cookies?
Start with cookies, because no password is shared, but they stop working when the site signs you out. A saved login keeps working until you change the password, so it suits sites that sign you out quickly and long-running schedules. For sites with two-step sign-in, use cookies.
Is my login information secure?
A saved password is encrypted, stored securely and not visible to Simplescraper. With cookies, no password is saved at all, only the session you signed in with.
What if my login stops working?
Cookies stop working when the site signs you out. Sign in again, open the scraper's 'Settings' in the extension and refresh the cookies. If you change your password on the site, change it in the credential too.
Which websites can I scrape behind login?
Most sites you sign in to, such as business tools, members areas and private dashboards.
Scrape your first page behind a login.
New accounts start with 100 credits.
Start free