How to scrape Indeed Job listings (or any website) directly into Airtable

Airtable is a powerful platform that allows anyone to create useful applications on top of their data. It can serve as a database for no-coders or the planning backbone for entire organizations.

In many cases you'll want to move data from the web into Airtable. If you're a recruiter looking to know who's hiring or a no-code maker planning a curated jobs board, for example, having the latest jobs from multiple websites automatically appear in your base every hour or each morning would prove valuable and save you time.

So in this guide we'll walk through how to make that happen by scraping the popular jobs website Indeed.com into Airtable.

We'll use Simplescraper's new Airtable Integration which allows you to scrape data from any website into Airtable with one click and zero lines of code. Once the integration is connected you can extend your scraping to LinkedIn, Glassdoor, SimplyHired or any website that you choose.

Getting the data from website to base should take less than 5 minutes so let's get started.

Creating your Indeed job scraper recipe

Simplescraper has a readymade scrape recipe for Indeed.com so you don't need to create one yourself. Simply click here to load the recipe in Simplescraper and save it to your account.

When saving the recipe you can choose which Indeed URL you want to scrape, for example if you want the latest full-stack developer jobs in your Airtable base you would use this URL: https://www.indeed.com/jobs?q=full stack developer.

Save the recipe and click run and it will scrape the Job title, company, summary and location details from Indeed.

Now that you've created your recipe and tested that it's working, let's connect to Airtable.

Connecting Simplescraper to Airtable

Video showing how to connect Simplescraper to Airtable

In Simplescraper, navigate to the Integrate tab of the Indeed scrape recipe that you just created and you'll find the Airtable Integration. There are four sections to be completed: API key, Base ID, Table name and Included properties. Follow the instructions provided to complete the integration or view this detailed integration guide if you need more help.

For each property that you wish to scrape into Airtable you'll need to create a corresponding single text field with the exact same name in your Airtable base. So if you want to copy all data from Indeed then create a field in Airtable for each of the following properties: job_title, company, summary, location.

When you're done click test integration and you should see a 'test passed' message. You're all set to go so let's make the data appear in Airtable.

Scraping data into Airtable

Video of website scraping directly into Airtable

Now that you've created your scrape recipe and successfully connected to Airtable all you have to do is click run recipe again. Simplescraper will scrape Indeed and populate your Airtable base with the results. When the scrape recipe has completed, navigate to Airtable and your results should be displayed.

You can choose to set Simplescraper to run on schedule so that you have the latest jobs data in your Airtable automatically and set a unique key to avoid duplicate results. You can also create more recipes to scrape multiple websites into the same table or base and then organize them using different Airtable views.

And you're done. Simplescraper is now integrated with your Airtable, making any website on the web a data source for your bases.