WebHarvy can be used to scrape job details from jobs listing websites like Indeed, Google Jobs etc. WebHarvy can automatically pull job details from multiple pages of listings and save them to a file or database.
The following video shows how WebHarvy can be configured to scrape data from Google Jobs listings. Details like job title, position, application URL, company name, description etc. can be easily extracted.
More jobs are loaded on to the same page when you scroll down the left hand side pane on Google Jobs listings page. To perform this the JavaScript method of pagination has to be used. The JavaScript code to be used for this is given below.
lists = document.getElementsByTagName(‘ul’);
els = lists[lists.length-1].children;
els[els.length-1].scrollIntoView();
Before selecting any data, the following JavaScript code needs to be run on the page to collate job listings grouped under various sections to a single group.
lists = document.getElementsByTagName(‘ul’);
parent = lists[0];
for (var i = lists.length – 1; i >= 1; i–) {
list = lists[i].children;
for (var j = list.length – 1; j >= 0; j–) {
parent.appendChild(list[j]);
}
}
Video : How to scrape Google Jobs using WebHarvy?
Interested? We highly recommend that you download and try using the free evaluation version of WebHarvy available in our website, by following the link given below.
Start web scraping using WebHarvy
In case you have any questions feel free to contact our technical support team.