WebHarvy is a visual web scraping software which can be easily configured to scrape data from any website. In this article we will see how WebHarvy can be used to scrape data from Yellow Pages Australia listings.
Yellow Pages Australia Scraper
The built-in browser of WebHarvy allows you to load any website and build a web scraper for that website. Data which you need to scrape can be selected using mouse clicks. WebHarvy will automatically identify and scrape repeating data of the same kind from a web page. It can also automatically scrape data from multiple pages of listings and also by following links to fetch detailed data.
The following video shows how WebHarvy can be configured to build an Yellow Pages Australia Scraper. A special technique is employed to select data correctly and consistently from yellowpages.com.au listings. This is mainly because the layout of boxes of listings vary from one listing to another – some has header with their logo/image, some does not etc.
The regular expression strings used in the above video can be found in the video description.
We highly recommend that you download and try using the free evaluation version of WebHarvy available in our website. To get started, please follow the link below.