Scraping data from a list of URLs

WebHarvy can scrape data from a list of URLs, provided that they all belong to the same website/domain and share the same layout/page design. This technique is explained in the following link.

How to scrape a list of URLs using a single configuration ?

To any WebHarvy configuration (built to extract data from a page / website), you can add additional URLs as explained here. This can be done while creating the configuration, or while editing it later.

The following video shows how a list of Amazon product page URLs can be scraped using WebHarvy.

To know more, please visit the link below.

Getting started with web scraping using WebHarvy

 

Leave a Comment