Scraping hidden details using WebHarvy

WebHarvy allows you to scrape hidden fields in websites which are displayed only when you click on a link or button. The ‘Click’ option in the Capture window can be used to display such ‘click to display’ fields. The following video shows the process.
https://www.youtube.com/watch?v=MYfAQYtKE8E
The video below shows how contact details from Craigslist listing pages can be extracted using this feature.
https://www.youtube.com/watch?v=D8pHdI_5Dco
WebHarvy also allows you to scrape data from the HTML of the page. For example, the following video shows how geo location (latitude, longitude) can be extracted from yellow page listings (map details) from its HTML – this data is not visible in browser.
https://www.youtube.com/watch?v=qhY4644MLO8
 Know More

Leave a Comment