Scraping hidden (click to display) fields using WebHarvy

Certain web pages require that you to click on a link or button for the data to be displayed. There are many websites where email addresses or phone numbers are partially displayed, they will be fully displayed only if you click on them.
The ‘Click’ option under ‘More Options’ button in the Capture Window lets you scrape data in such scenarios. (See https://www.webharvy.com/tour1.html#ScrapeHidden). 
The following video shows how this option can be used to scrape hidden fields.
http://www.youtube.com/watch?v=MYfAQYtKE8E
Here the phone numbers are partially displayed. Using the Click option, they can be made fully visible and then scraped.
To know more about the features of WebHarvy, see the product feature tour at https://www.webharvy.com/tour.html.

Leave a Comment