Web Scraping Made Easy
Sreejith Normally, if you try to login to your Google account in WebHarvy’s configuration browser, you will get the following message. Related: How to scrape data from websites which require login ? To solve this, follow the steps below. Open WebHarvy Settings > Browser Settings and select/tick ‘Enable custom user agent string’ Paste the user agent string … Read more
WebHarvy is a generic visual web scraping software which can be easily configured to extract data from any website. In this article we will see how WebHarvy can be configured to extract data from Bing maps. Details like business name, address, phone number, website address, rating etc. can be easily extracted from Bing maps listings … Read more
WebHarvy can be used to scrape data from TripAdvisor website. In this article we will be see how WebHarvy can be configured to scrape reviews and ratings from multiple listings at TripAdvisor website. By default, TripAdvisor does not display the complete review text in its listings pages. You will have to click a ‘Read more’ … Read more
WebHarvy can be used to easily scrape product data from listings at eCommerce websites like Amazon, eBay etc. We have an entire playlist of demonstration videos related to eCommerce data extraction in our YouTube channel. eBay Data Scraping In this article we will see how WebHarvy can be used to extract product data from eBay … Read more
In this article we will see how WebHarvy can be used to extract data from Spanish Yellow Pages website – paginasamarillas.es Paginas Amarillas Data Extraction WebHarvy can extract data like business name, address, website, email and phone numbers from paginasamarillas.es listings. The following video shows how this can be done. Most of the details except email … Read more
This is a major update of WebHarvy. But the number of visible new features added is nil. The main change is that WebHarvy now selects data faster and the accuracy of data fetched during mining has been improved. So WebHarvy now takes lesser time to fetch patterns of data from listing pages. The selection accuracy … Read more
This update contains a major bug fix. The miner window rarely used to go into a hang/freeze state during mining. This happened especially when a larger number of parallel mining threads (> 4) were set in Advanced Miner Options. We have fixed this issue in this release, so that you can mine data with maximum … Read more
WebHarvy 5.5.1.170 brings an important bug fix and also a few other improvements. Bug fix Sometimes, during configuration, while selecting data from starting page (where there are multiple listings), preview gets updated with only a single item, giving the impression that pattern detection failed. This issue is present in the last 2 versions of WebHarvy, … Read more
The following are the main changes (features/improvements) of WebHarvy 5.5 1. Custom User Agent String If you go to WebHarvy Settings > Browser tab, you can enable custom user agent string as shown below. The ‘Enable custom user agent string’ option allows you to specify a user agent string which WebHarvy configuration and mining browsers will use. This option … Read more
WebHarvy Settings involves various options which you can set for Miner, Browser, Proxies, Category/Keyword and Images. We have created the following video which explains the various settings and how each of them can affect the mining performance/consistency and provide additional functionality. Please contact our support if you have any questions.