Web Scraping Made Easy
Newegg is an online retailer of computer hardware and electronics products. In this article we will learn how web scraping can be used to extract product data from various product categories of Newegg website. Web Scraping Software A web scraping software is a tool which helps you to easily scrape data from any website. In … Read more
WebHarvy Version 6.5.0.194 is a minor release which contains bug fix for issues reported while exporting data to latest version of MySQL server (8.0.29). Along with this we have also updated other libraries which are used internally by the software. This update may be downloaded from https://www.webharvy.com/download.html
Glassdoor is a website where employees anonymously review companies which they have worked for. Using Web Scraping, review data from Glassdoor website can be extracted to a local file in your computer or to a database. Web Scraping is the process of automatically extracting text and images in spreadsheet format from websites. There are no-code … Read more
Version 6.5.0.93 of WebHarvy comes with the following changes. Internal Browser Update The internal browser has been updated to Chromium V96, which comes with the latest security updates and web standards compliance. Auto Enable ‘Follow this Link’ option When you click a link during configuration and find the Follow this link option disabled, apply the … Read more
In this version we have improved the performance (speed) of Capture Following Text option while mining data. Since this option is heavily used for accurately selecting data from details pages (pages linked from starting page), it translates to faster mining especially for large amounts of data. The database export feature has been updated to fix … Read more
WebHarvy 6.3 comes with support for custom data fields. The following custom data fields can be added to a configuration. Current page URL Screenshot of currently loaded page Date and Time of mining data User provided text Custom data fields can be added by clicking anywhere on the page during configuration and by selecting ‘Add … Read more
WebHarvy can be used to scrape Chrome Web Store data. Chrome web store displays Chrome extensions, listed under various categories. In this article we will see how WebHarvy can be used to scrape details of extensions listed under a specific category from Chrome Web Store. Using WebHarvy to Scrape Chrome Web Store Chrome web store … Read more
Versions of WebHarvy prior to (and including) 6.2.0.184 will receive an ‘Activation failed due to unknown reason’ error message while trying to unlock using the license key file (for registered users). This issue has been fixed in the latest version of WebHarvy 6.2.0.185 which is currently available for download at https://www.webharvy.com/download.html. Please contact us in … Read more
The following are the changes in this version. Enhanced proxy support In this version we have added support for various types of proxies. Earlier, WebHarvy supported only HTTP proxies. Starting from this version the following proxy types are supported. HTTP HTTPS SOCKS4 SOCKS4a SOCKS5 In the proxy settings window you can select the type of … Read more
This article explains how the Keyword Scraping feature of WebHarvy can be used to scrape geo location coordinates (latitude and longitude) of a list of addresses from Google Maps. Given below is a sample list of addresses for which we will scrape geo location coordinates from Google Maps using WebHarvy as shown in the above … Read more