| | YouTube Channel | KB Articles

Articles Home

Product Help

YouTube Channel

WebHarvy Blog

Proxy server recommendations for web scraping

To scrape data anonymously and to avoid getting your IP blocked by web servers, it is recommended that you use proxy servers to access internet during web scraping. Most web scraping software allow you to set proxy server addresses to be used during data extraction.

There are free as well as paid proxy servers available in the internet. Free proxies available are often slow and unreliable, and may result in missing data during data extraction. For this reason, we do not recommend using free proxies for web scraping.

The following are the proxy services which we recommend for data extraction. We have tested the following services and they work well with WebHarvy as well as other web scraping software.

Luminati is a proxy network that requires consent from its residential peers, has tight compliance procedures for its customers and serves Fortune 500 enterprises. You can easily switch between shared proxies, data-center private proxy, residential IPs and mobile IPs. IPs are available in every country, city, ASN and carrier with 99.9% uptime.

Try Luminati Proxy Network

How to setup Luminati Proxy Server Network with WebHarvy ?

Trusted Proxies

You can sign up for a free trial account with Trusted Proxies at the following link which will let you try their service for FREE with WebHarvy

Signup for Trusted Proxies Proxy Server Cloud Account for WebHarvy

Once you create a free Proxy Server Cloud trial account you will receive your proxy IP address / port number as well your account username/password. You should add the proxy server IP address/port in WebHarvy as explained at Scrape via Proxy Servers. Then, before mining you should authenticate with Trusted proxies at the web link provided in account settings details using your user name & password.

How to setup Trusted Proxies Proxy Server Cloud account with WebHarvy ?

Private Proxies provide HTTP(S) anonymous proxies which allows you to hide your computer’s IP address by entering them in your Browser or Web Scraping Software. Only private dedicated proxies from a unique pool of proxies are provided. They offer a free monthly swap option whereby you can resolve blocked proxies.

Signup for free trial of Private Proxies

Use coupon code WEBHARVY to get 25% discount for any package which you purchase from PrivateProxy.


GreenCloudVPS offer a wide range of Proxies: Semi-Dedicated Proxies and Dedicated Proxies. We have found GreenCloudVPS to be effective and better at avoiding blocking and detection while extracting data from some popular websites compared to other solutions.

Try GreenCloudVPS

Squid Proxies

Squid Proxies offers elite anonymous HTTP/HTTPS proxies, which can access websites using any popular web browser or web scraping software and support both HTTP and HTTPS web protocols. Squid proxies offer the highest level of IP anonymity with 1,000+ Mbps dedicated speeds. There are no server restrictions on the amount of bandwidth you use.

Try Squid Proxies