WebHarvy Articles

General

What is Web Scraping ?

Practical uses of a Web Scraper

Advantages of using WebHarvy for Web Scraping

Is Web Scraping Legal ?

Proxy Server Recommendations for Web Scraping

How to choose a Web Scraping software ?

Best Web Scraping Software and Services

Various ways to scrape data from websites

How to ?

All How Tos

How to anonymously scrape data?

How to scrape data from websites which require login?

How to scrape data displayed within frames?

Scrape data from pages which load more data via auto scroll / 'show more data' - manual 2 stage solution

How to scrape large amounts of data?

How to scrape data displayed in table/grid format?

How to scrape multiple categories within a website?

How to scrape multiple (product) images from (eCommerce) websites?

How to scrape data from a list of URLs?

How to write your own web scraper using Puppeteer?

How to capture screenshots of web pages?

Case Studies

Yellow Pages

Scraping data from Yellow Pages

Scraping business location (map coordinates) from Yellow Pages

Scraping email addresses and phone numbers from Yellow Pages

Scraping Yellow Pages Australia (www.yellowpages.com.au)

Scraping paginasamarillas.es - Spanish Yellow Pages

Amazon

Web Scraping Amazon

How to scrape product data from Amazon ?

Scraping multiple product images from Amazon listings

Extracting Amazon product reviews and ratings

Scraping Amazon Best Sellers List

Scraping Amazon product details for a list of ASINs

E-commerce

Product data scraping from eBay listings

Web Scraping Home Depot Product Data

How to scrape Target.com product data?

Scraping Shopee Product Data

Alibaba / AliExpress

Scraping Product Data from AliExpress

Alibaba Product Data Scraping

Real Estate / Zillow

Scraping Real Estate Websites

Zillow : How to scrape all 40 property listing details per page?

Scraping Zillow Real Estate Data

How to scrape Trulia real estate listings?

Scraping Realtor.com Real Estate Listings

Generate Real Estate Leads using Web Scraping

How to scrape phone numbers of real estate agents on Zillow ?

How to scrape property listings for a list of Zip codes in Zillow ?

How to scrape pricing history of properties listed on Zillow ?

Scrape LandWatch Property Listings Data

TripAdvisor

How to scrape TripAdvisor Hotels & Restaurants data ?

Scraping TripAdvisor Hotels, Reviews, Forums

How to scrape TripAdvisor Reviews ?

How to scrape email addresses from TripAdvisor ?

Sports Betting and Analytics

Scraping Sports Betting Odds - Sports Analytics

How to scrape football live scores?

Scraping OddsPortal using WebHarvy

Scraping BetExplorer

Scraping live scores and betting odds from FlashScore

Scraping FlashScore Opening/Closing Odds

Scraping League Match Statistics from FlashScore

Scraping WhoScored.com Live Scores

Scraping Transfermarkt with No Code

Scraping Football Statistics from FootyStats.org

Google

Scraping Product Data from Google Shopping

How to Scrape Google Maps Data?

Scraping YouTube Video Details

Scraping YouTube comments

Scraping location coordinates (latitude/longitude) of businesses from Google Maps

How to scrape Google Jobs?

How to scrape Google News?

Scraping Chrome Web Store

Scraping Google Play App Reviews

Web Scraping translations of a website using Google Translate

Scraping Google Hotels Search Results

Job Websites

Scrape Indeed Job Postings Data

How to scrape Dice.com Job Postings?

Web Scrape Jooble Job Listings Data

How to scrape Google Jobs?

How to scrape Glassdoor reviews?

Web Scrape Monster Job Listings

Others

How to use web scraping to get training data for Machine Learning projects?

Scraping Yelp restaurant reviews

How to Scrape Instagram Images?

Scraping Crypto Currency Prices

Scraping NFT Market Data

Scraping News Articles and Press Releases

Scraping Medical and Scientific articles - Author Names and Emails

Scraping Crunchbase Company Data

Scrape Tweets from Twitter / X

How to Scrape LinkedIn Profile Data?