Transfermarkt is one of the richest public sources of football data on the internet- player valuations, transfer histories, squad details, injury records, and performance stats for clubs across virtually every league in the world. For analysts, bettors, fantasy football enthusiasts, and researchers, this data is gold, but manually copying it from thousands of player and club pages simply isn’t practical. That’s where web scraping comes in.
In this guide, we’ll show you how to use WebHarvy, a point-and-click web scraping tool, to extract player data from Transfermarkt quickly and without writing a single line of code. Whether you need data on a handful of players or want to build a complete dataset covering entire leagues, WebHarvy’s visual selection tools make the process straightforward and repeatable.
Video Demonstration
The above video shows how WebHarvy’s easy-to-use point-and-click data selection interface can be used to effortlessly scrape player data from Transfermarkt website.
Step By Step Guide
The following are the steps which you need to follow to scrape player data from Transfermarkt.com website using WebHarvy.
Step 1: Download and Install WebHarvy
Download and install the free trial version of WebHarvy in your computer. WebHarvy is a local web scraper which runs directly from your computer. By paying a one-time license fee you can purchase the full version of WebHarvy to scrape unlimited amounts of data from any website, for life, without any limitations or recurring monthly payments.
Step 2: Load the Transfermarkt Player Listings Page within WebHarvy
Open WebHarvy and navigate to the player listings page at Transfermarkt.com website from which you need to scrape data. WebHarvy’s user interface resembles a web browser using which you can load and navigate web pages. You can click and select data from this browser interface for data extraction.
Step 3: Start Configuration and Start Selecting Data
Click on the Start button in the Home menu to Start Configuration. Now, you can click and select the data which you need for extraction. Clicking any data item (text or image) on page displays a Capture window with various options. Select the Capture Text option to capture the text of the selected item. Details like player name, age, goals, position etc. can be selected from the starting page by following this method.
Step 4: Configure Pagination
To scrape data from multiple pages, scroll down the page and click on the link to load page number 2. From the resulting Capture window, select the Set as next page link option. Know more
Step 5: Follow Links
To scrape data by following player links to load player details page, click on the first player name and select the Follow this link option from the Capture window. Wait for the player details page to load. Once loaded, you can click and select more details.
Step 6: Stop Configuration and Start Mine
Once you have selected all required data, Stop Configuration and Start Mine. You can also save the configuration so that it can be run or edited later. Saved configurations can also be scheduled for periodic data extraction (daily, weekly, monthly etc.)
The scraped data can be exported to a file or database. Various file formats and database types are supported.
Download and Try WebHarvy
You can download and try the 15 days free evaluation version of WebHarvy from our website. To get started, please follow the link below.
If you have any questions, please do not hesitate to contact us.