Combining 1000 csv files with Python

Are you ready to take your data wrangling skills to the next level? Learn how to easily combine 2000 CSV's in Python.

Learn

Data Cleaning

Before you start modeling, you need to get your model in the right format...More

Experience

James Anthony Phoenix

Data Engineer | Full Stack Developer
Logo
Logo
💪 Useful 0
😓 Difficult 0
🎉 Fun 0
😴 Boring 0
🚨 Errors 0
😕 Confusing 0
🤓 Interesting 0
Premium subscription required.
Python experience recommended.
1. Scenario
GOOLYBIB OFFICES – WEEKLY MARKETING MEETING
The content team is keen to review several months of reporting. However the data is spread across into multiple .csv files and it would take a very long time to manually merge them.
Gustav Gieger
at GoolyBib

We have tons of content marketing data but it's all in separate csv files.

Please would you be able to automatically merge them so that we can review the data?

This course is a work of fiction. Unless otherwise indicated, all the names, characters, businesses, data, places, events and incidents in this course are either the product of the author's imagination or used in a fictitious manner. Any resemblance to actual persons, living or dead, or actual events is purely coincidental.

2. Brief

The benefit of automatically merging CSV files with pandas is that it can save time and effort. By using pandas, you can quickly and easily combine data from multiple CSV files into a single data frame. This makes it easier to analyze and visualize the data, as well as allowing you to quickly make changes to the data set. Additionally, many pandas functions are optimized to work with CSV files, making them a great choice for working with this type of data.

3. Tutorial

0:00 Alright, so the boss has just sent us a bunch of CSVs and we've got over a thousand CSVs inside of this data folder.

CSV File Merge.ipynb
Download
4. Exercises
5. Certificate

Share This Course