Linux, Shell, VIM and more

Importing Different Types of Data Files in Python Using Pandas(Part 01)

Nabin Oli's photo
Nabin Oli
·

2 min read

Python, with its powerful data manipulation and analysis library called Pandas, is a popular choice for working with diverse types of data files. Pandas provide convenient functions to read and import various file formats, making it an excellent tool for data processing and analysis. In this blog post, we'll explore how to import different types of data files using Pandas.

Table of Contents

  1. CSV (Comma-Separated Values) Files

  2. Excel Files (.xlsx, .xls)

  3. JSON (JavaScript Object Notation) Files

  4. Text Files (TXT)

  5. HTML Data

  6. HDF (Hierarchical Data Format) Files

1. CSV (Comma-Separated Values) Files

CSV files are one of the most common and versatile formats for storing tabular data. Pandas provides a simple method, read_csv(), to read CSV files into a data frame.

import pandas as pd

# Reading a CSV file into a DataFrame
df = pd.read_csv('path_to_csv_file.csv')

2. Excel Files (.xlsx, .xls)

To read Excel files, Pandas offers the read_excel() function. You can specify the sheet name or index to read the data from a particular sheet.

# Reading an Excel file into a DataFrame
df = pd.read_excel('path_to_excel_file.xlsx', sheet_name='Sheet1')

3. JSON (JavaScript Object Notation) Files

JSON files are often used to store semi-structured or nested data. Pandas support reading JSON data using read_json().

# Reading a JSON file into a DataFrame
df = pd.read_json('path_to_json_file.json')

4. Text Files (TXT)

Pandas allow you to read text files with fixed or variable delimiters using read_table().

# Reading a text file with a specific delimiter into a DataFrame
df = pd.read_table('path_to_text_file.txt', delimiter=';')

5. HTML Data

To scrape tables from HTML pages, you can use the read_html() function.

# Reading HTML tables into a list of DataFrames
dfs = pd.read_html('https://example.com/page_with_table.html')

# Accessing the DataFrame from the list (if more than one table)
df = dfs[0]

6. HDF (Hierarchical Data Format) Files

HDF is a file format to store and organize large amounts of numerical data. Pandas support HDF5 format using read_hdf().

# Reading an HDF5 file into a DataFrame
df = pd.read_hdf('path_to_hdf_file.h5', key='data')

In this blog post, we've explored how to import various types of data files using Pandas, a versatile and efficient library for data analysis in Python. With these techniques, you can efficiently read and work with different types of data, paving the way for insightful analysis and meaningful insights. Happy data processing!