Skip to main content

PyArrow

PyArrow↗️ is the Python API of Apache Arrow. Apache Arrow is a development platform for in-memory analytics.

Installing​

pip install pyarrow

Read parquet file and convert to pandas dataframe​

import pyarrow.parquet as pq
import pandas as pd

# read parquet file using pyarrow
pq_file = pq.read_table('filename.parquet')

# convert to pandas dataframe
pq_df = pq_file.to_pandas()