#ARROW

1 post · RSS feed · All tags

Understanding Predicate Pushdown at the Row-Group Level in Parquet with PyArrow and Python

January 19, 2020 · python · pydata · parquet · arrow · pandas

How predicate pushdown works on row group level in Apache Parquet, and how to use the row group statistics with pyarrow to read only the data you need. Read more →