Questions tagged [parquet]

Apache Parquet is a columnar storage format available to any project in the Hadoop ecosystem, regardless of the choice of data processing framework, data model or programming language.

Filter by
Sorted by
Tagged with
3
votes
0answers
36 views

Optimizing throughput when writing millions of rows with Parquet's row group

I'm building a basic data pipeline in .NET to extract data from tables in our RDBMS systems, that exports into columnar storage using Parquet. I'm using Parquet's row group to batch up the writes into ...