Upgrade DataFusion to arrow-rs/parquet 58.0.0 / object_store 0.13.0#19728
Upgrade DataFusion to arrow-rs/parquet 58.0.0 / object_store 0.13.0#19728alamb merged 64 commits intoapache:mainfrom
object_store 0.13.0#19728Conversation
| | alltypes_plain.parquet | 1851 | 8882 | 2 | page_index=false | | ||
| | alltypes_tiny_pages.parquet | 454233 | 269266 | 2 | page_index=true | | ||
| | lz4_raw_compressed_larger.parquet | 380836 | 1347 | 2 | page_index=false | | ||
| | alltypes_tiny_pages.parquet | 454233 | 269074 | 2 | page_index=true | |
There was a problem hiding this comment.
I think this reduction in metadata size is a direct consequence of @WaterWhisperer's PR to improve PageEncoding representation
|
Run benchmarks |
This comment has been minimized.
This comment has been minimized.
This comment was marked as outdated.
This comment was marked as outdated.
This comment was marked as outdated.
This comment was marked as outdated.
This comment was marked as outdated.
This comment was marked as outdated.
This comment was marked as outdated.
This comment was marked as outdated.
This comment was marked as outdated.
This comment was marked as outdated.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
|
run benchmarks |
|
🤖 |
|
🤖: Benchmark completed Details
|
|
run benchmarks |
|
🤖 |
|
🤖: Benchmark completed Details
|
mbutrovich
left a comment
There was a problem hiding this comment.
Just a small question. Thanks for doing the heavy lifting on this update, @alamb!
|
Thanks again @mbutrovich |
Which issue does this PR close?
58.0.0(January 2026) arrow-rs#8466Rationale for this change
Keep datafusion up to date (and test Arrow using DataFusion tests)
What changes are included in this PR?
Are these changes tested?
Are there any user-facing changes?