Upgrade DataFusion to arrow-rs/parquet 58.0.0 / `object_store` 0.13.0 by alamb · Pull Request #19728 · apache/datafusion

alamb · 2026-01-10T12:19:14Z

Which issue does this PR close?

Follow on to Upgrade DataFusion to arrow-rs/parquet 57.2.0 #19355
related to Release arrow-rs / parquet Major version 58.0.0 (January 2026) arrow-rs#8466
Closes [datafusion-spark] [SQL] [TEST] IntervalMonthDayNano(0,0,0) give line blank #17455

Rationale for this change

Keep datafusion up to date (and test Arrow using DataFusion tests)

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

….2.0

datafusion/sqllogictest/test_files/spark/datetime/make_interval.slt

alamb · 2026-01-10T13:42:26Z

datafusion-cli/src/main.rs

        | alltypes_plain.parquet            | 1851            | 8882                | 2    | page_index=false |
-        | alltypes_tiny_pages.parquet       | 454233          | 269266              | 2    | page_index=true  |
-        | lz4_raw_compressed_larger.parquet | 380836          | 1347                | 2    | page_index=false |
+        | alltypes_tiny_pages.parquet       | 454233          | 269074              | 2    | page_index=true  |


I think this reduction in metadata size is a direct consequence of @WaterWhisperer's PR to improve PageEncoding representation

feat: change default behavior for Parquet PageEncodingStats to bitmask arrow-rs#9051

Dandandan · 2026-01-10T14:18:49Z

Run benchmarks

alamb · 2026-02-26T14:11:06Z

run benchmarks

alamb-ghbot · 2026-02-26T14:11:14Z

🤖 ./gh_compare_branch.sh gh_compare_branch.sh Running
Linux aal-dev 6.14.0-1018-gcp #19~24.04.1-Ubuntu SMP Wed Sep 24 23:23:09 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow_58 (f00edb3) to a026e7d diff using: tpch_mem clickbench_partitioned clickbench_extended
Results will be posted here when complete

alamb-ghbot · 2026-02-26T14:52:57Z

🤖: Benchmark completed

Details

Comparing HEAD and alamb_update_arrow_58
--------------------
Benchmark clickbench_extended.json
--------------------
┏━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query    ┃        HEAD ┃ alamb_update_arrow_58 ┃        Change ┃
┡━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 0 │  2305.49 ms │            2335.05 ms │     no change │
│ QQuery 1 │   913.36 ms │             899.55 ms │     no change │
│ QQuery 2 │  1731.08 ms │            1797.03 ms │     no change │
│ QQuery 3 │  1035.10 ms │            1020.72 ms │     no change │
│ QQuery 4 │  2167.60 ms │            2158.30 ms │     no change │
│ QQuery 5 │ 28038.29 ms │           26508.20 ms │ +1.06x faster │
│ QQuery 6 │  3705.82 ms │            3823.35 ms │     no change │
│ QQuery 7 │  2780.45 ms │            2672.16 ms │     no change │
└──────────┴─────────────┴───────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 42677.19ms │
│ Total Time (alamb_update_arrow_58)   │ 41214.35ms │
│ Average Time (HEAD)                  │  5334.65ms │
│ Average Time (alamb_update_arrow_58) │  5151.79ms │
│ Queries Faster                       │          1 │
│ Queries Slower                       │          0 │
│ Queries with No Change               │          7 │
│ Queries with Failure                 │          0 │
└──────────────────────────────────────┴────────────┘
--------------------
Benchmark clickbench_partitioned.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃        HEAD ┃ alamb_update_arrow_58 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 0  │     3.58 ms │               2.67 ms │ +1.34x faster │
│ QQuery 1  │    56.01 ms │              46.98 ms │ +1.19x faster │
│ QQuery 2  │   146.74 ms │             150.97 ms │     no change │
│ QQuery 3  │   181.85 ms │             163.79 ms │ +1.11x faster │
│ QQuery 4  │  1230.50 ms │            1058.61 ms │ +1.16x faster │
│ QQuery 5  │  1495.23 ms │            1295.50 ms │ +1.15x faster │
│ QQuery 6  │     8.90 ms │               6.40 ms │ +1.39x faster │
│ QQuery 7  │    64.20 ms │              52.05 ms │ +1.23x faster │
│ QQuery 8  │  1688.95 ms │            1455.01 ms │ +1.16x faster │
│ QQuery 9  │  2463.55 ms │            1852.05 ms │ +1.33x faster │
│ QQuery 10 │   409.52 ms │             342.15 ms │ +1.20x faster │
│ QQuery 11 │   499.91 ms │             380.66 ms │ +1.31x faster │
│ QQuery 12 │  1532.39 ms │            1228.88 ms │ +1.25x faster │
│ QQuery 13 │  2486.47 ms │            1903.70 ms │ +1.31x faster │
│ QQuery 14 │  1615.93 ms │            1226.76 ms │ +1.32x faster │
│ QQuery 15 │  1550.55 ms │            1209.90 ms │ +1.28x faster │
│ QQuery 16 │  3241.70 ms │            2454.13 ms │ +1.32x faster │
│ QQuery 17 │  3263.57 ms │            2422.09 ms │ +1.35x faster │
│ QQuery 18 │  7181.83 ms │            4636.92 ms │ +1.55x faster │
│ QQuery 19 │   151.15 ms │             120.53 ms │ +1.25x faster │
│ QQuery 20 │  2246.24 ms │            1797.45 ms │ +1.25x faster │
│ QQuery 21 │  2562.12 ms │            2086.47 ms │ +1.23x faster │
│ QQuery 22 │  4279.48 ms │            3581.94 ms │ +1.19x faster │
│ QQuery 23 │ 11745.33 ms │           11572.02 ms │     no change │
│ QQuery 24 │   202.32 ms │             188.30 ms │ +1.07x faster │
│ QQuery 25 │   447.86 ms │             432.71 ms │     no change │
│ QQuery 26 │   196.72 ms │             194.88 ms │     no change │
│ QQuery 27 │  2588.46 ms │            2626.82 ms │     no change │
│ QQuery 28 │ 23642.54 ms │           23518.84 ms │     no change │
│ QQuery 29 │   950.99 ms │             995.23 ms │     no change │
│ QQuery 30 │  1241.88 ms │            1255.66 ms │     no change │
│ QQuery 31 │  1323.18 ms │            1285.76 ms │     no change │
│ QQuery 32 │  4624.51 ms │            4858.34 ms │  1.05x slower │
│ QQuery 33 │  5384.60 ms │            5284.55 ms │     no change │
│ QQuery 34 │  5655.88 ms │            5896.07 ms │     no change │
│ QQuery 35 │  1850.70 ms │            1887.79 ms │     no change │
│ QQuery 36 │   187.08 ms │             188.15 ms │     no change │
│ QQuery 37 │    73.97 ms │              73.10 ms │     no change │
│ QQuery 38 │   112.04 ms │             115.35 ms │     no change │
│ QQuery 39 │   343.74 ms │             343.20 ms │     no change │
│ QQuery 40 │    37.90 ms │              41.32 ms │  1.09x slower │
│ QQuery 41 │    33.28 ms │              35.55 ms │  1.07x slower │
│ QQuery 42 │    30.36 ms │              31.36 ms │     no change │
└───────────┴─────────────┴───────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 99033.71ms │
│ Total Time (alamb_update_arrow_58)   │ 90300.61ms │
│ Average Time (HEAD)                  │  2303.11ms │
│ Average Time (alamb_update_arrow_58) │  2100.01ms │
│ Queries Faster                       │         23 │
│ Queries Slower                       │          3 │
│ Queries with No Change               │         17 │
│ Queries with Failure                 │          0 │
└──────────────────────────────────────┴────────────┘
--------------------
Benchmark tpch_mem_sf1.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃      HEAD ┃ alamb_update_arrow_58 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 1  │ 114.06 ms │             115.01 ms │     no change │
│ QQuery 2  │  40.69 ms │              36.07 ms │ +1.13x faster │
│ QQuery 3  │  49.89 ms │              46.77 ms │ +1.07x faster │
│ QQuery 4  │  36.62 ms │              35.69 ms │     no change │
│ QQuery 5  │ 113.33 ms │              99.82 ms │ +1.14x faster │
│ QQuery 6  │  25.46 ms │              22.98 ms │ +1.11x faster │
│ QQuery 7  │ 199.33 ms │             173.89 ms │ +1.15x faster │
│ QQuery 8  │  50.88 ms │              45.26 ms │ +1.12x faster │
│ QQuery 9  │ 148.73 ms │             124.15 ms │ +1.20x faster │
│ QQuery 10 │  89.74 ms │              78.50 ms │ +1.14x faster │
│ QQuery 11 │  22.93 ms │              22.01 ms │     no change │
│ QQuery 12 │  60.87 ms │              61.74 ms │     no change │
│ QQuery 13 │  62.06 ms │              61.47 ms │     no change │
│ QQuery 14 │  18.67 ms │              17.93 ms │     no change │
│ QQuery 15 │  37.12 ms │              36.09 ms │     no change │
│ QQuery 16 │  33.07 ms │              31.56 ms │     no change │
│ QQuery 17 │ 179.61 ms │             202.24 ms │  1.13x slower │
│ QQuery 18 │ 346.19 ms │             351.39 ms │     no change │
│ QQuery 19 │  46.73 ms │              47.38 ms │     no change │
│ QQuery 20 │  74.34 ms │              68.41 ms │ +1.09x faster │
│ QQuery 21 │ 233.64 ms │             215.03 ms │ +1.09x faster │
│ QQuery 22 │  26.68 ms │              25.76 ms │     no change │
└───────────┴───────────┴───────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃           ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 2010.64ms │
│ Total Time (alamb_update_arrow_58)   │ 1919.18ms │
│ Average Time (HEAD)                  │   91.39ms │
│ Average Time (alamb_update_arrow_58) │   87.24ms │
│ Queries Faster                       │        10 │
│ Queries Slower                       │         1 │
│ Queries with No Change               │        11 │
│ Queries with Failure                 │         0 │
└──────────────────────────────────────┴───────────┘

alamb · 2026-02-26T16:56:07Z

run benchmarks

alamb-ghbot · 2026-02-26T16:56:16Z

🤖 ./gh_compare_branch.sh gh_compare_branch.sh Running
Linux aal-dev 6.14.0-1018-gcp #19~24.04.1-Ubuntu SMP Wed Sep 24 23:23:09 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/update_arrow_58 (f00edb3) to a026e7d diff using: tpch_mem clickbench_partitioned clickbench_extended
Results will be posted here when complete

alamb-ghbot · 2026-02-26T17:34:52Z

🤖: Benchmark completed

Details

Comparing HEAD and alamb_update_arrow_58
--------------------
Benchmark clickbench_extended.json
--------------------
┏━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┓
┃ Query    ┃        HEAD ┃ alamb_update_arrow_58 ┃       Change ┃
┡━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━┩
│ QQuery 0 │  2208.22 ms │            2266.92 ms │    no change │
│ QQuery 1 │   903.63 ms │             950.42 ms │ 1.05x slower │
│ QQuery 2 │  1795.66 ms │            1790.10 ms │    no change │
│ QQuery 3 │  1030.29 ms │            1034.72 ms │    no change │
│ QQuery 4 │  2150.60 ms │            2157.69 ms │    no change │
│ QQuery 5 │ 27985.16 ms │           26609.86 ms │    no change │
│ QQuery 6 │  3740.77 ms │            3820.19 ms │    no change │
│ QQuery 7 │  2749.54 ms │            2812.14 ms │    no change │
└──────────┴─────────────┴───────────────────────┴──────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 42563.87ms │
│ Total Time (alamb_update_arrow_58)   │ 41442.04ms │
│ Average Time (HEAD)                  │  5320.48ms │
│ Average Time (alamb_update_arrow_58) │  5180.25ms │
│ Queries Faster                       │          0 │
│ Queries Slower                       │          1 │
│ Queries with No Change               │          7 │
│ Queries with Failure                 │          0 │
└──────────────────────────────────────┴────────────┘
--------------------
Benchmark clickbench_partitioned.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃        HEAD ┃ alamb_update_arrow_58 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 0  │     2.53 ms │               2.61 ms │     no change │
│ QQuery 1  │    50.77 ms │              47.73 ms │ +1.06x faster │
│ QQuery 2  │   140.19 ms │             154.36 ms │  1.10x slower │
│ QQuery 3  │   151.08 ms │             164.03 ms │  1.09x slower │
│ QQuery 4  │   981.38 ms │            1035.64 ms │  1.06x slower │
│ QQuery 5  │  1263.88 ms │            1276.18 ms │     no change │
│ QQuery 6  │     6.39 ms │               6.69 ms │     no change │
│ QQuery 7  │    51.56 ms │              53.74 ms │     no change │
│ QQuery 8  │  1374.15 ms │            1393.23 ms │     no change │
│ QQuery 9  │  1745.40 ms │            1724.75 ms │     no change │
│ QQuery 10 │   347.15 ms │             330.37 ms │     no change │
│ QQuery 11 │   405.72 ms │             375.35 ms │ +1.08x faster │
│ QQuery 12 │  1187.93 ms │            1207.81 ms │     no change │
│ QQuery 13 │  1889.89 ms │            1839.37 ms │     no change │
│ QQuery 14 │  1196.98 ms │            1211.06 ms │     no change │
│ QQuery 15 │  1160.23 ms │            1184.76 ms │     no change │
│ QQuery 16 │  2457.04 ms │            2422.08 ms │     no change │
│ QQuery 17 │  2431.60 ms │            2420.20 ms │     no change │
│ QQuery 18 │  5542.27 ms │            4871.87 ms │ +1.14x faster │
│ QQuery 19 │   122.18 ms │             120.43 ms │     no change │
│ QQuery 20 │  1778.32 ms │            1828.13 ms │     no change │
│ QQuery 21 │  2042.64 ms │            2118.44 ms │     no change │
│ QQuery 22 │  3495.35 ms │            3575.44 ms │     no change │
│ QQuery 23 │ 11889.11 ms │           11476.97 ms │     no change │
│ QQuery 24 │   218.39 ms │             192.45 ms │ +1.13x faster │
│ QQuery 25 │   443.14 ms │             430.35 ms │     no change │
│ QQuery 26 │   193.49 ms │             191.76 ms │     no change │
│ QQuery 27 │  2565.90 ms │            2562.10 ms │     no change │
│ QQuery 28 │ 23615.98 ms │           23339.58 ms │     no change │
│ QQuery 29 │   963.06 ms │             963.92 ms │     no change │
│ QQuery 30 │  1232.91 ms │            1217.83 ms │     no change │
│ QQuery 31 │  1313.27 ms │            1301.86 ms │     no change │
│ QQuery 32 │  4628.77 ms │            4335.44 ms │ +1.07x faster │
│ QQuery 33 │  5565.10 ms │            5335.30 ms │     no change │
│ QQuery 34 │  5864.17 ms │            5644.74 ms │     no change │
│ QQuery 35 │  1869.02 ms │            1805.60 ms │     no change │
│ QQuery 36 │   186.11 ms │             186.69 ms │     no change │
│ QQuery 37 │    72.24 ms │              72.08 ms │     no change │
│ QQuery 38 │   109.39 ms │             115.35 ms │  1.05x slower │
│ QQuery 39 │   334.51 ms │             347.62 ms │     no change │
│ QQuery 40 │    40.94 ms │              39.68 ms │     no change │
│ QQuery 41 │    33.20 ms │              33.72 ms │     no change │
│ QQuery 42 │    29.17 ms │              30.66 ms │  1.05x slower │
└───────────┴─────────────┴───────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 90992.47ms │
│ Total Time (alamb_update_arrow_58)   │ 88987.95ms │
│ Average Time (HEAD)                  │  2116.10ms │
│ Average Time (alamb_update_arrow_58) │  2069.49ms │
│ Queries Faster                       │          5 │
│ Queries Slower                       │          5 │
│ Queries with No Change               │         33 │
│ Queries with Failure                 │          0 │
└──────────────────────────────────────┴────────────┘
--------------------
Benchmark tpch_mem_sf1.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃      HEAD ┃ alamb_update_arrow_58 ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 1  │ 102.30 ms │             102.19 ms │     no change │
│ QQuery 2  │  32.74 ms │              30.90 ms │ +1.06x faster │
│ QQuery 3  │  40.44 ms │              37.85 ms │ +1.07x faster │
│ QQuery 4  │  29.90 ms │              29.30 ms │     no change │
│ QQuery 5  │  88.84 ms │              80.36 ms │ +1.11x faster │
│ QQuery 6  │  21.60 ms │              20.25 ms │ +1.07x faster │
│ QQuery 7  │ 159.78 ms │             143.28 ms │ +1.12x faster │
│ QQuery 8  │  37.79 ms │              37.61 ms │     no change │
│ QQuery 9  │ 105.23 ms │              91.91 ms │ +1.15x faster │
│ QQuery 10 │  67.00 ms │              62.14 ms │ +1.08x faster │
│ QQuery 11 │  18.13 ms │              18.64 ms │     no change │
│ QQuery 12 │  51.55 ms │              54.35 ms │  1.05x slower │
│ QQuery 13 │  48.23 ms │              48.94 ms │     no change │
│ QQuery 14 │  14.56 ms │              13.81 ms │ +1.05x faster │
│ QQuery 15 │  29.66 ms │              28.58 ms │     no change │
│ QQuery 16 │  27.89 ms │              26.90 ms │     no change │
│ QQuery 17 │ 140.95 ms │             142.02 ms │     no change │
│ QQuery 18 │ 278.96 ms │             264.84 ms │ +1.05x faster │
│ QQuery 19 │  39.45 ms │              40.94 ms │     no change │
│ QQuery 20 │  57.13 ms │              55.33 ms │     no change │
│ QQuery 21 │ 195.29 ms │             183.60 ms │ +1.06x faster │
│ QQuery 22 │  22.16 ms │              22.21 ms │     no change │
└───────────┴───────────┴───────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┓
┃ Benchmark Summary                    ┃           ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━┩
│ Total Time (HEAD)                    │ 1609.60ms │
│ Total Time (alamb_update_arrow_58)   │ 1535.94ms │
│ Average Time (HEAD)                  │   73.16ms │
│ Average Time (alamb_update_arrow_58) │   69.82ms │
│ Queries Faster                       │        10 │
│ Queries Slower                       │         1 │
│ Queries with No Change               │        11 │
│ Queries with Failure                 │         0 │
└──────────────────────────────────────┴───────────┘

mbutrovich

Just a small question. Thanks for doing the heavy lifting on this update, @alamb!

datafusion/spark/src/function/datetime/next_day.rs

alamb · 2026-02-28T10:43:48Z

Thanks again @mbutrovich

stuhood · 2026-03-08T22:47:07Z

@alamb : According to a bisect, this change introduced some failures (on macOS arm64) for:

cargo test -p datafusion-physical-plan sort_merge_join

It looks like the merge queue ran those though, which is mysterious.

…apache#19728) ## Which issue does this PR close? - Follow on to apache#19355 - related to apache/arrow-rs#8466 - Closes apache#17455 ## Rationale for this change Keep datafusion up to date (and test Arrow using DataFusion tests) ## What changes are included in this PR?  ## Are these changes tested?  ## Are there any user-facing changes?   --------- Co-authored-by: Daniël Heres <danielheres@gmail.com>

alamb added 10 commits January 6, 2026 17:55

Update to pre-release arrow

120d2b0

Fix clippy due to UnionFields::new is deprecated

40a6a71

Fix real bug in test

f50b9c3

Update test for fixed issue upstream

87563d8

Update tests for new feature

4afd46f

Update tests for struct casting

70e2841

Update to latest

b29b662

Merge remote-tracking branch 'apache/main' into alamb/update_arrow_57…

6a2e631

….2.0

Merge branch 'main' into alamb/update_arrow_57.2.0

ca11966

Update to pre-release main

63a85eb

github-actions bot added sqllogictest SQL Logic Tests (.slt) common Related to common crate proto Related to proto crate functions Changes to functions implementation datasource Changes to the datasource crate physical-plan Changes to the physical-plan crate labels Jan 10, 2026

Update expected value of make_interval

277aac4

alamb commented Jan 10, 2026

View reviewed changes

datafusion/sqllogictest/test_files/spark/datetime/make_interval.slt Show resolved Hide resolved

Update expected output

bb29b0c

alamb commented Jan 10, 2026

View reviewed changes

alamb mentioned this pull request Jan 10, 2026

feat: change default behavior for Parquet PageEncodingStats to bitmask apache/arrow-rs#9051

Merged

Update to latest arrow

35b97fa

alamb mentioned this pull request Jan 10, 2026

fix: liberal parsing of zero scale decimals apache/arrow-rs#8700

Merged

This comment has been minimized.

Sign in to view

This comment was marked as outdated.

Sign in to view

This comment has been minimized.

Sign in to view

alamb added 2 commits February 26, 2026 07:02

Merge branch 'main' into alamb/update_arrow_58

258251a

Merge branch 'main' into alamb/update_arrow_58

f00edb3

alamb requested a review from Dandandan February 27, 2026 15:28

mbutrovich approved these changes Feb 27, 2026

View reviewed changes

datafusion/spark/src/function/datetime/next_day.rs Show resolved Hide resolved

Merge branch 'main' into alamb/update_arrow_58

f12d5cd

alamb added this pull request to the merge queue Feb 28, 2026

Merged via the queue into apache:main with commit 73fbd48 Feb 28, 2026
32 checks passed

alamb deleted the alamb/update_arrow_58 branch February 28, 2026 10:45

sdf-jkl mentioned this pull request Feb 28, 2026

Clean up date_part preimage implementation #20350

Merged

nuno-faria mentioned this pull request Feb 28, 2026

Release DataFusion 53.0.0 (Feb 2026 / Mar 2026) #19692

Closed

26 tasks

if0ne mentioned this pull request Mar 2, 2026

feat(rust/core): add async traits apache/arrow-adbc#4014

Draft

stuhood mentioned this pull request Mar 9, 2026

Debug assertions currently failing on main #20831

Closed

Conversation

alamb commented Jan 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Which issue does this PR close?

Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

Uh oh!

Uh oh!

alamb Jan 10, 2026

Choose a reason for hiding this comment

Uh oh!

Dandandan commented Jan 10, 2026

Uh oh!

This comment has been minimized.

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

alamb commented Feb 26, 2026

Uh oh!

alamb-ghbot commented Feb 26, 2026

Uh oh!

alamb-ghbot commented Feb 26, 2026

Uh oh!

alamb commented Feb 26, 2026

Uh oh!

alamb-ghbot commented Feb 26, 2026

Uh oh!

alamb-ghbot commented Feb 26, 2026

Uh oh!

mbutrovich left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

alamb commented Feb 28, 2026

Uh oh!

Uh oh!

stuhood commented Mar 8, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants

alamb commented Jan 10, 2026 •

edited

Loading

stuhood commented Mar 8, 2026 •

edited

Loading