conbench-apache-arrow / Conbench performance report
succeeded
Apr 2, 2025 in 0s
Found 0 regressions
After merging your PR, Conbench analyzed the 4 benchmarking runs that have been run so far on merge-commit 6452194.
Benchmarks with performance regressions
There were 0 possible performance regressions, according to the lookback z-score method.
All benchmark runs analyzed:
- Commit Run on
arm64-t4g-2xlarge-linuxat 2025-04-02 11:12:14Z - Commit Run on
amd64-c6a-4xlarge-linuxat 2025-04-02 10:48:24Z - Commit Run on
test-mac-armat 2025-04-02 11:27:16Z - Commit Run on
amd64-m5-4xlarge-linuxat 2025-04-02 15:49:13Z
Unstable benchmarks with performance regressions
The following benchmark results indicate a possible performance regression, but are known to sometimes produce false positives when applying the lookback z-score analysis.
-
Commit Run on
arm64-t4g-2xlarge-linuxat 2025-04-02 11:12:14Z -
Commit Run on
test-mac-armat 2025-04-02 11:27:16ZValueCountsDictionaryChunks(C++) with params=7, source=cpp-micro, suite=arrow-compute-vector-hash-benchmarkFilterOverheadIsolated(C++) with params=ref_only_expression/batch_size:1000000/null_prob:0/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead(C++) with params=not_null_to_is_true_multipass_benchmark/batch_size:100000/null_prob:75/bool_true_prob:100/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkFilterOverhead(C++) with params=not_null_to_is_true_multipass_benchmark/batch_size:1000/null_prob:0/bool_true_prob:25/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmark
-
Commit Run on
amd64-m5-4xlarge-linuxat 2025-04-02 15:49:13ZArrayRankStringNarrow(C++) with params=32768/1/tiebreaker:3, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkFilterInt64FilterWithNulls(C++) with params=1048576/9, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkFilterFixedSizeBinaryFilterWithNulls(C++) with params=1048576/9/8, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkArraySortIndicesBool(C++) with params=32768/100, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkFilterFixedSizeBinaryFilterWithNulls(C++) with params=1048576/12/9, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkArrayArrayKernel(C++) with params=<SubtractChecked, UInt8Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayRankStringNarrow(C++) with params=32768/1/tiebreaker:2, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkBM_DeltaLengthEncodingByteArray(C++) with params=max-string-length:8/batch-size:2048, source=cpp-micro, suite=parquet-encoding-benchmarkBenchmarkTemporalBinary(C++) with params=<MonthDayNanoBetween, time32_type>/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkFilterFixedSizeBinaryFilterNoNulls(C++) with params=1048576/10/8, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkFilterInt64FilterWithNulls(C++) with params=1048576/12, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkFilterInt64FilterWithNulls(C++) with params=1048576/13, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkFilterFSLInt64FilterWithNulls(C++) with params=1048576/3, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkArraySortIndicesBool(C++) with params=32768/10000, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkFilterInt64FilterNoNulls(C++) with params=1048576/10, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkIndexInInt64SmallSet(C++) with params=4, source=cpp-micro, suite=arrow-compute-scalar-set-lookup-benchmarkArrayRankInt64Wide(C++) with params=32768/1/tiebreaker:3, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkArraySortIndicesBool(C++) with params=32768/10, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkArraySortIndicesBool(C++) with params=32768/2, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkFilterFixedSizeBinaryFilterWithNulls(C++) with params=1048576/12/8, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkArrayArrayKernel(C++) with params=<SubtractChecked, UInt64Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayArrayKernel(C++) with params=<SubtractChecked, Int16Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkFilterFixedSizeBinaryFilterWithNulls(C++) with params=1048576/9/9, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkArraySortIndicesInt64Narrow(C++) with params=1048576/100, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkIsInInt8SmallSet(C++) with params=4, source=cpp-micro, suite=arrow-compute-scalar-set-lookup-benchmarkIsInInt8SmallSet(C++) with params=2, source=cpp-micro, suite=arrow-compute-scalar-set-lookup-benchmarkArrayArrayKernel(C++) with params=<SubtractChecked, Int8Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkReferenceStreamingCompression(C++) with params=Compression::ZSTD, source=cpp-micro, suite=arrow-compression-benchmarkArrayArrayKernel(C++) with params=<SubtractChecked, UInt32Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayArrayKernel(C++) with params=<AddChecked, UInt8Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkFilterFixedSizeBinaryFilterWithNulls(C++) with params=1048576/10/8, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkArrayArrayKernel(C++) with params=<SubtractChecked, Int32Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayRankInt64Wide(C++) with params=32768/1/tiebreaker:2, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkArrayArrayKernel(C++) with params=<SubtractChecked, UInt16Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkFilterFSLInt64FilterNoNulls(C++) with params=1048576/9, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkArrayArrayKernel(C++) with params=<SubtractChecked, Int64Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkFilterInt64FilterNoNulls(C++) with params=1048576/13, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkFilterFixedSizeBinaryFilterWithNulls(C++) with params=1048576/13/8, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkArraySortIndicesInt64Narrow(C++) with params=32768/100, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkFilterFixedSizeBinaryFilterNoNulls(C++) with params=1048576/13/8, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkFilterFSLInt64FilterWithNulls(C++) with params=1048576/4, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkFilterInt64FilterWithNulls(C++) with params=1048576/10, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkValueCountsDictionaryChunks(C++) with params=3, source=cpp-micro, suite=arrow-compute-vector-hash-benchmark
Details
This report was generated using the lookback z-score method with a z-score threshold of 30.0.
Loading