Skip to content

Order Scan V2 conjuncts by measured cost per rejected row - #11144

Draft
joseph-isaacs wants to merge 2 commits into
developfrom
ji/scan-v2-adaptive-conjunct-order
Draft

joseph-isaacs wants to merge 2 commits into
developfrom
ji/scan-v2-adaptive-conjunct-order

Conversation

@joseph-isaacs

Copy link
Copy Markdown
Contributor

Summary

Split out of #10964. Stacked on #11143, whose commit it includes. Review only the top commit.

Conjuncts ran in an order chosen from selectivity alone. An expensive but selective predicate, such as a string match, could therefore run before a cheap numeric filter that rejects nearly as many rows.

Changes

  • Per-file estimates of each conjunct's CPU cost per row and pass rate are shared by every chunk of the file (filter/ordering.rs).
  • Once each conjunct has 4 observations, chunks run conjuncts in order of expected cost per rejected row. The order only switches for an estimated gain of at least 10%.
  • Recent observations are weighted more heavily, and a new dynamic bound resets its conjunct's estimates.
  • One chunk in 32 swaps two neighbouring conjuncts, so a conjunct hidden by short-circuiting is still measured. Each chunk keeps the order it started with.
  • Timing runs only when a filter has more than one conjunct.

Local validation

4 vCPU cloud VM, TPC-H SF10 Vortex files, Scan V2, 2 alternating (ABBA) rounds × 5 iterations. Base-vs-base noise: +1.3% geomean, up to ±8% per query.

Engine vs develop (median / min)
DuckDB +1.6% / +0.9% (noise)

TPC-H's conjuncts are already well ordered by selectivity, so this shows no gain there. The DataFusion run is still in progress locally.

  • cargo nextest run -p vortex-layout: 747 passed, including 10 new ordering tests.
  • Pinned-nightly rustfmt --check on changed files: clean.
  • cargo clippy: not yet run.

Generated by Claude Code

joseph-isaacs and others added 2 commits November 3, 2026 11:48
Every conjunct plan was wrapped in a Filter, which compiled the predicate over all rows of the
chunk and only then applied the rows earlier conjuncts kept. A selective first conjunct
therefore saved no decoding or evaluation work for later ones. Plan conjuncts unwrapped so the
selected rows reach their leaves, and wrap only when at least half of the rows remain, where
evaluating the whole batch vectorized is cheaper than gathering it.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniB9gdaaoxAeUkYj48Q3
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Conjuncts ran in an order picked from selectivity alone, so an expensive but selective
predicate, such as a string match, could run before a cheap numeric filter that rejects
nearly as many rows. Share per-file estimates of each conjunct's CPU cost per row and pass
rate, and order chunks by expected cost per rejected row once every conjunct has a few
observations, switching only for a clear estimated gain. Recent observations are weighted
more, a new dynamic bound resets its conjunct's estimates, and an occasional chunk swaps two
neighbours so a conjunct hidden by short-circuiting is still measured. Chunks keep the order
they started with.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniB9gdaaoxAeUkYj48Q3
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added changelog/performance A performance improvement action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Nov 3, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 3, 2026
@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 0e95e7b fineweb 1 Explore Profiling Data
🟢 Done 0e95e7b tpch-nvme-10 1 Explore Profiling Data
🟢 Done 0e95e7b clickbench-nvme 1 Explore Profiling Data
🟢 Done 0e95e7b tpch-s3 1 Explore Profiling Data
🟢 Done 0e95e7b polarsignals 1 Explore Profiling Data
🟢 Done 0e95e7b tpch-nvme 1 Explore Profiling Data
🟢 Done 0e95e7b tpcds-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 0e95e7b8 vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Engines: DataFusion No clear signal (-2.1%, low confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 0.989x ➖ · cold 1.000x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.003x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.979x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15490977 / 16263915 / -4.8% 43772169 / 44263199 / -1.1% 0.35 / 0.37 / -3.7%
tpch_q02/datafusion:vortex-file-compressed 16494278 / 16894974 / -2.4% 34984622 / 36611616 / -4.4% 0.47 / 0.46 / +2.2%
tpch_q03/datafusion:vortex-file-compressed 19608820 / 19527766 / +0.4% 48378089 / 49847443 / -2.9% 0.41 / 0.39 / +3.5%
tpch_q04/datafusion:vortex-file-compressed 9919292 / 10188611 / -2.6% 37156830 / 35817404 / +3.7% 0.27 / 0.28 / -6.2%
tpch_q05/datafusion:vortex-file-compressed 36967566 / 37541382 / -1.5% 66373955 / 67849249 / -2.2% 0.56 / 0.55 / +0.7%
tpch_q06/datafusion:vortex-file-compressed 4381496 / 5955274 / -26.4% 🟢 29720826 / 28481717 / +4.4% 0.15 / 0.21 / -29.5%
tpch_q07/datafusion:vortex-file-compressed 51137302 / 51398304 / -0.5% 83388900 / 82045194 / +1.6% 0.61 / 0.63 / -2.1%
tpch_q08/datafusion:vortex-file-compressed 52056641 / 51875388 / +0.3% 77146032 / 80701452 / -4.4% 0.67 / 0.64 / +5.0%
tpch_q09/datafusion:vortex-file-compressed 47746039 / 47995869 / -0.5% 79400343 / 80826300 / -1.8% 0.60 / 0.59 / +1.3%
tpch_q10/datafusion:vortex-file-compressed 17485365 / 17741482 / -1.4% 50278415 / 53082340 / -5.3% 0.35 / 0.33 / +4.1%
tpch_q11/datafusion:vortex-file-compressed 14113916 / 14031627 / +0.6% 34229794 / 33512469 / +2.1% 0.41 / 0.42 / -1.5%
tpch_q12/datafusion:vortex-file-compressed 18830050 / 18328359 / +2.7% 45003131 / 45157861 / -0.3% 0.42 / 0.41 / +3.1%
tpch_q13/datafusion:vortex-file-compressed 19732467 / 19616934 / +0.6% 40151108 / 38185157 / +5.1% 0.49 / 0.51 / -4.3%
tpch_q14/datafusion:vortex-file-compressed 14415651 / 14594152 / -1.2% 36752984 / 39735581 / -7.5% 0.39 / 0.37 / +6.8%
tpch_q15/datafusion:vortex-file-compressed 18637963 / 18763971 / -0.7% 42624308 / 43533246 / -2.1% 0.44 / 0.43 / +1.4%
tpch_q16/datafusion:vortex-file-compressed 18330519 / 18234276 / +0.5% 39636395 / 37635522 / +5.3% 0.46 / 0.48 / -4.5%
tpch_q17/datafusion:vortex-file-compressed 28732294 / 28378421 / +1.2% 60750106 / 61847418 / -1.8% 0.47 / 0.46 / +3.1%
tpch_q18/datafusion:vortex-file-compressed 35413687 / 35305543 / +0.3% 57822534 / 61599150 / -6.1% 0.61 / 0.57 / +6.9%
tpch_q19/datafusion:vortex-file-compressed 11415748 / 11827307 / -3.5% 39142022 / 35891404 / +9.1% 0.29 / 0.33 / -11.5%
tpch_q20/datafusion:vortex-file-compressed 20095546 / 20441467 / -1.7% 44441417 / 46957425 / -5.4% 0.45 / 0.44 / +3.9%
tpch_q21/datafusion:vortex-file-compressed 38526738 / 38735030 / -0.5% 73045554 / 69895942 / +4.5% 0.53 / 0.55 / -4.8%
tpch_q22/datafusion:vortex-file-compressed 10665921 / 10820078 / -1.4% 29680547 / 29933093 / -0.8% 0.36 / 0.36 / -0.6%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71834387 / 71895679 / -0.1% 90225491 / 90101832 / +0.1% 0.80 / 0.80 / -0.2%
tpch_q02/datafusion:parquet 76008557 / 76098843 / -0.1% 93934552 / 90855700 / +3.4% 0.81 / 0.84 / -3.4%
tpch_q03/datafusion:parquet 81722379 / 81802859 / -0.1% 104881446 / 104624570 / +0.2% 0.78 / 0.78 / -0.3%
tpch_q04/datafusion:parquet 39454496 / 39443450 / +0.0% 60810678 / 56105007 / +8.4% 0.65 / 0.70 / -7.7%
tpch_q05/datafusion:parquet 110153444 / 110243073 / -0.1% 138431769 / 137233632 / +0.9% 0.80 / 0.80 / -0.9%
tpch_q06/datafusion:parquet 31348724 / 31285870 / +0.2% 49697020 / 48958203 / +1.5% 0.63 / 0.64 / -1.3%
tpch_q07/datafusion:parquet 113307597 / 112628638 / +0.6% 141543629 / 140164965 / +1.0% 0.80 / 0.80 / -0.4%
tpch_q08/datafusion:parquet 117213369 / 117365432 / -0.1% 145818972 / 144858333 / +0.7% 0.80 / 0.81 / -0.8%
tpch_q09/datafusion:parquet 136961689 / 137648335 / -0.5% 167289438 / 165675523 / +1.0% 0.82 / 0.83 / -1.5%
tpch_q10/datafusion:parquet 103208572 / 104232599 / -1.0% 130657222 / 131557659 / -0.7% 0.79 / 0.79 / -0.3%
tpch_q11/datafusion:parquet 62397813 / 61117621 / +2.1% 82136906 / 83469534 / -1.6% 0.76 / 0.73 / +3.8%
tpch_q12/datafusion:parquet 63674127 / 63935260 / -0.4% 83761462 / 85713684 / -2.3% 0.76 / 0.75 / +1.9%
tpch_q13/datafusion:parquet 143544693 / 143039529 / +0.4% 164851308 / 163205266 / +1.0% 0.87 / 0.88 / -0.6%
tpch_q14/datafusion:parquet 47454988 / 47461665 / -0.0% 70293680 / 70523444 / -0.3% 0.68 / 0.67 / +0.3%
tpch_q15/datafusion:parquet 73612133 / 73406392 / +0.3% 92424709 / 92742867 / -0.3% 0.80 / 0.79 / +0.6%
tpch_q16/datafusion:parquet 43113119 / 43563928 / -1.0% 61979261 / 63270122 / -2.0% 0.70 / 0.69 / +1.0%
tpch_q17/datafusion:parquet 122781783 / 123301020 / -0.4% 145414909 / 147211074 / -1.2% 0.84 / 0.84 / +0.8%
tpch_q18/datafusion:parquet 121039707 / 121046192 / -0.0% 142357868 / 142737474 / -0.3% 0.85 / 0.85 / +0.3%
tpch_q19/datafusion:parquet 57296515 / 57598916 / -0.5% 82552515 / 84233107 / -2.0% 0.69 / 0.68 / +1.5%
tpch_q20/datafusion:parquet 78129749 / 77933849 / +0.3% 103495541 / 103206085 / +0.3% 0.75 / 0.76 / -0.0%
tpch_q21/datafusion:parquet 113040041 / 113408807 / -0.3% 139578243 / 138663269 / +0.7% 0.81 / 0.82 / -1.0%
tpch_q22/datafusion:parquet 52067709 / 52165988 / -0.2% 67064014 / 67936274 / -1.3% 0.78 / 0.77 / +1.1%
duckdb / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9708136 / 9761332 / -0.5% 20716594 / 18912466 / +9.5% 0.47 / 0.52 / -9.2%
tpch_q02/duckdb:vortex-file-compressed 15245322 / 15133618 / +0.7% 24353235 / 25240568 / -3.5% 0.63 / 0.60 / +4.4%
tpch_q03/duckdb:vortex-file-compressed 18620381 / 18478693 / +0.8% 34053103 / 35420760 / -3.9% 0.55 / 0.52 / +4.8%
tpch_q04/duckdb:vortex-file-compressed 12459454 / 12526559 / -0.5% 27186057 / 26797289 / +1.5% 0.46 / 0.47 / -2.0%
tpch_q05/duckdb:vortex-file-compressed 19939763 / 19984330 / -0.2% 36407707 / 35135251 / +3.6% 0.55 / 0.57 / -3.7%
tpch_q06/duckdb:vortex-file-compressed 4668183 / 4707229 / -0.8% 14515932 / 14897236 / -2.6% 0.32 / 0.32 / +1.8%
tpch_q07/duckdb:vortex-file-compressed 24407355 / 24433501 / -0.1% 40921693 / 40669053 / +0.6% 0.60 / 0.60 / -0.7%
tpch_q08/duckdb:vortex-file-compressed 21391317 / 21158117 / +1.1% 37047083 / 37360088 / -0.8% 0.58 / 0.57 / +2.0%
tpch_q09/duckdb:vortex-file-compressed 22549649 / 21780886 / +3.5% 38124662 / 39377115 / -3.2% 0.59 / 0.55 / +6.9%
tpch_q10/duckdb:vortex-file-compressed 22676400 / 23061494 / -1.7% 38615039 / 40021706 / -3.5% 0.59 / 0.58 / +1.9%
tpch_q11/duckdb:vortex-file-compressed 8046929 / 8190706 / -1.8% 16995318 / 17311375 / -1.8% 0.47 / 0.47 / +0.1%
tpch_q12/duckdb:vortex-file-compressed 14586325 / 14552453 / +0.2% 26990825 / 27518794 / -1.9% 0.54 / 0.53 / +2.2%
tpch_q13/duckdb:vortex-file-compressed 19631183 / 19645042 / -0.1% 33005476 / 32940206 / +0.2% 0.59 / 0.60 / -0.3%
tpch_q14/duckdb:vortex-file-compressed 11483965 / 11380023 / +0.9% 24487244 / 24837163 / -1.4% 0.47 / 0.46 / +2.4%
tpch_q15/duckdb:vortex-file-compressed 8780061 / 8545626 / +2.7% 21684289 / 20629863 / +5.1% 0.40 / 0.41 / -2.3%
tpch_q16/duckdb:vortex-file-compressed 16430859 / 16616443 / -1.1% 23428504 / 22882070 / +2.4% 0.70 / 0.73 / -3.4%
tpch_q17/duckdb:vortex-file-compressed 12575415 / 12625912 / -0.4% 27427979 / 26443070 / +3.7% 0.46 / 0.48 / -4.0%
tpch_q18/duckdb:vortex-file-compressed 24110024 / 24532908 / -1.7% 35263544 / 34479790 / +2.3% 0.68 / 0.71 / -3.9%
tpch_q19/duckdb:vortex-file-compressed 11797023 / 12047148 / -2.1% 26871921 / 25716209 / +4.5% 0.44 / 0.47 / -6.3%
tpch_q20/duckdb:vortex-file-compressed 14438488 / 14345954 / +0.6% 30347792 / 30444524 / -0.3% 0.48 / 0.47 / +1.0%
tpch_q21/duckdb:vortex-file-compressed 37086916 / 37122052 / -0.1% 58887259 / 57121904 / +3.1% 0.63 / 0.65 / -3.1%
tpch_q22/duckdb:vortex-file-compressed 16753445 / 16816566 / -0.4% 26029919 / 25979595 / +0.2% 0.64 / 0.65 / -0.6%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47553807 / 47858045 / -0.6% 54247938 / 54404459 / -0.3% 0.88 / 0.88 / -0.3%
tpch_q02/duckdb:parquet 48096770 / 48336474 / -0.5% 55010349 / 55353685 / -0.6% 0.87 / 0.87 / +0.1%
tpch_q03/duckdb:parquet 60114973 / 60227192 / -0.2% 68580290 / 68349323 / +0.3% 0.88 / 0.88 / -0.5%
tpch_q04/duckdb:parquet 34778789 / 34720265 / +0.2% 43262870 / 43310065 / -0.1% 0.80 / 0.80 / +0.3%
tpch_q05/duckdb:parquet 66933489 / 67254941 / -0.5% 77645948 / 77626992 / +0.0% 0.86 / 0.87 / -0.5%
tpch_q06/duckdb:parquet 21716253 / 21944900 / -1.0% 27419858 / 27248080 / +0.6% 0.79 / 0.81 / -1.7%
tpch_q07/duckdb:parquet 63562237 / 63950143 / -0.6% 73642315 / 73664982 / -0.0% 0.86 / 0.87 / -0.6%
tpch_q08/duckdb:parquet 75497399 / 75776774 / -0.4% 86967805 / 86626463 / +0.4% 0.87 / 0.87 / -0.8%
tpch_q09/duckdb:parquet 107736924 / 107707033 / +0.0% 119601348 / 119514067 / +0.1% 0.90 / 0.90 / -0.0%
tpch_q10/duckdb:parquet 105503508 / 105854709 / -0.3% 116857672 / 118365462 / -1.3% 0.90 / 0.89 / +1.0%
tpch_q11/duckdb:parquet 29322176 / 29396110 / -0.3% 34602609 / 34577937 / +0.1% 0.85 / 0.85 / -0.3%
tpch_q12/duckdb:parquet 37138681 / 37190745 / -0.1% 44184657 / 44080916 / +0.2% 0.84 / 0.84 / -0.4%
tpch_q13/duckdb:parquet 174216702 / 174943548 / -0.4% 183082974 / 181832631 / +0.7% 0.95 / 0.96 / -1.1%
tpch_q14/duckdb:parquet 42259639 / 42368298 / -0.3% 51484811 / 51640657 / -0.3% 0.82 / 0.82 / +0.0%
tpch_q15/duckdb:parquet 32558240 / 32604664 / -0.1% 41045283 / 41186217 / -0.3% 0.79 / 0.79 / +0.2%
tpch_q16/duckdb:parquet 46784041 / 47438886 / -1.4% 52745542 / 52839714 / -0.2% 0.89 / 0.90 / -1.2%
tpch_q17/duckdb:parquet 47857919 / 47948653 / -0.2% 57748009 / 56916284 / +1.5% 0.83 / 0.84 / -1.6%
tpch_q18/duckdb:parquet 73901022 / 74218067 / -0.4% 79235291 / 81836806 / -3.2% 0.93 / 0.91 / +2.8%
tpch_q19/duckdb:parquet 48872834 / 47859814 / +2.1% 60287624 / 54599501 / +10.4% 🔴 0.81 / 0.88 / -7.5%
tpch_q20/duckdb:parquet 63201428 / 63470737 / -0.4% 73604551 / 74451035 / -1.1% 0.86 / 0.85 / +0.7%
tpch_q21/duckdb:parquet 106339013 / 106811631 / -0.4% 115897766 / 115756341 / +0.1% 0.92 / 0.92 / -0.6%
tpch_q22/duckdb:parquet 50291376 / 50510487 / -0.4% 58588949 / 58832593 / -0.4% 0.86 / 0.86 / -0.0%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 0e95e7b8 vs base 246a397e
Vortex (geomean): hot 1.015x ➖ · cold 0.955x ➖


datafusion / vortex-file-compressed / ns (1.015x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 43733088 / 44174877 / -1.0% 82329722 / 83381591 / -1.3% 0.53 / 0.53 / +0.3%
polarsignals_q01/datafusion:vortex-file-compressed 68303546 / 59498684 / +14.8% 🔴 108257717 / 113392846 / -4.5% 0.63 / 0.52 / +20.2%
polarsignals_q02/datafusion:vortex-file-compressed 11914358 / 11978216 / -0.5% 42857342 / 49588551 / -13.6% 🟢 0.28 / 0.24 / +15.1%
polarsignals_q03/datafusion:vortex-file-compressed 55019350 / 54233533 / +1.4% 111395551 / 112439358 / -0.9% 0.49 / 0.48 / +2.4%
polarsignals_q04/datafusion:vortex-file-compressed 9105667 / 9157702 / -0.6% 38026559 / 40279396 / -5.6% 0.24 / 0.23 / +5.3%
polarsignals_q05/datafusion:vortex-file-compressed 11590812 / 11581688 / +0.1% 40996365 / 44512288 / -7.9% 0.28 / 0.26 / +8.7%
polarsignals_q06/datafusion:vortex-file-compressed 22775494 / 23169506 / -1.7% 51621012 / 52769004 / -2.2% 0.44 / 0.44 / +0.5%
polarsignals_q07/datafusion:vortex-file-compressed 10662583 / 10570672 / +0.9% 38456932 / 41644590 / -7.7% 0.28 / 0.25 / +9.2%
polarsignals_q08/datafusion:vortex-file-compressed 97776459 / 97258934 / +0.5% 159386610 / 150877578 / +5.6% 0.61 / 0.64 / -4.8%
polarsignals_q09/datafusion:vortex-file-compressed 9974845 / 9737686 / +2.4% 36964196 / 39267571 / -5.9% 0.27 / 0.25 / +8.8%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 0e95e7b8 vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (-0.6%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 1.003x ➖
Parquet (geomean): hot 1.001x ➖ · cold 0.998x ➖
Shifts: Parquet (control) +0.1% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21198859 / 21075930 / +0.6% 37856672 / 38638247 / -2.0% 0.56 / 0.55 / +2.7%
tpcds_q02/datafusion:vortex-file-compressed 44157120 / 44337330 / -0.4% 66691342 / 64322678 / +3.7% 0.66 / 0.69 / -3.9%
tpcds_q03/datafusion:vortex-file-compressed 11318636 / 11162676 / +1.4% 26710881 / 27874319 / -4.2% 0.42 / 0.40 / +5.8%
tpcds_q04/datafusion:vortex-file-compressed 86368778 / 86734277 / -0.4% 116888236 / 118451152 / -1.3% 0.74 / 0.73 / +0.9%
tpcds_q05/datafusion:vortex-file-compressed 56596192 / 56827797 / -0.4% 77462186 / 76114099 / +1.8% 0.73 / 0.75 / -2.1%
tpcds_q06/datafusion:vortex-file-compressed 22449480 / 22692446 / -1.1% 41742759 / 42045614 / -0.7% 0.54 / 0.54 / -0.4%
tpcds_q07/datafusion:vortex-file-compressed 28979099 / 28756891 / +0.8% 51683915 / 50270298 / +2.8% 0.56 / 0.57 / -2.0%
tpcds_q08/datafusion:vortex-file-compressed 24871567 / 24565008 / +1.2% 45310235 / 44075611 / +2.8% 0.55 / 0.56 / -1.5%
tpcds_q09/datafusion:vortex-file-compressed 20860083 / 21207415 / -1.6% 37915250 / 35851284 / +5.8% 0.55 / 0.59 / -7.0%
tpcds_q10/datafusion:vortex-file-compressed 26705378 / 27171788 / -1.7% 47748604 / 48716984 / -2.0% 0.56 / 0.56 / +0.3%
tpcds_q11/datafusion:vortex-file-compressed 52410527 / 52909560 / -0.9% 85002485 / 79987379 / +6.3% 0.62 / 0.66 / -6.8%
tpcds_q12/datafusion:vortex-file-compressed 14998828 / 14883221 / +0.8% 31333653 / 31358319 / -0.1% 0.48 / 0.47 / +0.9%
tpcds_q13/datafusion:vortex-file-compressed 31027417 / 31185554 / -0.5% 57356716 / 56269502 / +1.9% 0.54 / 0.55 / -2.4%
tpcds_q14/datafusion:vortex-file-compressed 484653638 / 489067088 / -0.9% 542251103 / 543494011 / -0.2% 0.89 / 0.90 / -0.7%
tpcds_q15/datafusion:vortex-file-compressed 12420412 / 12361730 / +0.5% 32596587 / 32624708 / -0.1% 0.38 / 0.38 / +0.6%
tpcds_q16/datafusion:vortex-file-compressed 18171692 / 18767600 / -3.2% 39394653 / 37497209 / +5.1% 0.46 / 0.50 / -7.8%
tpcds_q17/datafusion:vortex-file-compressed 53699244 / 54689321 / -1.8% 84147145 / 71444295 / +17.8% 🔴 0.64 / 0.77 / -16.6%
tpcds_q18/datafusion:vortex-file-compressed 62231246 / 62745430 / -0.8% 87937288 / 84923290 / +3.5% 0.71 / 0.74 / -4.2%
tpcds_q19/datafusion:vortex-file-compressed 16331798 / 16953830 / -3.7% 38260312 / 38328755 / -0.2% 0.43 / 0.44 / -3.5%
tpcds_q20/datafusion:vortex-file-compressed 16119298 / 15971812 / +0.9% 36456882 / 36958911 / -1.4% 0.44 / 0.43 / +2.3%
tpcds_q21/datafusion:vortex-file-compressed 15458480 / 16341850 / -5.4% 39828992 / 37152728 / +7.2% 0.39 / 0.44 / -11.8%
tpcds_q22/datafusion:vortex-file-compressed 48989316 / 49281792 / -0.6% 73909238 / 72884478 / +1.4% 0.66 / 0.68 / -2.0%
tpcds_q23/datafusion:vortex-file-compressed 69500166 / 70660138 / -1.6% 93934051 / 98187087 / -4.3% 0.74 / 0.72 / +2.8%
tpcds_q24/datafusion:vortex-file-compressed 64510156 / 64849742 / -0.5% 91105248 / 85912267 / +6.0% 0.71 / 0.75 / -6.2%
tpcds_q25/datafusion:vortex-file-compressed 43960679 / 48102446 / -8.6% 72390683 / 73606543 / -1.7% 0.61 / 0.65 / -7.1%
tpcds_q26/datafusion:vortex-file-compressed 25734490 / 25675571 / +0.2% 46238201 / 46144233 / +0.2% 0.56 / 0.56 / +0.0%
tpcds_q27/datafusion:vortex-file-compressed 58141455 / 57037719 / +1.9% 82779110 / 79256017 / +4.4% 0.70 / 0.72 / -2.4%
tpcds_q28/datafusion:vortex-file-compressed 24722734 / 24421590 / +1.2% 41596785 / 41637022 / -0.1% 0.59 / 0.59 / +1.3%
tpcds_q29/datafusion:vortex-file-compressed 53111375 / 53192800 / -0.2% 71596947 / 75657345 / -5.4% 0.74 / 0.70 / +5.5%
tpcds_q30/datafusion:vortex-file-compressed 26399762 / 25828708 / +2.2% 43703005 / 43291925 / +0.9% 0.60 / 0.60 / +1.2%
tpcds_q31/datafusion:vortex-file-compressed 58132890 / 58867606 / -1.2% 83877423 / 83455412 / +0.5% 0.69 / 0.71 / -1.7%
tpcds_q32/datafusion:vortex-file-compressed 12540318 / 12386412 / +1.2% 30062961 / 28927311 / +3.9% 0.42 / 0.43 / -2.6%
tpcds_q33/datafusion:vortex-file-compressed 27408461 / 27251526 / +0.6% 50663275 / 48738507 / +3.9% 0.54 / 0.56 / -3.2%
tpcds_q34/datafusion:vortex-file-compressed 17143220 / 17480834 / -1.9% 36739481 / 34421823 / +6.7% 0.47 / 0.51 / -8.1%
tpcds_q35/datafusion:vortex-file-compressed 30186028 / 30075320 / +0.4% 55338107 / 53053102 / +4.3% 0.55 / 0.57 / -3.8%
tpcds_q36/datafusion:vortex-file-compressed 47652656 / 46675208 / +2.1% 69893738 / 69079110 / +1.2% 0.68 / 0.68 / +0.9%
tpcds_q37/datafusion:vortex-file-compressed 12570018 / 11904318 / +5.6% 31465517 / 33415021 / -5.8% 0.40 / 0.36 / +12.1%
tpcds_q38/datafusion:vortex-file-compressed 26006523 / 25706742 / +1.2% 48002407 / 46753111 / +2.7% 0.54 / 0.55 / -1.5%
tpcds_q39/datafusion:vortex-file-compressed 65010784 / 64869784 / +0.2% 88189940 / 89570934 / -1.5% 0.74 / 0.72 / +1.8%
tpcds_q40/datafusion:vortex-file-compressed 22193099 / 23325174 / -4.9% 42049571 / 42047023 / +0.0% 0.53 / 0.55 / -4.9%
tpcds_q41/datafusion:vortex-file-compressed 20403817 / 20342688 / +0.3% 32283531 / 31695807 / +1.9% 0.63 / 0.64 / -1.5%
tpcds_q42/datafusion:vortex-file-compressed 10924882 / 10755524 / +1.6% 27624727 / 26462137 / +4.4% 0.40 / 0.41 / -2.7%
tpcds_q43/datafusion:vortex-file-compressed 12536910 / 12549322 / -0.1% 31104922 / 31280405 / -0.6% 0.40 / 0.40 / +0.5%
tpcds_q44/datafusion:vortex-file-compressed 28836600 / 28515654 / +1.1% 49817637 / 50995861 / -2.3% 0.58 / 0.56 / +3.5%
tpcds_q45/datafusion:vortex-file-compressed 15934715 / 16298120 / -2.2% 33280186 / 33457337 / -0.5% 0.48 / 0.49 / -1.7%
tpcds_q46/datafusion:vortex-file-compressed 23354446 / 23229427 / +0.5% 46371495 / 44755548 / +3.6% 0.50 / 0.52 / -3.0%
tpcds_q47/datafusion:vortex-file-compressed 74989323 / 74695810 / +0.4% 103793662 / 101833669 / +1.9% 0.72 / 0.73 / -1.5%
tpcds_q48/datafusion:vortex-file-compressed 28942576 / 28485442 / +1.6% 50250464 / 50825432 / -1.1% 0.58 / 0.56 / +2.8%
tpcds_q49/datafusion:vortex-file-compressed 56770912 / 56616678 / +0.3% 77431447 / 79193807 / -2.2% 0.73 / 0.71 / +2.6%
tpcds_q50/datafusion:vortex-file-compressed 29867986 / 30225275 / -1.2% 54361649 / 51542216 / +5.5% 0.55 / 0.59 / -6.3%
tpcds_q51/datafusion:vortex-file-compressed 64853105 / 66238316 / -2.1% 86521454 / 85961923 / +0.7% 0.75 / 0.77 / -2.7%
tpcds_q52/datafusion:vortex-file-compressed 11252398 / 11173757 / +0.7% 26397226 / 26707892 / -1.2% 0.43 / 0.42 / +1.9%
tpcds_q53/datafusion:vortex-file-compressed 17582816 / 17815272 / -1.3% 38183695 / 38592794 / -1.1% 0.46 / 0.46 / -0.2%
tpcds_q54/datafusion:vortex-file-compressed 31274410 / 31294044 / -0.1% 54336152 / 54411096 / -0.1% 0.58 / 0.58 / +0.1%
tpcds_q55/datafusion:vortex-file-compressed 10748480 / 10977064 / -2.1% 25833005 / 26445815 / -2.3% 0.42 / 0.42 / +0.2%
tpcds_q56/datafusion:vortex-file-compressed 26171245 / 26267608 / -0.4% 46397661 / 47242232 / -1.8% 0.56 / 0.56 / +1.4%
tpcds_q57/datafusion:vortex-file-compressed 62213910 / 61853212 / +0.6% 84157487 / 86088207 / -2.2% 0.74 / 0.72 / +2.9%
tpcds_q58/datafusion:vortex-file-compressed 37783670 / 38380444 / -1.6% 62795180 / 63376054 / -0.9% 0.60 / 0.61 / -0.6%
tpcds_q59/datafusion:vortex-file-compressed 29377760 / 29424571 / -0.2% 53835222 / 53366384 / +0.9% 0.55 / 0.55 / -1.0%
tpcds_q60/datafusion:vortex-file-compressed 25912782 / 25428852 / +1.9% 46109937 / 46248957 / -0.3% 0.56 / 0.55 / +2.2%
tpcds_q61/datafusion:vortex-file-compressed 21614737 / 21069785 / +2.6% 45666665 / 42650322 / +7.1% 0.47 / 0.49 / -4.2%
tpcds_q62/datafusion:vortex-file-compressed 16173917 / 16464280 / -1.8% 34110637 / 34481569 / -1.1% 0.47 / 0.48 / -0.7%
tpcds_q63/datafusion:vortex-file-compressed 17476885 / 17537600 / -0.3% 39131609 / 37514994 / +4.3% 0.45 / 0.47 / -4.5%
tpcds_q64/datafusion:vortex-file-compressed 209219730 / 209658176 / -0.2% 245793127 / 244014821 / +0.7% 0.85 / 0.86 / -0.9%
tpcds_q65/datafusion:vortex-file-compressed 72362600 / 71931186 / +0.6% 92173425 / 93293623 / -1.2% 0.79 / 0.77 / +1.8%
tpcds_q66/datafusion:vortex-file-compressed 49775689 / 50314022 / -1.1% 72713765 / 73443461 / -1.0% 0.68 / 0.69 / -0.1%
tpcds_q67/datafusion:vortex-file-compressed 50106530 / 50809885 / -1.4% 81837252 / 80439935 / +1.7% 0.61 / 0.63 / -3.1%
tpcds_q68/datafusion:vortex-file-compressed 22544242 / 22935066 / -1.7% 46701849 / 46212376 / +1.1% 0.48 / 0.50 / -2.7%
tpcds_q69/datafusion:vortex-file-compressed 24855812 / 25957220 / -4.2% 46401708 / 48199065 / -3.7% 0.54 / 0.54 / -0.5%
tpcds_q70/datafusion:vortex-file-compressed 71569576 / 70921686 / +0.9% 93255442 / 91526378 / +1.9% 0.77 / 0.77 / -1.0%
tpcds_q71/datafusion:vortex-file-compressed 18849028 / 19479654 / -3.2% 39143413 / 39385822 / -0.6% 0.48 / 0.49 / -2.6%
tpcds_q72/datafusion:vortex-file-compressed 350473220 / 349635619 / +0.2% 386513704 / 390053124 / -0.9% 0.91 / 0.90 / +1.2%
tpcds_q73/datafusion:vortex-file-compressed 16389286 / 16370256 / +0.1% 36169483 / 35825318 / +1.0% 0.45 / 0.46 / -0.8%
tpcds_q74/datafusion:vortex-file-compressed 39299166 / 40729710 / -3.5% 66615784 / 66101755 / +0.8% 0.59 / 0.62 / -4.3%
tpcds_q75/datafusion:vortex-file-compressed 136185876 / 133231577 / +2.2% 172003007 / 159508865 / +7.8% 0.79 / 0.84 / -5.2%
tpcds_q76/datafusion:vortex-file-compressed 29800266 / 29878010 / -0.3% 47647500 / 49131830 / -3.0% 0.63 / 0.61 / +2.8%
tpcds_q77/datafusion:vortex-file-compressed 44087568 / 44794824 / -1.6% 64813879 / 68725579 / -5.7% 0.68 / 0.65 / +4.4%
tpcds_q78/datafusion:vortex-file-compressed 63970643 / 64149016 / -0.3% 92898224 / 91826652 / +1.2% 0.69 / 0.70 / -1.4%
tpcds_q79/datafusion:vortex-file-compressed 19735074 / 19747138 / -0.1% 42633458 / 41330856 / +3.2% 0.46 / 0.48 / -3.1%
tpcds_q80/datafusion:vortex-file-compressed 72007523 / 73516756 / -2.1% 100852708 / 103399339 / -2.5% 0.71 / 0.71 / +0.4%
tpcds_q81/datafusion:vortex-file-compressed 26014216 / 26433507 / -1.6% 45356887 / 44049315 / +3.0% 0.57 / 0.60 / -4.4%
tpcds_q82/datafusion:vortex-file-compressed 12166126 / 12061347 / +0.9% 33986575 / 33334269 / +2.0% 0.36 / 0.36 / -1.1%
tpcds_q83/datafusion:vortex-file-compressed 32605644 / 32437804 / +0.5% 51816144 / 52048289 / -0.4% 0.63 / 0.62 / +1.0%
tpcds_q84/datafusion:vortex-file-compressed 9814926 / 10107068 / -2.9% 25179434 / 25586667 / -1.6% 0.39 / 0.40 / -1.3%
tpcds_q85/datafusion:vortex-file-compressed 53030720 / 53327322 / -0.6% 78012464 / 79919547 / -2.4% 0.68 / 0.67 / +1.9%
tpcds_q86/datafusion:vortex-file-compressed 15593594 / 15658314 / -0.4% 32062342 / 32167556 / -0.3% 0.49 / 0.49 / -0.1%
tpcds_q87/datafusion:vortex-file-compressed 25519852 / 26232334 / -2.7% 48539635 / 48269535 / +0.6% 0.53 / 0.54 / -3.3%
tpcds_q88/datafusion:vortex-file-compressed 31210736 / 31404654 / -0.6% 48797862 / 50217706 / -2.8% 0.64 / 0.63 / +2.3%
tpcds_q89/datafusion:vortex-file-compressed 20691596 / 20857143 / -0.8% 43420191 / 40998842 / +5.9% 0.48 / 0.51 / -6.3%
tpcds_q90/datafusion:vortex-file-compressed 9944773 / 9857710 / +0.9% 24142997 / 24004775 / +0.6% 0.41 / 0.41 / +0.3%
tpcds_q91/datafusion:vortex-file-compressed 16279976 / 16590985 / -1.9% 36450716 / 36406808 / +0.1% 0.45 / 0.46 / -2.0%
tpcds_q92/datafusion:vortex-file-compressed 13368838 / 12785642 / +4.6% 28275222 / 28212901 / +0.2% 0.47 / 0.45 / +4.3%
tpcds_q93/datafusion:vortex-file-compressed 20254331 / 20514612 / -1.3% 40425590 / 39172325 / +3.2% 0.50 / 0.52 / -4.3%
tpcds_q94/datafusion:vortex-file-compressed 17908008 / 18329141 / -2.3% 38206812 / 37017769 / +3.2% 0.47 / 0.50 / -5.3%
tpcds_q95/datafusion:vortex-file-compressed 41381404 / 41892583 / -1.2% 62771296 / 60792282 / +3.3% 0.66 / 0.69 / -4.3%
tpcds_q96/datafusion:vortex-file-compressed 7668438 / 7680347 / -0.2% 23986748 / 24590568 / -2.5% 0.32 / 0.31 / +2.4%
tpcds_q97/datafusion:vortex-file-compressed 16650708 / 16976546 / -1.9% 36968972 / 36962622 / +0.0% 0.45 / 0.46 / -1.9%
tpcds_q98/datafusion:vortex-file-compressed 16016744 / 16323012 / -1.9% 39055526 / 35491744 / +10.0% 🔴 0.41 / 0.46 / -10.8%
tpcds_q99/datafusion:vortex-file-compressed 15890060 / 16055726 / -1.0% 35248916 / 34645287 / +1.7% 0.45 / 0.46 / -2.7%
datafusion / parquet / ns (1.001x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 43448283 / 42790168 / +1.5% 60195949 / 57645148 / +4.4% 0.72 / 0.74 / -2.8%
tpcds_q02/datafusion:parquet 54539786 / 54765044 / -0.4% 68876320 / 70421354 / -2.2% 0.79 / 0.78 / +1.8%
tpcds_q03/datafusion:parquet 18918462 / 19097265 / -0.9% 30671567 / 30445091 / +0.7% 0.62 / 0.63 / -1.7%
tpcds_q04/datafusion:parquet 179290441 / 178887614 / +0.2% 202557445 / 202039145 / +0.3% 0.89 / 0.89 / -0.0%
tpcds_q05/datafusion:parquet 67942106 / 67878001 / +0.1% 87997473 / 89709488 / -1.9% 0.77 / 0.76 / +2.0%
tpcds_q06/datafusion:parquet 33760430 / 33778804 / -0.1% 48315527 / 45692699 / +5.7% 0.70 / 0.74 / -5.5%
tpcds_q07/datafusion:parquet 47143291 / 47393786 / -0.5% 64982302 / 65545052 / -0.9% 0.73 / 0.72 / +0.3%
tpcds_q08/datafusion:parquet 31241084 / 30786170 / +1.5% 48311509 / 43159155 / +11.9% 🔴 0.65 / 0.71 / -9.3%
tpcds_q09/datafusion:parquet 34219726 / 30591208 / +11.9% 🔴 43772830 / 42974319 / +1.9% 0.78 / 0.71 / +9.8%
tpcds_q10/datafusion:parquet 44182098 / 43909954 / +0.6% 57043884 / 58393927 / -2.3% 0.77 / 0.75 / +3.0%
tpcds_q11/datafusion:parquet 96504167 / 97359220 / -0.9% 118256130 / 119001225 / -0.6% 0.82 / 0.82 / -0.3%
tpcds_q12/datafusion:parquet 23370315 / 23515044 / -0.6% 36089773 / 34010680 / +6.1% 0.65 / 0.69 / -6.3%
tpcds_q13/datafusion:parquet 47008642 / 46313484 / +1.5% 64628469 / 68018563 / -5.0% 0.73 / 0.68 / +6.8%
tpcds_q14/datafusion:parquet 532752992 / 534683184 / -0.4% 583230981 / 582375794 / +0.1% 0.91 / 0.92 / -0.5%
tpcds_q15/datafusion:parquet 23832231 / 24175697 / -1.4% 37193544 / 36583322 / +1.7% 0.64 / 0.66 / -3.0%
tpcds_q16/datafusion:parquet 36606918 / 37052644 / -1.2% 50057097 / 49572893 / +1.0% 0.73 / 0.75 / -2.2%
tpcds_q17/datafusion:parquet 73328771 / 75207760 / -2.5% 94902211 / 98319183 / -3.5% 0.77 / 0.76 / +1.0%
tpcds_q18/datafusion:parquet 65448776 / 67278429 / -2.7% 87940655 / 89472378 / -1.7% 0.74 / 0.75 / -1.0%
tpcds_q19/datafusion:parquet 29742922 / 29426323 / +1.1% 42992317 / 42286597 / +1.7% 0.69 / 0.70 / -0.6%
tpcds_q20/datafusion:parquet 24671596 / 24728196 / -0.2% 37652799 / 35453048 / +6.2% 0.66 / 0.70 / -6.1%
tpcds_q21/datafusion:parquet 20118844 / 19988597 / +0.7% 31057985 / 33163707 / -6.3% 0.65 / 0.60 / +7.5%
tpcds_q22/datafusion:parquet 77186291 / 77207674 / -0.0% 87648955 / 87517272 / +0.2% 0.88 / 0.88 / -0.2%
tpcds_q23/datafusion:parquet 92725142 / 91103138 / +1.8% 112330813 / 115810894 / -3.0% 0.83 / 0.79 / +4.9%
tpcds_q24/datafusion:parquet 90801848 / 90312194 / +0.5% 113334862 / 114753768 / -1.2% 0.80 / 0.79 / +1.8%
tpcds_q25/datafusion:parquet 81901504 / 82183728 / -0.3% 97027665 / 101090115 / -4.0% 0.84 / 0.81 / +3.8%
tpcds_q26/datafusion:parquet 43508538 / 43975604 / -1.1% 59418011 / 60140227 / -1.2% 0.73 / 0.73 / +0.1%
tpcds_q27/datafusion:parquet 74429835 / 75256415 / -1.1% 96111788 / 96796596 / -0.7% 0.77 / 0.78 / -0.4%
tpcds_q28/datafusion:parquet 28531568 / 28282492 / +0.9% 41740590 / 40540051 / +3.0% 0.68 / 0.70 / -2.0%
tpcds_q29/datafusion:parquet 75063563 / 76327373 / -1.7% 94114737 / 95497789 / -1.4% 0.80 / 0.80 / -0.2%
tpcds_q30/datafusion:parquet 45081072 / 44172996 / +2.1% 57175146 / 56428909 / +1.3% 0.79 / 0.78 / +0.7%
tpcds_q31/datafusion:parquet 78102722 / 81059734 / -3.6% 98066824 / 97847034 / +0.2% 0.80 / 0.83 / -3.9%
tpcds_q32/datafusion:parquet 26909610 / 26106716 / +3.1% 38934575 / 38996408 / -0.2% 0.69 / 0.67 / +3.2%
tpcds_q33/datafusion:parquet 38152266 / 36632188 / +4.1% 51633226 / 51696853 / -0.1% 0.74 / 0.71 / +4.3%
tpcds_q34/datafusion:parquet 24153083 / 24283762 / -0.5% 34573507 / 35496823 / -2.6% 0.70 / 0.68 / +2.1%
tpcds_q35/datafusion:parquet 51943138 / 51092331 / +1.7% 61650133 / 63128294 / -2.3% 0.84 / 0.81 / +4.1%
tpcds_q36/datafusion:parquet 53355472 / 52133216 / +2.3% 71195128 / 73276361 / -2.8% 0.75 / 0.71 / +5.3%
tpcds_q37/datafusion:parquet 21348122 / 21186441 / +0.8% 35164782 / 32501720 / +8.2% 0.61 / 0.65 / -6.9%
tpcds_q38/datafusion:parquet 44548970 / 44473320 / +0.2% 58172679 / 60661224 / -4.1% 0.77 / 0.73 / +4.5%
tpcds_q39/datafusion:parquet 68508454 / 67893870 / +0.9% 84610233 / 85512997 / -1.1% 0.81 / 0.79 / +2.0%
tpcds_q40/datafusion:parquet 30126012 / 30116612 / +0.0% 48392045 / 50944751 / -5.0% 0.62 / 0.59 / +5.3%
tpcds_q41/datafusion:parquet 19899632 / 19875884 / +0.1% 29751041 / 30988887 / -4.0% 0.67 / 0.64 / +4.3%
tpcds_q42/datafusion:parquet 17978765 / 18263912 / -1.6% 30531622 / 31580411 / -3.3% 0.59 / 0.58 / +1.8%
tpcds_q43/datafusion:parquet 19454754 / 19328598 / +0.7% 30762564 / 32363765 / -4.9% 0.63 / 0.60 / +5.9%
tpcds_q44/datafusion:parquet 35019022 / 34729506 / +0.8% 50057704 / 49650609 / +0.8% 0.70 / 0.70 / +0.0%
tpcds_q45/datafusion:parquet 27564693 / 27674712 / -0.4% 46736472 / 40581829 / +15.2% 🔴 0.59 / 0.68 / -13.5%
tpcds_q46/datafusion:parquet 28615466 / 28849347 / -0.8% 44478156 / 44446206 / +0.1% 0.64 / 0.65 / -0.9%
tpcds_q47/datafusion:parquet 96486931 / 97767068 / -1.3% 119863529 / 116071791 / +3.3% 0.80 / 0.84 / -4.4%
tpcds_q48/datafusion:parquet 42099032 / 42223134 / -0.3% 58643110 / 58362840 / +0.5% 0.72 / 0.72 / -0.8%
tpcds_q49/datafusion:parquet 71222130 / 71584984 / -0.5% 92760303 / 93559482 / -0.9% 0.77 / 0.77 / +0.4%
tpcds_q50/datafusion:parquet 48550300 / 47188732 / +2.9% 65919572 / 65957634 / -0.1% 0.74 / 0.72 / +2.9%
tpcds_q51/datafusion:parquet 74734124 / 75687516 / -1.3% 93433221 / 93987537 / -0.6% 0.80 / 0.81 / -0.7%
tpcds_q52/datafusion:parquet 18479946 / 18477546 / +0.0% 29784792 / 30516528 / -2.4% 0.62 / 0.61 / +2.5%
tpcds_q53/datafusion:parquet 22317162 / 22069787 / +1.1% 36861886 / 37394397 / -1.4% 0.61 / 0.59 / +2.6%
tpcds_q54/datafusion:parquet 53203188 / 53068499 / +0.3% 68817669 / 66798825 / +3.0% 0.77 / 0.79 / -2.7%
tpcds_q55/datafusion:parquet 18167804 / 18177591 / -0.1% 30051030 / 29615062 / +1.5% 0.60 / 0.61 / -1.5%
tpcds_q56/datafusion:parquet 40126871 / 40536538 / -1.0% 52589866 / 51702806 / +1.7% 0.76 / 0.78 / -2.7%
tpcds_q57/datafusion:parquet 101500818 / 100992704 / +0.5% 116552851 / 119321534 / -2.3% 0.87 / 0.85 / +2.9%
tpcds_q58/datafusion:parquet 65032157 / 65003510 / +0.0% 83017538 / 81993727 / +1.2% 0.78 / 0.79 / -1.2%
tpcds_q59/datafusion:parquet 47335684 / 47142071 / +0.4% 64002409 / 64332209 / -0.5% 0.74 / 0.73 / +0.9%
tpcds_q60/datafusion:parquet 40873611 / 41143805 / -0.7% 51966716 / 56528494 / -8.1% 0.79 / 0.73 / +8.1%
tpcds_q61/datafusion:parquet 36041214 / 37070528 / -2.8% 48999550 / 50658408 / -3.3% 0.74 / 0.73 / +0.5%
tpcds_q62/datafusion:parquet 24954664 / 25299585 / -1.4% 38099632 / 37400865 / +1.9% 0.65 / 0.68 / -3.2%
tpcds_q63/datafusion:parquet 22068876 / 22137338 / -0.3% 37025613 / 37267059 / -0.6% 0.60 / 0.59 / +0.3%
tpcds_q64/datafusion:parquet 286655139 / 283491307 / +1.1% 324558681 / 324365594 / +0.1% 0.88 / 0.87 / +1.1%
tpcds_q65/datafusion:parquet 122028389 / 121796900 / +0.2% 137754817 / 140340790 / -1.8% 0.89 / 0.87 / +2.1%
tpcds_q66/datafusion:parquet 60032045 / 60159790 / -0.2% 75208235 / 74271493 / +1.3% 0.80 / 0.81 / -1.5%
tpcds_q67/datafusion:parquet 68490017 / 69200688 / -1.0% 91649932 / 92158955 / -0.6% 0.75 / 0.75 / -0.5%
tpcds_q68/datafusion:parquet 28544342 / 28638674 / -0.3% 48894967 / 47694525 / +2.5% 0.58 / 0.60 / -2.8%
tpcds_q69/datafusion:parquet 43343122 / 43345552 / -0.0% 59006315 / 54686235 / +7.9% 0.73 / 0.79 / -7.3%
tpcds_q70/datafusion:parquet 79844334 / 80271896 / -0.5% 96896025 / 100088952 / -3.2% 0.82 / 0.80 / +2.7%
tpcds_q71/datafusion:parquet 25028204 / 24373552 / +2.7% 36926264 / 38366867 / -3.8% 0.68 / 0.64 / +6.7%
tpcds_q72/datafusion:parquet 520065330 / 527329837 / -1.4% 548761089 / 560736807 / -2.1% 0.95 / 0.94 / +0.8%
tpcds_q73/datafusion:parquet 23766289 / 23675195 / +0.4% 35351680 / 35651529 / -0.8% 0.67 / 0.66 / +1.2%
tpcds_q74/datafusion:parquet 70013766 / 69750544 / +0.4% 81554379 / 88419484 / -7.8% 0.86 / 0.79 / +8.8%
tpcds_q75/datafusion:parquet 153932018 / 154280426 / -0.2% 179087650 / 175992735 / +1.8% 0.86 / 0.88 / -2.0%
tpcds_q76/datafusion:parquet 33474299 / 32552642 / +2.8% 47087925 / 46197310 / +1.9% 0.71 / 0.70 / +0.9%
tpcds_q77/datafusion:parquet 57255212 / 55912258 / +2.4% 75538621 / 75401961 / +0.2% 0.76 / 0.74 / +2.2%
tpcds_q78/datafusion:parquet 87535671 / 86298158 / +1.4% 116193628 / 119573989 / -2.8% 0.75 / 0.72 / +4.4%
tpcds_q79/datafusion:parquet 26927030 / 26941018 / -0.1% 41451008 / 41670899 / -0.5% 0.65 / 0.65 / +0.5%
tpcds_q80/datafusion:parquet 79791513 / 79571648 / +0.3% 107103405 / 107798298 / -0.6% 0.74 / 0.74 / +0.9%
tpcds_q81/datafusion:parquet 38968610 / 37708022 / +3.3% 52003340 / 49644780 / +4.8% 0.75 / 0.76 / -1.3%
tpcds_q82/datafusion:parquet 22396873 / 22862742 / -2.0% 35337441 / 35659042 / -0.9% 0.63 / 0.64 / -1.1%
tpcds_q83/datafusion:parquet 59719606 / 58728850 / +1.7% 74216048 / 73572759 / +0.9% 0.80 / 0.80 / +0.8%
tpcds_q84/datafusion:parquet 25673446 / 27588446 / -6.9% 39284186 / 37424130 / +5.0% 0.65 / 0.74 / -11.3%
tpcds_q85/datafusion:parquet 81488053 / 80037900 / +1.8% 102262178 / 103303133 / -1.0% 0.80 / 0.77 / +2.8%
tpcds_q86/datafusion:parquet 20989686 / 20803682 / +0.9% 32505754 / 32694603 / -0.6% 0.65 / 0.64 / +1.5%
tpcds_q87/datafusion:parquet 44092769 / 44953774 / -1.9% 59469561 / 58673543 / +1.4% 0.74 / 0.77 / -3.2%
tpcds_q88/datafusion:parquet 36470994 / 37194222 / -1.9% 49492647 / 51481242 / -3.9% 0.74 / 0.72 / +2.0%
tpcds_q89/datafusion:parquet 25676246 / 25767740 / -0.4% 41620902 / 40885679 / +1.8% 0.62 / 0.63 / -2.1%
tpcds_q90/datafusion:parquet 15243488 / 15051543 / +1.3% 25858690 / 27168268 / -4.8% 0.59 / 0.55 / +6.4%
tpcds_q91/datafusion:parquet 32493776 / 32426770 / +0.2% 45554182 / 45756299 / -0.4% 0.71 / 0.71 / +0.7%
tpcds_q92/datafusion:parquet 26807030 / 26788312 / +0.1% 41894483 / 39570067 / +5.9% 0.64 / 0.68 / -5.5%
tpcds_q93/datafusion:parquet 26751708 / 26826836 / -0.3% 45931172 / 45720426 / +0.5% 0.58 / 0.59 / -0.7%
tpcds_q94/datafusion:parquet 34892430 / 35612212 / -2.0% 47445717 / 47235641 / +0.4% 0.74 / 0.75 / -2.5%
tpcds_q95/datafusion:parquet 63913728 / 64407442 / -0.8% 79714517 / 79417285 / +0.4% 0.80 / 0.81 / -1.1%
tpcds_q96/datafusion:parquet 12703782 / 13109518 / -3.1% 24749522 / 25052704 / -1.2% 0.51 / 0.52 / -1.9%
tpcds_q97/datafusion:parquet 34996496 / 35212817 / -0.6% 51506762 / 51110766 / +0.8% 0.68 / 0.69 / -1.4%
tpcds_q98/datafusion:parquet 24883622 / 24928664 / -0.2% 37337672 / 36311664 / +2.8% 0.67 / 0.69 / -2.9%
tpcds_q99/datafusion:parquet 29412085 / 29956348 / -1.8% 41678951 / 41613620 / +0.2% 0.71 / 0.72 / -2.0%
duckdb / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 16020718 / 16142117 / -0.8% 25280904 / 24883739 / +1.6% 0.63 / 0.65 / -2.3%
tpcds_q02/duckdb:vortex-file-compressed 15389013 / 16709276 / -7.9% 22227879 / 22051108 / +0.8% 0.69 / 0.76 / -8.6%
tpcds_q03/duckdb:vortex-file-compressed 6956942 / 7045657 / -1.3% 15736202 / 16301596 / -3.5% 0.44 / 0.43 / +2.3%
tpcds_q04/duckdb:vortex-file-compressed 45943936 / 45758252 / +0.4% 57203169 / 56479163 / +1.3% 0.80 / 0.81 / -0.9%
tpcds_q05/duckdb:vortex-file-compressed 22772805 / 23036528 / -1.1% 33601641 / 32578849 / +3.1% 0.68 / 0.71 / -4.2%
tpcds_q06/duckdb:vortex-file-compressed 24306452 / 24423028 / -0.5% 38053235 / 38193338 / -0.4% 0.64 / 0.64 / -0.1%
tpcds_q07/duckdb:vortex-file-compressed 13617038 / 13353038 / +2.0% 24674828 / 24712568 / -0.2% 0.55 / 0.54 / +2.1%
tpcds_q08/duckdb:vortex-file-compressed 17460794 / 17520489 / -0.3% 25556287 / 25721441 / -0.6% 0.68 / 0.68 / +0.3%
tpcds_q09/duckdb:vortex-file-compressed 19207882 / 19111982 / +0.5% 28427362 / 29348465 / -3.1% 0.68 / 0.65 / +3.8%
tpcds_q10/duckdb:vortex-file-compressed 28008628 / 27612226 / +1.4% 41683124 / 40320225 / +3.4% 0.67 / 0.68 / -1.9%
tpcds_q11/duckdb:vortex-file-compressed 36760558 / 36903964 / -0.4% 46311926 / 46177346 / +0.3% 0.79 / 0.80 / -0.7%
tpcds_q12/duckdb:vortex-file-compressed 10234188 / 10200694 / +0.3% 17525864 / 17187152 / +2.0% 0.58 / 0.59 / -1.6%
tpcds_q13/duckdb:vortex-file-compressed 20649526 / 21263297 / -2.9% 33351292 / 32547269 / +2.5% 0.62 / 0.65 / -5.2%
tpcds_q14/duckdb:vortex-file-compressed 56196960 / 57809828 / -2.8% 68175331 / 68046783 / +0.2% 0.82 / 0.85 / -3.0%
tpcds_q15/duckdb:vortex-file-compressed 11009800 / 11119113 / -1.0% 18276869 / 18816176 / -2.9% 0.60 / 0.59 / +1.9%
tpcds_q16/duckdb:vortex-file-compressed 23991309 / 24266849 / -1.1% 35044656 / 34786209 / +0.7% 0.68 / 0.70 / -1.9%
tpcds_q17/duckdb:vortex-file-compressed 24427027 / 24227736 / +0.8% 34968932 / 36525117 / -4.3% 0.70 / 0.66 / +5.3%
tpcds_q18/duckdb:vortex-file-compressed 31611240 / 31509080 / +0.3% 42820195 / 41766543 / +2.5% 0.74 / 0.75 / -2.1%
tpcds_q19/duckdb:vortex-file-compressed 77934750 / 77960863 / -0.0% 88129460 / 89377861 / -1.4% 0.88 / 0.87 / +1.4%
tpcds_q20/duckdb:vortex-file-compressed 11168726 / 10971804 / +1.8% 18475920 / 17747764 / +4.1% 0.60 / 0.62 / -2.2%
tpcds_q21/duckdb:vortex-file-compressed 9744894 / 9745305 / -0.0% 22314136 / 20923879 / +6.6% 0.44 / 0.47 / -6.2%
tpcds_q22/duckdb:vortex-file-compressed 17590862 / 17585292 / +0.0% 30455297 / 29572488 / +3.0% 0.58 / 0.59 / -2.9%
tpcds_q23/duckdb:vortex-file-compressed 37836926 / 38130006 / -0.8% 50038842 / 49924896 / +0.2% 0.76 / 0.76 / -1.0%
tpcds_q24/duckdb:vortex-file-compressed 26359416 / 26574018 / -0.8% 36640144 / 36642246 / -0.0% 0.72 / 0.73 / -0.8%
tpcds_q25/duckdb:vortex-file-compressed 23506350 / 23695962 / -0.8% 35797944 / 36381968 / -1.6% 0.66 / 0.65 / +0.8%
tpcds_q26/duckdb:vortex-file-compressed 12856846 / 13100696 / -1.9% 21575362 / 21291607 / +1.3% 0.60 / 0.62 / -3.2%
tpcds_q27/duckdb:vortex-file-compressed 15826172 / 15963922 / -0.9% 25957146 / 27540444 / -5.7% 0.61 / 0.58 / +5.2%
tpcds_q28/duckdb:vortex-file-compressed 14872946 / 15588588 / -4.6% 26183696 / 26167172 / +0.1% 0.57 / 0.60 / -4.7%
tpcds_q29/duckdb:vortex-file-compressed 23122620 / 22710729 / +1.8% 34113161 / 34899355 / -2.3% 0.68 / 0.65 / +4.2%
tpcds_q30/duckdb:vortex-file-compressed 16196860 / 15872199 / +2.0% 24218695 / 24336692 / -0.5% 0.67 / 0.65 / +2.5%
tpcds_q31/duckdb:vortex-file-compressed 17703432 / 18069675 / -2.0% 26760956 / 26891648 / -0.5% 0.66 / 0.67 / -1.5%
tpcds_q32/duckdb:vortex-file-compressed 11816806 / 11623212 / +1.7% 20353561 / 20950684 / -2.9% 0.58 / 0.55 / +4.6%
tpcds_q33/duckdb:vortex-file-compressed 18640672 / 18357493 / +1.5% 28472597 / 28185569 / +1.0% 0.65 / 0.65 / +0.5%
tpcds_q34/duckdb:vortex-file-compressed 13146936 / 13014242 / +1.0% 23287320 / 23047270 / +1.0% 0.56 / 0.56 / -0.0%
tpcds_q35/duckdb:vortex-file-compressed 28178592 / 27929879 / +0.9% 39256990 / 39014716 / +0.6% 0.72 / 0.72 / +0.3%
tpcds_q36/duckdb:vortex-file-compressed 14129766 / 13908706 / +1.6% 24888194 / 23970044 / +3.8% 0.57 / 0.58 / -2.2%
tpcds_q37/duckdb:vortex-file-compressed 9491246 / 9515167 / -0.3% 24611624 / 24340830 / +1.1% 0.39 / 0.39 / -1.3%
tpcds_q38/duckdb:vortex-file-compressed 24346026 / 24300837 / +0.2% 32378629 / 32361884 / +0.1% 0.75 / 0.75 / +0.1%
tpcds_q39/duckdb:vortex-file-compressed 18586604 / 18334157 / +1.4% 29919479 / 33896858 / -11.7% 🟢 0.62 / 0.54 / +14.9%
tpcds_q40/duckdb:vortex-file-compressed 13882519 / 14107318 / -1.6% 20599662 / 20388858 / +1.0% 0.67 / 0.69 / -2.6%
tpcds_q41/duckdb:vortex-file-compressed 18860107 / 18789802 / +0.4% 25380758 / 25592058 / -0.8% 0.74 / 0.73 / +1.2%
tpcds_q42/duckdb:vortex-file-compressed 7084882 / 7115361 / -0.4% 15970726 / 16445425 / -2.9% 0.44 / 0.43 / +2.5%
tpcds_q43/duckdb:vortex-file-compressed 9765465 / 9847942 / -0.8% 19106811 / 19094789 / +0.1% 0.51 / 0.52 / -0.9%
tpcds_q44/duckdb:vortex-file-compressed 12609074 / 12546484 / +0.5% 24139772 / 24279354 / -0.6% 0.52 / 0.52 / +1.1%
tpcds_q45/duckdb:vortex-file-compressed 23252090 / 23264362 / -0.1% 29808167 / 31280867 / -4.7% 0.78 / 0.74 / +4.9%
tpcds_q46/duckdb:vortex-file-compressed 19466504 / 19680982 / -1.1% 27694199 / 27352411 / +1.2% 0.70 / 0.72 / -2.3%
tpcds_q47/duckdb:vortex-file-compressed 34404430 / 34836730 / -1.2% 44769056 / 45045037 / -0.6% 0.77 / 0.77 / -0.6%
tpcds_q48/duckdb:vortex-file-compressed 23360462 / 23197005 / +0.7% 35738726 / 36376826 / -1.8% 0.65 / 0.64 / +2.5%
tpcds_q49/duckdb:vortex-file-compressed 18965511 / 18947468 / +0.1% 31286384 / 31460092 / -0.6% 0.61 / 0.60 / +0.7%
tpcds_q50/duckdb:vortex-file-compressed 16807354 / 16868396 / -0.4% 27061358 / 27316563 / -0.9% 0.62 / 0.62 / +0.6%
tpcds_q51/duckdb:vortex-file-compressed 48779346 / 48747450 / +0.1% 59179295 / 76407317 / -22.5% 🟢 0.82 / 0.64 / +29.2%
tpcds_q52/duckdb:vortex-file-compressed 7147140 / 7223788 / -1.1% 16449383 / 16544978 / -0.6% 0.43 / 0.44 / -0.5%
tpcds_q53/duckdb:vortex-file-compressed 11440196 / 11580455 / -1.2% 20580746 / 20950001 / -1.8% 0.56 / 0.55 / +0.6%
tpcds_q54/duckdb:vortex-file-compressed 20477289 / 20288914 / +0.9% 30821101 / 30647003 / +0.6% 0.66 / 0.66 / +0.4%
tpcds_q55/duckdb:vortex-file-compressed 6814480 / 6902994 / -1.3% 15837113 / 15931120 / -0.6% 0.43 / 0.43 / -0.7%
tpcds_q56/duckdb:vortex-file-compressed 18052757 / 17960990 / +0.5% 28635746 / 27713372 / +3.3% 0.63 / 0.65 / -2.7%
tpcds_q57/duckdb:vortex-file-compressed 25777954 / 26098614 / -1.2% 33915428 / 34582639 / -1.9% 0.76 / 0.75 / +0.7%
tpcds_q58/duckdb:vortex-file-compressed 20567175 / 20331842 / +1.2% 30046079 / 30877019 / -2.7% 0.68 / 0.66 / +4.0%
tpcds_q59/duckdb:vortex-file-compressed 19487804 / 19688060 / -1.0% 26709022 / 27058532 / -1.3% 0.73 / 0.73 / +0.3%
tpcds_q60/duckdb:vortex-file-compressed 18792232 / 18617518 / +0.9% 29770334 / 29659067 / +0.4% 0.63 / 0.63 / +0.6%
tpcds_q61/duckdb:vortex-file-compressed 25536607 / 25605872 / -0.3% 35382314 / 34595872 / +2.3% 0.72 / 0.74 / -2.5%
tpcds_q62/duckdb:vortex-file-compressed 11652884 / 11685066 / -0.3% 18731642 / 18455703 / +1.5% 0.62 / 0.63 / -1.7%
tpcds_q63/duckdb:vortex-file-compressed 11009236 / 10996244 / +0.1% 19825116 / 20737428 / -4.4% 0.56 / 0.53 / +4.7%
tpcds_q64/duckdb:vortex-file-compressed 49928840 / 49381384 / +1.1% 65348982 / 66047661 / -1.1% 0.76 / 0.75 / +2.2%
tpcds_q65/duckdb:vortex-file-compressed 13048090 / 13292210 / -1.8% 23719004 / 23558633 / +0.7% 0.55 / 0.56 / -2.5%
tpcds_q66/duckdb:vortex-file-compressed 29073561 / 29707612 / -2.1% 35508657 / 35612347 / -0.3% 0.82 / 0.83 / -1.8%
tpcds_q67/duckdb:vortex-file-compressed 58130528 / 58292138 / -0.3% 69799241 / 66652555 / +4.7% 0.83 / 0.87 / -4.8%
tpcds_q68/duckdb:vortex-file-compressed 19035235 / 19064728 / -0.2% 27480432 / 27773620 / -1.1% 0.69 / 0.69 / +0.9%
tpcds_q69/duckdb:vortex-file-compressed 22853883 / 22826429 / +0.1% 36984556 / 37192445 / -0.6% 0.62 / 0.61 / +0.7%
tpcds_q70/duckdb:vortex-file-compressed 15621601 / 16314066 / -4.2% 27998269 / 27191282 / +3.0% 0.56 / 0.60 / -7.0%
tpcds_q71/duckdb:vortex-file-compressed 12939001 / 12617499 / +2.5% 23400336 / 23746617 / -1.5% 0.55 / 0.53 / +4.1%
tpcds_q72/duckdb:vortex-file-compressed 52073482 / 51945424 / +0.2% 63394725 / 62476510 / +1.5% 0.82 / 0.83 / -1.2%
tpcds_q73/duckdb:vortex-file-compressed 12137947 / 11909118 / +1.9% 20914780 / 21101470 / -0.9% 0.58 / 0.56 / +2.8%
tpcds_q74/duckdb:vortex-file-compressed 25874250 / 26041908 / -0.6% 34272028 / 34022832 / +0.7% 0.75 / 0.77 / -1.4%
tpcds_q75/duckdb:vortex-file-compressed 27736298 / 28133652 / -1.4% 37783012 / 38375865 / -1.5% 0.73 / 0.73 / +0.1%
tpcds_q76/duckdb:vortex-file-compressed 12807056 / 12764356 / +0.3% 23400542 / 22963071 / +1.9% 0.55 / 0.56 / -1.5%
tpcds_q77/duckdb:vortex-file-compressed 21076423 / 21418045 / -1.6% 31425504 / 32708962 / -3.9% 0.67 / 0.65 / +2.4%
tpcds_q78/duckdb:vortex-file-compressed 43098924 / 43337642 / -0.6% 53903961 / 53885227 / +0.0% 0.80 / 0.80 / -0.6%
tpcds_q79/duckdb:vortex-file-compressed 12888832 / 13232534 / -2.6% 21547569 / 21910779 / -1.7% 0.60 / 0.60 / -1.0%
tpcds_q80/duckdb:vortex-file-compressed 36749338 / 36847054 / -0.3% 48568712 / 49501801 / -1.9% 0.76 / 0.74 / +1.7%
tpcds_q81/duckdb:vortex-file-compressed 21206318 / 21429800 / -1.0% 29417749 / 30095533 / -2.3% 0.72 / 0.71 / +1.2%
tpcds_q82/duckdb:vortex-file-compressed 9675054 / 9708050 / -0.3% 24212978 / 25061879 / -3.4% 0.40 / 0.39 / +3.2%
tpcds_q83/duckdb:vortex-file-compressed 17696920 / 17427131 / +1.5% 24462687 / 24376519 / +0.4% 0.72 / 0.71 / +1.2%
tpcds_q84/duckdb:vortex-file-compressed 15459876 / 15770181 / -2.0% 23197436 / 23129342 / +0.3% 0.67 / 0.68 / -2.3%
tpcds_q85/duckdb:vortex-file-compressed 24340472 / 24403894 / -0.3% 36715085 / 36380296 / +0.9% 0.66 / 0.67 / -1.2%
tpcds_q86/duckdb:vortex-file-compressed 9923130 / 9717139 / +2.1% 16798911 / 15906721 / +5.6% 0.59 / 0.61 / -3.3%
tpcds_q87/duckdb:vortex-file-compressed 25882591 / 26017050 / -0.5% 33463671 / 33396290 / +0.2% 0.77 / 0.78 / -0.7%
tpcds_q88/duckdb:vortex-file-compressed 30529200 / 30324574 / +0.7% 37805251 / 38572757 / -2.0% 0.81 / 0.79 / +2.7%
tpcds_q89/duckdb:vortex-file-compressed 11963510 / 12106472 / -1.2% 21630996 / 20820791 / +3.9% 0.55 / 0.58 / -4.9%
tpcds_q90/duckdb:vortex-file-compressed 8166430 / 7989972 / +2.2% 15396984 / 15308508 / +0.6% 0.53 / 0.52 / +1.6%
tpcds_q91/duckdb:vortex-file-compressed 14787206 / 14428822 / +2.5% 22728040 / 23070665 / -1.5% 0.65 / 0.63 / +4.0%
tpcds_q92/duckdb:vortex-file-compressed 12111844 / 12093567 / +0.2% 20304399 / 20435129 / -0.6% 0.60 / 0.59 / +0.8%
tpcds_q93/duckdb:vortex-file-compressed 10034290 / 10489510 / -4.3% 22972737 / 23114016 / -0.6% 0.44 / 0.45 / -3.8%
tpcds_q94/duckdb:vortex-file-compressed 22380474 / 21924813 / +2.1% 32138100 / 32104172 / +0.1% 0.70 / 0.68 / +2.0%
tpcds_q95/duckdb:vortex-file-compressed 62545706 / 62938576 / -0.6% 72251295 / 71963612 / +0.4% 0.87 / 0.87 / -1.0%
tpcds_q96/duckdb:vortex-file-compressed 7028439 / 6838084 / +2.8% 15867774 / 14762606 / +7.5% 0.44 / 0.46 / -4.4%
tpcds_q97/duckdb:vortex-file-compressed 23302476 / 23163218 / +0.6% 33547911 / 31012754 / +8.2% 0.69 / 0.75 / -7.0%
tpcds_q98/duckdb:vortex-file-compressed 11397126 / 11360176 / +0.3% 19877369 / 19475284 / +2.1% 0.57 / 0.58 / -1.7%
tpcds_q99/duckdb:vortex-file-compressed 14554524 / 14668948 / -0.8% 22726182 / 22813440 / -0.4% 0.64 / 0.64 / -0.4%
duckdb / parquet / ns (1.001x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23852399 / 23966969 / -0.5% 30324476 / 30829019 / -1.6% 0.79 / 0.78 / +1.2%
tpcds_q02/duckdb:parquet 17814020 / 17973470 / -0.9% 24058995 / 23889142 / +0.7% 0.74 / 0.75 / -1.6%
tpcds_q03/duckdb:parquet 9688732 / 9784454 / -1.0% 15769538 / 15698965 / +0.4% 0.61 / 0.62 / -1.4%
tpcds_q04/duckdb:parquet 117600153 / 117912489 / -0.3% 125962824 / 126089418 / -0.1% 0.93 / 0.94 / -0.2%
tpcds_q05/duckdb:parquet 27987080 / 28395371 / -1.4% 33073521 / 32582262 / +1.5% 0.85 / 0.87 / -2.9%
tpcds_q06/duckdb:parquet 26168388 / 26216986 / -0.2% 35406950 / 35588221 / -0.5% 0.74 / 0.74 / +0.3%
tpcds_q07/duckdb:parquet 32776585 / 33420428 / -1.9% 38882597 / 38430436 / +1.2% 0.84 / 0.87 / -3.1%
tpcds_q08/duckdb:parquet 19647904 / 19585998 / +0.3% 26139704 / 26172260 / -0.1% 0.75 / 0.75 / +0.4%
tpcds_q09/duckdb:parquet 26257091 / 27371152 / -4.1% 29705765 / 29649948 / +0.2% 0.88 / 0.92 / -4.3%
tpcds_q10/duckdb:parquet 32417442 / 32361482 / +0.2% 40172614 / 40184705 / -0.0% 0.81 / 0.81 / +0.2%
tpcds_q11/duckdb:parquet 69353264 / 68514487 / +1.2% 74242742 / 76389272 / -2.8% 0.93 / 0.90 / +4.2%
tpcds_q12/duckdb:parquet 13883174 / 13876876 / +0.0% 18852301 / 19186188 / -1.7% 0.74 / 0.72 / +1.8%
tpcds_q13/duckdb:parquet 30603840 / 30368470 / +0.8% 39601190 / 40187836 / -1.5% 0.77 / 0.76 / +2.3%
tpcds_q14/duckdb:parquet 65782166 / 63510142 / +3.6% 67764669 / 67941108 / -0.3% 0.97 / 0.93 / +3.8%
tpcds_q15/duckdb:parquet 16400200 / 16546332 / -0.9% 22568982 / 22895550 / -1.4% 0.73 / 0.72 / +0.6%
tpcds_q16/duckdb:parquet 30061391 / 30007520 / +0.2% 37091369 / 36406547 / +1.9% 0.81 / 0.82 / -1.7%
tpcds_q17/duckdb:parquet 34179056 / 34177397 / +0.0% 39542194 / 40441172 / -2.2% 0.86 / 0.85 / +2.3%
tpcds_q18/duckdb:parquet 46940192 / 47042055 / -0.2% 54438912 / 54456240 / -0.0% 0.86 / 0.86 / -0.2%
tpcds_q19/duckdb:parquet 19636659 / 18502952 / +6.1% 25579447 / 25759438 / -0.7% 0.77 / 0.72 / +6.9%
tpcds_q20/duckdb:parquet 14797254 / 14883558 / -0.6% 19557011 / 19539428 / +0.1% 0.76 / 0.76 / -0.7%
tpcds_q21/duckdb:parquet 10437325 / 10610768 / -1.6% 17235778 / 17113867 / +0.7% 0.61 / 0.62 / -2.3%
tpcds_q22/duckdb:parquet 20455502 / 20553610 / -0.5% 26468485 / 26725059 / -1.0% 0.77 / 0.77 / +0.5%
tpcds_q23/duckdb:parquet 42597310 / 43575614 / -2.2% 46296187 / 46598579 / -0.6% 0.92 / 0.94 / -1.6%
tpcds_q24/duckdb:parquet 29833380 / 30367457 / -1.8% 36711107 / 36478211 / +0.6% 0.81 / 0.83 / -2.4%
tpcds_q25/duckdb:parquet 30263162 / 30221780 / +0.1% 36997059 / 36937818 / +0.2% 0.82 / 0.82 / -0.0%
tpcds_q26/duckdb:parquet 28651022 / 28776880 / -0.4% 35557353 / 35302112 / +0.7% 0.81 / 0.82 / -1.2%
tpcds_q27/duckdb:parquet 35528774 / 35523786 / +0.0% 41850427 / 41611405 / +0.6% 0.85 / 0.85 / -0.6%
tpcds_q28/duckdb:parquet 25522954 / 26328432 / -3.1% 34573172 / 34309155 / +0.8% 0.74 / 0.77 / -3.8%
tpcds_q29/duckdb:parquet 33825294 / 31825925 / +6.3% 39239636 / 38870785 / +0.9% 0.86 / 0.82 / +5.3%
tpcds_q30/duckdb:parquet 35029904 / 35121615 / -0.3% 44576441 / 44712118 / -0.3% 0.79 / 0.79 / +0.0%
tpcds_q31/duckdb:parquet 35379528 / 35271778 / +0.3% 42597103 / 42481930 / +0.3% 0.83 / 0.83 / +0.0%
tpcds_q32/duckdb:parquet 14113016 / 14057028 / +0.4% 20366676 / 20598153 / -1.1% 0.69 / 0.68 / +1.5%
tpcds_q33/duckdb:parquet 23345996 / 23124152 / +1.0% 28765704 / 29167207 / -1.4% 0.81 / 0.79 / +2.4%
tpcds_q34/duckdb:parquet 19153510 / 16934344 / +13.1% 🔴 24000708 / 24303526 / -1.2% 0.80 / 0.70 / +14.5%
tpcds_q35/duckdb:parquet 34944226 / 35187535 / -0.7% 43998857 / 43708254 / +0.7% 0.79 / 0.81 / -1.3%
tpcds_q36/duckdb:parquet 39413731 / 39353736 / +0.2% 47809052 / 47971471 / -0.3% 0.82 / 0.82 / +0.5%
tpcds_q37/duckdb:parquet 12617936 / 12699916 / -0.6% 19112911 / 19775516 / -3.4% 0.66 / 0.64 / +2.8%
tpcds_q38/duckdb:parquet 29471310 / 29409083 / +0.2% 33376565 / 33644782 / -0.8% 0.88 / 0.87 / +1.0%
tpcds_q39/duckdb:parquet 23157834 / 23268776 / -0.5% 29811646 / 30173448 / -1.2% 0.78 / 0.77 / +0.7%
tpcds_q40/duckdb:parquet 15852801 / 15818668 / +0.2% 21334327 / 21350935 / -0.1% 0.74 / 0.74 / +0.3%
tpcds_q41/duckdb:parquet 11791770 / 11937368 / -1.2% 17807538 / 17654837 / +0.9% 0.66 / 0.68 / -2.1%
tpcds_q42/duckdb:parquet 9443098 / 9467242 / -0.3% 15472894 / 15390992 / +0.5% 0.61 / 0.62 / -0.8%
tpcds_q43/duckdb:parquet 11993247 / 13469714 / -11.0% 🟢 18089454 / 18054883 / +0.2% 0.66 / 0.75 / -11.1%
tpcds_q44/duckdb:parquet 20931088 / 21728390 / -3.7% 27457406 / 27212840 / +0.9% 0.76 / 0.80 / -4.5%
tpcds_q45/duckdb:parquet 20693511 / 20743408 / -0.2% 28077176 / 27840154 / +0.9% 0.74 / 0.75 / -1.1%
tpcds_q46/duckdb:parquet 35252282 / 36989149 / -4.7% 43819661 / 44071441 / -0.6% 0.80 / 0.84 / -4.1%
tpcds_q47/duckdb:parquet 35931516 / 34549854 / +4.0% 40676464 / 41188971 / -1.2% 0.88 / 0.84 / +5.3%
tpcds_q48/duckdb:parquet 28436067 / 30458733 / -6.6% 37076287 / 37126578 / -0.1% 0.77 / 0.82 / -6.5%
tpcds_q49/duckdb:parquet 31594463 / 30077962 / +5.0% 36491642 / 35486466 / +2.8% 0.87 / 0.85 / +2.1%
tpcds_q50/duckdb:parquet 19359150 / 19303932 / +0.3% 25457869 / 25663854 / -0.8% 0.76 / 0.75 / +1.1%
tpcds_q51/duckdb:parquet 51639174 / 51972089 / -0.6% 60080391 / 60028308 / +0.1% 0.86 / 0.87 / -0.7%
tpcds_q52/duckdb:parquet 9686434 / 9584687 / +1.1% 15688173 / 15536302 / +1.0% 0.62 / 0.62 / +0.1%
tpcds_q53/duckdb:parquet 13751823 / 13859535 / -0.8% 20918366 / 21051270 / -0.6% 0.66 / 0.66 / -0.1%
tpcds_q54/duckdb:parquet 24640764 / 24769012 / -0.5% 32300721 / 32317507 / -0.1% 0.76 / 0.77 / -0.5%
tpcds_q55/duckdb:parquet 9454673 / 9458322 / -0.0% 15318305 / 15628508 / -2.0% 0.62 / 0.61 / +2.0%
tpcds_q56/duckdb:parquet 24551585 / 24451846 / +0.4% 30226408 / 30263945 / -0.1% 0.81 / 0.81 / +0.5%
tpcds_q57/duckdb:parquet 30619358 / 30496694 / +0.4% 36296327 / 36082806 / +0.6% 0.84 / 0.85 / -0.2%
tpcds_q58/duckdb:parquet 24743654 / 24048685 / +2.9% 29689452 / 29574418 / +0.4% 0.83 / 0.81 / +2.5%
tpcds_q59/duckdb:parquet 22660236 / 22781209 / -0.5% 28682099 / 28822798 / -0.5% 0.79 / 0.79 / -0.0%
tpcds_q60/duckdb:parquet 27212520 / 26326926 / +3.4% 32497863 / 32439784 / +0.2% 0.84 / 0.81 / +3.2%
tpcds_q61/duckdb:parquet 24710072 / 24386621 / +1.3% 29011016 / 28840820 / +0.6% 0.85 / 0.85 / +0.7%
tpcds_q62/duckdb:parquet 12698546 / 12837852 / -1.1% 17777627 / 18021543 / -1.4% 0.71 / 0.71 / +0.3%
tpcds_q63/duckdb:parquet 13214804 / 13411461 / -1.5% 19827097 / 20165946 / -1.7% 0.67 / 0.67 / +0.2%
tpcds_q64/duckdb:parquet 70263424 / 70200230 / +0.1% 81088224 / 80412181 / +0.8% 0.87 / 0.87 / -0.7%
tpcds_q65/duckdb:parquet 20571863 / 18687231 / +10.1% 🔴 25875660 / 26192155 / -1.2% 0.80 / 0.71 / +11.4%
tpcds_q66/duckdb:parquet 33106715 / 33369771 / -0.8% 37741176 / 37725314 / +0.0% 0.88 / 0.88 / -0.8%
tpcds_q67/duckdb:parquet 60749620 / 60819089 / -0.1% 66908994 / 67228661 / -0.5% 0.91 / 0.90 / +0.4%
tpcds_q68/duckdb:parquet 29618105 / 29259984 / +1.2% 36586863 / 36839271 / -0.7% 0.81 / 0.79 / +1.9%
tpcds_q69/duckdb:parquet 25469108 / 25569940 / -0.4% 34103580 / 34423942 / -0.9% 0.75 / 0.74 / +0.5%
tpcds_q70/duckdb:parquet 19022504 / 19192084 / -0.9% 27216775 / 26739741 / +1.8% 0.70 / 0.72 / -2.6%
tpcds_q71/duckdb:parquet 16720136 / 17054927 / -2.0% 23556977 / 23954836 / -1.7% 0.71 / 0.71 / -0.3%
tpcds_q72/duckdb:parquet 52686258 / 52932942 / -0.5% 59098457 / 59845214 / -1.2% 0.89 / 0.88 / +0.8%
tpcds_q73/duckdb:parquet 15032068 / 14661652 / +2.5% 21330658 / 21893138 / -2.6% 0.70 / 0.67 / +5.2%
tpcds_q74/duckdb:parquet 84001119 / 84390668 / -0.5% 90843739 / 91452584 / -0.7% 0.92 / 0.92 / +0.2%
tpcds_q75/duckdb:parquet 43268806 / 44687585 / -3.2% 49597342 / 50609140 / -2.0% 0.87 / 0.88 / -1.2%
tpcds_q76/duckdb:parquet 19051862 / 19040094 / +0.1% 23168417 / 23607159 / -1.9% 0.82 / 0.81 / +2.0%
tpcds_q77/duckdb:parquet 26146736 / 25425972 / +2.8% 31690730 / 32155175 / -1.4% 0.83 / 0.79 / +4.3%
tpcds_q78/duckdb:parquet 77775098 / 77093010 / +0.9% 83529778 / 84250182 / -0.9% 0.93 / 0.92 / +1.8%
tpcds_q79/duckdb:parquet 23127857 / 21130690 / +9.5% 28834148 / 29307556 / -1.6% 0.80 / 0.72 / +11.2%
tpcds_q80/duckdb:parquet 37649870 / 37184819 / +1.3% 43651550 / 43847529 / -0.4% 0.86 / 0.85 / +1.7%
tpcds_q81/duckdb:parquet 36001457 / 35976995 / +0.1% 43903501 / 44333291 / -1.0% 0.82 / 0.81 / +1.0%
tpcds_q82/duckdb:parquet 13341924 / 13373336 / -0.2% 20450577 / 20170460 / +1.4% 0.65 / 0.66 / -1.6%
tpcds_q83/duckdb:parquet 20036036 / 20056018 / -0.1% 24749398 / 24832676 / -0.3% 0.81 / 0.81 / +0.2%
tpcds_q84/duckdb:parquet 22502522 / 22552006 / -0.2% 28711731 / 28863502 / -0.5% 0.78 / 0.78 / +0.3%
tpcds_q85/duckdb:parquet 32080997 / 32295063 / -0.7% 39215770 / 39757757 / -1.4% 0.82 / 0.81 / +0.7%
tpcds_q86/duckdb:parquet 11719359 / 11671840 / +0.4% 17315180 / 17041774 / +1.6% 0.68 / 0.68 / -1.2%
tpcds_q87/duckdb:parquet 31111259 / 31295030 / -0.6% 34964776 / 35573309 / -1.7% 0.89 / 0.88 / +1.1%
tpcds_q88/duckdb:parquet 38057996 / 38174937 / -0.3% 42380170 / 41231775 / +2.8% 0.90 / 0.93 / -3.0%
tpcds_q89/duckdb:parquet 14071023 / 15086220 / -6.7% 21284667 / 21158011 / +0.6% 0.66 / 0.71 / -7.3%
tpcds_q90/duckdb:parquet 10013667 / 9834406 / +1.8% 14813313 / 15371268 / -3.6% 0.68 / 0.64 / +5.7%
tpcds_q91/duckdb:parquet 20731871 / 20811260 / -0.4% 28288555 / 28789486 / -1.7% 0.73 / 0.72 / +1.4%
tpcds_q92/duckdb:parquet 15487226 / 15505942 / -0.1% 22110848 / 21884251 / +1.0% 0.70 / 0.71 / -1.1%
tpcds_q93/duckdb:parquet 15351188 / 14008072 / +9.6% 20600632 / 20243382 / +1.8% 0.75 / 0.69 / +7.7%
tpcds_q94/duckdb:parquet 25332565 / 25514996 / -0.7% 32591614 / 32909651 / -1.0% 0.78 / 0.78 / +0.3%
tpcds_q95/duckdb:parquet 43706186 / 43842982 / -0.3% 48826189 / 49538887 / -1.4% 0.90 / 0.89 / +1.1%
tpcds_q96/duckdb:parquet 8118533 / 8142782 / -0.3% 13548060 / 13576831 / -0.2% 0.60 / 0.60 / -0.1%
tpcds_q97/duckdb:parquet 27225629 / 27093344 / +0.5% 34163998 / 32358898 / +5.6% 0.80 / 0.84 / -4.8%
tpcds_q98/duckdb:parquet 16345916 / 16374839 / -0.2% 22951556 / 23141567 / -0.8% 0.71 / 0.71 / +0.6%
tpcds_q99/duckdb:parquet 18745948 / 18656013 / +0.5% 24663514 / 24696138 / -0.1% 0.76 / 0.76 / +0.6%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 0e95e7b8 vs base 246a397e
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.0%
Engines: DataFusion No clear signal (-1.4%, environment too noisy confidence) · DuckDB No clear signal (-2.5%, environment too noisy confidence)
Vortex (geomean): hot 1.041x ➖ · cold 1.013x ➖
Parquet (geomean): hot 1.062x ➖ · cold 1.075x ➖
Shifts: Parquet (control) +6.2% · Median polish +3.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.102x ➖, 0↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 240690752 / 220831264 / +9.0% 784002978 / 576458480 / +36.0% 🔴 0.31 / 0.38 / -19.9%
tpch_q02/datafusion:vortex-file-compressed 359108895 / 308669932 / +16.3% 587004961 / 674528013 / -13.0% 0.61 / 0.46 / +33.7%
tpch_q03/datafusion:vortex-file-compressed 385794822 / 347086704 / +11.2% 1017973664 / 871608881 / +16.8% 0.38 / 0.40 / -4.8%
tpch_q04/datafusion:vortex-file-compressed 184531895 / 207021749 / -10.9% 383610919 / 422384755 / -9.2% 0.48 / 0.49 / -1.9%
tpch_q05/datafusion:vortex-file-compressed 380280335 / 425586511 / -10.6% 576667751 / 613441206 / -6.0% 0.66 / 0.69 / -4.9%
tpch_q06/datafusion:vortex-file-compressed 159658560 / 141424151 / +12.9% 322732019 / 371254228 / -13.1% 0.49 / 0.38 / +29.9%
tpch_q07/datafusion:vortex-file-compressed 447086207 / 462415225 / -3.3% 658208486 / 582547518 / +13.0% 0.68 / 0.79 / -14.4%
tpch_q08/datafusion:vortex-file-compressed 694250469 / 427390773 / +62.4% 🔴 682824631 / 601931393 / +13.4% 1.02 / 0.71 / +43.2%
tpch_q09/datafusion:vortex-file-compressed 356749304 / 268529658 / +32.9% 🔴 492625194 / 473357724 / +4.1% 0.72 / 0.57 / +27.7%
tpch_q10/datafusion:vortex-file-compressed 356852828 / 348508035 / +2.4% 505942765 / 528499094 / -4.3% 0.71 / 0.66 / +7.0%
tpch_q11/datafusion:vortex-file-compressed 384780875 / 257327413 / +49.5% 🔴 561824651 / 420659524 / +33.6% 🔴 0.68 / 0.61 / +12.0%
tpch_q12/datafusion:vortex-file-compressed 231478053 / 210715328 / +9.9% 368209189 / 429074710 / -14.2% 0.63 / 0.49 / +28.0%
tpch_q13/datafusion:vortex-file-compressed 132125471 / 131309055 / +0.6% 292754955 / 370354402 / -21.0% 0.45 / 0.35 / +27.3%
tpch_q14/datafusion:vortex-file-compressed 169581827 / 211521200 / -19.8% 284224835 / 383637559 / -25.9% 0.60 / 0.55 / +8.2%
tpch_q15/datafusion:vortex-file-compressed 352215161 / 292649172 / +20.4% 512171489 / 520914480 / -1.7% 0.69 / 0.56 / +22.4%
tpch_q16/datafusion:vortex-file-compressed 176772866 / 158770515 / +11.3% 316175056 / 318188188 / -0.6% 0.56 / 0.50 / +12.0%
tpch_q17/datafusion:vortex-file-compressed 439506470 / 307709054 / +42.8% 🔴 590494031 / 454845057 / +29.8% 0.74 / 0.68 / +10.0%
tpch_q18/datafusion:vortex-file-compressed 480547371 / 590427775 / -18.6% 714906878 / 723635830 / -1.2% 0.67 / 0.82 / -17.6%
tpch_q19/datafusion:vortex-file-compressed 375556780 / 216120746 / +73.8% 🔴 386618107 / 356996489 / +8.3% 0.97 / 0.61 / +60.5%
tpch_q20/datafusion:vortex-file-compressed 267069236 / 292443661 / -8.7% 431782708 / 509890552 / -15.3% 0.62 / 0.57 / +7.8%
tpch_q21/datafusion:vortex-file-compressed 444177024 / 456400316 / -2.7% 611244658 / 730212380 / -16.3% 0.73 / 0.63 / +16.3%
tpch_q22/datafusion:vortex-file-compressed 165044101 / 167024301 / -1.2% 407605800 / 388209621 / +5.0% 0.40 / 0.43 / -5.9%
datafusion / parquet / ns (1.118x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 160929489 / 150351198 / +7.0% 510710360 / 460460005 / +10.9% 0.32 / 0.33 / -3.5%
tpch_q02/datafusion:parquet 339123631 / 284014916 / +19.4% 593123991 / 458008198 / +29.5% 0.57 / 0.62 / -7.8%
tpch_q03/datafusion:parquet 255913569 / 271007543 / -5.6% 597346172 / 753951884 / -20.8% 0.43 / 0.36 / +19.2%
tpch_q04/datafusion:parquet 146753340 / 133714329 / +9.8% 337529218 / 322406865 / +4.7% 0.43 / 0.41 / +4.8%
tpch_q05/datafusion:parquet 421676573 / 342356608 / +23.2% 599272693 / 468240904 / +28.0% 0.70 / 0.73 / -3.8%
tpch_q06/datafusion:parquet 113888065 / 112055911 / +1.6% 226074644 / 226141107 / -0.0% 0.50 / 0.50 / +1.7%
tpch_q07/datafusion:parquet 365178926 / 329957349 / +10.7% 450159969 / 516179984 / -12.8% 0.81 / 0.64 / +26.9%
tpch_q08/datafusion:parquet 412829227 / 432763020 / -4.6% 548290185 / 536690978 / +2.2% 0.75 / 0.81 / -6.6%
tpch_q09/datafusion:parquet 406032979 / 373806384 / +8.6% 582561951 / 539014441 / +8.1% 0.70 / 0.69 / +0.5%
tpch_q10/datafusion:parquet 406158725 / 309340609 / +31.3% 🔴 611977893 / 417479206 / +46.6% 🔴 0.66 / 0.74 / -10.4%
tpch_q11/datafusion:parquet 275347779 / 261901027 / +5.1% 450699138 / 373704730 / +20.6% 0.61 / 0.70 / -12.8%
tpch_q12/datafusion:parquet 284357827 / 162342440 / +75.2% 🔴 372803148 / 309500458 / +20.5% 0.76 / 0.52 / +45.4%
tpch_q13/datafusion:parquet 335628516 / 276376623 / +21.4% 612856239 / 436081873 / +40.5% 🔴 0.55 / 0.63 / -13.6%
tpch_q14/datafusion:parquet 170115699 / 157906152 / +7.7% 276741978 / 273555838 / +1.2% 0.61 / 0.58 / +6.5%
tpch_q15/datafusion:parquet 352407011 / 317865748 / +10.9% 457724051 / 523121657 / -12.5% 0.77 / 0.61 / +26.7%
tpch_q16/datafusion:parquet 101511740 / 111322386 / -8.8% 253710188 / 231410953 / +9.6% 0.40 / 0.48 / -16.8%
tpch_q17/datafusion:parquet 294638811 / 272274209 / +8.2% 448538233 / 526187695 / -14.8% 0.66 / 0.52 / +26.9%
tpch_q18/datafusion:parquet 317865013 / 341966792 / -7.0% 498118839 / 503106611 / -1.0% 0.64 / 0.68 / -6.1%
tpch_q19/datafusion:parquet 190609380 / 157601017 / +20.9% 556776423 / 273426259 / +103.6% 🔴 0.34 / 0.58 / -40.6%
tpch_q20/datafusion:parquet 306070267 / 235515300 / +30.0% 484060328 / 397076072 / +21.9% 0.63 / 0.59 / +6.6%
tpch_q21/datafusion:parquet 379932947 / 292874917 / +29.7% 572659176 / 463033836 / +23.7% 0.66 / 0.63 / +4.9%
tpch_q22/datafusion:parquet 150141237 / 160199804 / -6.3% 346921318 / 388871374 / -10.8% 0.43 / 0.41 / +5.1%
duckdb / vortex-file-compressed / ns (0.984x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 250120913 / 247509334 / +1.1% 276370272 / 267181463 / +3.4% 0.91 / 0.93 / -2.3%
tpch_q02/duckdb:vortex-file-compressed 437789110 / 408988212 / +7.0% 572546934 / 495524216 / +15.5% 0.76 / 0.83 / -7.4%
tpch_q03/duckdb:vortex-file-compressed 434571838 / 416179552 / +4.4% 610489154 / 484765981 / +25.9% 0.71 / 0.86 / -17.1%
tpch_q04/duckdb:vortex-file-compressed 294574414 / 273734107 / +7.6% 294027086 / 309747374 / -5.1% 1.00 / 0.88 / +13.4%
tpch_q05/duckdb:vortex-file-compressed 742017766 / 585375507 / +26.8% 824599477 / 657952067 / +25.3% 0.90 / 0.89 / +1.1%
tpch_q06/duckdb:vortex-file-compressed 181962127 / 203012163 / -10.4% 209773505 / 217053599 / -3.4% 0.87 / 0.94 / -7.3%
tpch_q07/duckdb:vortex-file-compressed 397863779 / 433499388 / -8.2% 494739114 / 491006362 / +0.8% 0.80 / 0.88 / -8.9%
tpch_q08/duckdb:vortex-file-compressed 589391944 / 856662362 / -31.2% 🟢 656846500 / 924712147 / -29.0% 0.90 / 0.93 / -3.1%
tpch_q09/duckdb:vortex-file-compressed 415432128 / 430063376 / -3.4% 512845412 / 472261724 / +8.6% 0.81 / 0.91 / -11.0%
tpch_q10/duckdb:vortex-file-compressed 548514620 / 562615415 / -2.5% 534368791 / 577179328 / -7.4% 1.03 / 0.97 / +5.3%
tpch_q11/duckdb:vortex-file-compressed 321508696 / 295453825 / +8.8% 338001515 / 295294530 / +14.5% 0.95 / 1.00 / -4.9%
tpch_q12/duckdb:vortex-file-compressed 245030922 / 281391065 / -12.9% 298562760 / 342314564 / -12.8% 0.82 / 0.82 / -0.2%
tpch_q13/duckdb:vortex-file-compressed 246986125 / 257839733 / -4.2% 281270576 / 337095202 / -16.6% 0.88 / 0.76 / +14.8%
tpch_q14/duckdb:vortex-file-compressed 243010380 / 215999117 / +12.5% 315867421 / 312373489 / +1.1% 0.77 / 0.69 / +11.3%
tpch_q15/duckdb:vortex-file-compressed 238931519 / 339636073 / -29.7% 313322736 / 292926502 / +7.0% 0.76 / 1.16 / -34.2%
tpch_q16/duckdb:vortex-file-compressed 208820827 / 210376153 / -0.7% 225801566 / 230946559 / -2.2% 0.92 / 0.91 / +1.5%
tpch_q17/duckdb:vortex-file-compressed 473222680 / 324970756 / +45.6% 🔴 616816947 / 357086182 / +72.7% 🔴 0.77 / 0.91 / -15.7%
tpch_q18/duckdb:vortex-file-compressed 356157501 / 431733303 / -17.5% 386948732 / 402106068 / -3.8% 0.92 / 1.07 / -14.3%
tpch_q19/duckdb:vortex-file-compressed 320553186 / 303395982 / +5.7% 464829222 / 339697179 / +36.8% 🔴 0.69 / 0.89 / -22.8%
tpch_q20/duckdb:vortex-file-compressed 400939760 / 385636006 / +4.0% 490588421 / 483758671 / +1.4% 0.82 / 0.80 / +2.5%
tpch_q21/duckdb:vortex-file-compressed 648293113 / 656583605 / -1.3% 714054830 / 782358666 / -8.7% 0.91 / 0.84 / +8.2%
tpch_q22/duckdb:vortex-file-compressed 229470791 / 251855732 / -8.9% 292602131 / 334512025 / -12.5% 0.78 / 0.75 / +4.2%
duckdb / parquet / ns (1.009x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 195245738 / 152166910 / +28.3% 208065976 / 211204649 / -1.5% 0.94 / 0.72 / +30.2%
tpch_q02/duckdb:parquet 422374938 / 453471368 / -6.9% 410935229 / 426327264 / -3.6% 1.03 / 1.06 / -3.4%
tpch_q03/duckdb:parquet 397991946 / 358243434 / +11.1% 424823026 / 423368603 / +0.3% 0.94 / 0.85 / +10.7%
tpch_q04/duckdb:parquet 258044413 / 281717280 / -8.4% 415948051 / 332953926 / +24.9% 0.62 / 0.85 / -26.7%
tpch_q05/duckdb:parquet 556680718 / 536493872 / +3.8% 607982757 / 570606274 / +6.6% 0.92 / 0.94 / -2.6%
tpch_q06/duckdb:parquet 190940763 / 161239284 / +18.4% 198043634 / 206658661 / -4.2% 0.96 / 0.78 / +23.6%
tpch_q07/duckdb:parquet 440384297 / 436361603 / +0.9% 436547081 / 493434333 / -11.5% 1.01 / 0.88 / +14.1%
tpch_q08/duckdb:parquet 583153739 / 631844333 / -7.7% 689310169 / 652757052 / +5.6% 0.85 / 0.97 / -12.6%
tpch_q09/duckdb:parquet 570050369 / 564743109 / +0.9% 848698764 / 620443574 / +36.8% 🔴 0.67 / 0.91 / -26.2%
tpch_q10/duckdb:parquet 606714702 / 581110821 / +4.4% 856095183 / 636456873 / +34.5% 🔴 0.71 / 0.91 / -22.4%
tpch_q11/duckdb:parquet 309708213 / 285994921 / +8.3% 370872399 / 263711609 / +40.6% 🔴 0.84 / 1.08 / -23.0%
tpch_q12/duckdb:parquet 261863130 / 252866750 / +3.6% 318070965 / 291902719 / +9.0% 0.82 / 0.87 / -5.0%
tpch_q13/duckdb:parquet 388750669 / 369355879 / +5.3% 556339656 / 429176067 / +29.6% 0.70 / 0.86 / -18.8%
tpch_q14/duckdb:parquet 221756265 / 269935408 / -17.8% 239770344 / 344984516 / -30.5% 🟢 0.92 / 0.78 / +18.2%
tpch_q15/duckdb:parquet 193543843 / 212505719 / -8.9% 197031650 / 228893439 / -13.9% 0.98 / 0.93 / +5.8%
tpch_q16/duckdb:parquet 261296354 / 275747511 / -5.2% 293286327 / 327100698 / -10.3% 0.89 / 0.84 / +5.7%
tpch_q17/duckdb:parquet 321223122 / 263952606 / +21.7% 379107493 / 331901361 / +14.2% 0.85 / 0.80 / +6.5%
tpch_q18/duckdb:parquet 322714415 / 382490629 / -15.6% 345382087 / 393794532 / -12.3% 0.93 / 0.97 / -3.8%
tpch_q19/duckdb:parquet 266798530 / 266061746 / +0.3% 384888064 / 345007366 / +11.6% 0.69 / 0.77 / -10.1%
tpch_q20/duckdb:parquet 443152510 / 448150426 / -1.1% 468853490 / 480087501 / -2.3% 0.95 / 0.93 / +1.3%
tpch_q21/duckdb:parquet 399065634 / 418893862 / -4.7% 394307795 / 454759125 / -13.3% 1.01 / 0.92 / +9.9%
tpch_q22/duckdb:parquet 332561003 / 323115195 / +2.9% 394916877 / 335134028 / +17.8% 0.84 / 0.96 / -12.7%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 0e95e7b8 vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Engines: DataFusion No clear signal (+0.6%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 0.995x ➖
Parquet (geomean): hot 0.990x ➖ · cold 0.996x ➖
Shifts: Parquet (control) -1.0% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1238752 / 1223583 / +1.2% 22072231 / 22393554 / -1.4% 0.06 / 0.05 / +2.7%
clickbench_q01/datafusion:vortex-file-compressed 6114847 / 6046842 / +1.1% 30605790 / 29592395 / +3.4% 0.20 / 0.20 / -2.2%
clickbench_q02/datafusion:vortex-file-compressed 11850197 / 10531240 / +12.5% 🔴 44704294 / 46036487 / -2.9% 0.27 / 0.23 / +15.9%
clickbench_q03/datafusion:vortex-file-compressed 12630464 / 12387916 / +2.0% 53848260 / 56727916 / -5.1% 0.23 / 0.22 / +7.4%
clickbench_q04/datafusion:vortex-file-compressed 58363851 / 58081216 / +0.5% 101826013 / 103589636 / -1.7% 0.57 / 0.56 / +2.2%
clickbench_q05/datafusion:vortex-file-compressed 77758976 / 79014320 / -1.6% 123482629 / 128484768 / -3.9% 0.63 / 0.61 / +2.4%
clickbench_q06/datafusion:vortex-file-compressed 1234843 / 1263943 / -2.3% 22177271 / 22422362 / -1.1% 0.06 / 0.06 / -1.2%
clickbench_q07/datafusion:vortex-file-compressed 9519178 / 9508768 / +0.1% 33644195 / 33881448 / -0.7% 0.28 / 0.28 / +0.8%
clickbench_q08/datafusion:vortex-file-compressed 77681186 / 79137674 / -1.8% 122331645 / 128803436 / -5.0% 0.64 / 0.61 / +3.4%
clickbench_q09/datafusion:vortex-file-compressed 170024983 / 173755480 / -2.1% 219812621 / 207375596 / +6.0% 0.77 / 0.84 / -7.7%
clickbench_q10/datafusion:vortex-file-compressed 22718956 / 23479735 / -3.2% 69700060 / 69620750 / +0.1% 0.33 / 0.34 / -3.4%
clickbench_q11/datafusion:vortex-file-compressed 25999223 / 26005739 / -0.0% 71459823 / 70384896 / +1.5% 0.36 / 0.37 / -1.5%
clickbench_q12/datafusion:vortex-file-compressed 73355916 / 75527217 / -2.9% 124251006 / 123896189 / +0.3% 0.59 / 0.61 / -3.2%
clickbench_q13/datafusion:vortex-file-compressed 116801682 / 115900178 / +0.8% 186458421 / 187353692 / -0.5% 0.63 / 0.62 / +1.3%
clickbench_q14/datafusion:vortex-file-compressed 73813337 / 75510882 / -2.2% 129176537 / 125936863 / +2.6% 0.57 / 0.60 / -4.7%
clickbench_q15/datafusion:vortex-file-compressed 63345859 / 63030918 / +0.5% 98225967 / 100187136 / -2.0% 0.64 / 0.63 / +2.5%
clickbench_q16/datafusion:vortex-file-compressed 155974473 / 155538995 / +0.3% 224078534 / 217221220 / +3.2% 0.70 / 0.72 / -2.8%
clickbench_q17/datafusion:vortex-file-compressed 151075218 / 155207311 / -2.7% 225792983 / 226552616 / -0.3% 0.67 / 0.69 / -2.3%
clickbench_q18/datafusion:vortex-file-compressed 295115166 / 294130736 / +0.3% 386882647 / 390830976 / -1.0% 0.76 / 0.75 / +1.4%
clickbench_q19/datafusion:vortex-file-compressed 8699293 / 8303792 / +4.8% 48997874 / 48242070 / +1.6% 0.18 / 0.17 / +3.1%
clickbench_q20/datafusion:vortex-file-compressed 67654186 / 71745774 / -5.7% 252755183 / 248435282 / +1.7% 0.27 / 0.29 / -7.3%
clickbench_q21/datafusion:vortex-file-compressed 78556696 / 79455405 / -1.1% 286928883 / 288506255 / -0.5% 0.27 / 0.28 / -0.6%
clickbench_q22/datafusion:vortex-file-compressed 90144354 / 91696814 / -1.7% 392939845 / 390845073 / +0.5% 0.23 / 0.23 / -2.2%
clickbench_q23/datafusion:vortex-file-compressed 195059327 / 183993637 / +6.0% 550166595 / 539539151 / +2.0% 0.35 / 0.34 / +4.0%
clickbench_q24/datafusion:vortex-file-compressed 15752048 / 15307686 / +2.9% 67211034 / 70032970 / -4.0% 0.23 / 0.22 / +7.2%
clickbench_q25/datafusion:vortex-file-compressed 18114298 / 19863486 / -8.8% 61515340 / 62923085 / -2.2% 0.29 / 0.32 / -6.7%
clickbench_q26/datafusion:vortex-file-compressed 15955083 / 16533236 / -3.5% 67745700 / 70743668 / -4.2% 0.24 / 0.23 / +0.8%
clickbench_q27/datafusion:vortex-file-compressed 101353726 / 101740724 / -0.4% 261568025 / 251569553 / +4.0% 0.39 / 0.40 / -4.2%
clickbench_q28/datafusion:vortex-file-compressed 557875389 / 562333160 / -0.8% 631399064 / 643537242 / -1.9% 0.88 / 0.87 / +1.1%
clickbench_q29/datafusion:vortex-file-compressed 24040902 / 24245137 / -0.8% 56026064 / 53670057 / +4.4% 0.43 / 0.45 / -5.0%
clickbench_q30/datafusion:vortex-file-compressed 55425160 / 57397381 / -3.4% 110100336 / 112998342 / -2.6% 0.50 / 0.51 / -0.9%
clickbench_q31/datafusion:vortex-file-compressed 67176232 / 65356445 / +2.8% 161217756 / 163081172 / -1.1% 0.42 / 0.40 / +4.0%
clickbench_q32/datafusion:vortex-file-compressed 291425294 / 290282297 / +0.4% 383880072 / 393223115 / -2.4% 0.76 / 0.74 / +2.8%
clickbench_q33/datafusion:vortex-file-compressed 323610088 / 324626808 / -0.3% 436261538 / 432328318 / +0.9% 0.74 / 0.75 / -1.2%
clickbench_q34/datafusion:vortex-file-compressed 326006564 / 324894899 / +0.3% 434367771 / 444404496 / -2.3% 0.75 / 0.73 / +2.7%
clickbench_q35/datafusion:vortex-file-compressed 56398524 / 56027504 / +0.7% 91788788 / 93654723 / -2.0% 0.61 / 0.60 / +2.7%
clickbench_q36/datafusion:vortex-file-compressed 37778995 / 37622886 / +0.4% 67334059 / 67872658 / -0.8% 0.56 / 0.55 / +1.2%
clickbench_q37/datafusion:vortex-file-compressed 21161556 / 21259280 / -0.5% 46918688 / 47424626 / -1.1% 0.45 / 0.45 / +0.6%
clickbench_q38/datafusion:vortex-file-compressed 13153537 / 13259514 / -0.8% 41895366 / 41723747 / +0.4% 0.31 / 0.32 / -1.2%
clickbench_q39/datafusion:vortex-file-compressed 78689853 / 78839799 / -0.2% 110929688 / 111367852 / -0.4% 0.71 / 0.71 / +0.2%
clickbench_q40/datafusion:vortex-file-compressed 10462588 / 10378568 / +0.8% 35994097 / 36528657 / -1.5% 0.29 / 0.28 / +2.3%
clickbench_q41/datafusion:vortex-file-compressed 10323224 / 9976754 / +3.5% 35980159 / 34471787 / +4.4% 0.29 / 0.29 / -0.9%
clickbench_q42/datafusion:vortex-file-compressed 10118700 / 10423952 / -2.9% 35897583 / 35196628 / +2.0% 0.28 / 0.30 / -4.8%
datafusion / parquet / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1238668 / 1245842 / -0.6% 49724029 / 49718186 / +0.0% 0.02 / 0.03 / -0.6%
clickbench_q01/datafusion:parquet 15677446 / 15975198 / -1.9% 65763618 / 66883453 / -1.7% 0.24 / 0.24 / -0.2%
clickbench_q02/datafusion:parquet 18548080 / 19024956 / -2.5% 80386577 / 81292366 / -1.1% 0.23 / 0.23 / -1.4%
clickbench_q03/datafusion:parquet 16893910 / 17560503 / -3.8% 78991054 / 79048536 / -0.1% 0.21 / 0.22 / -3.7%
clickbench_q04/datafusion:parquet 62543346 / 62657254 / -0.2% 123933045 / 129056405 / -4.0% 0.50 / 0.49 / +3.9%
clickbench_q05/datafusion:parquet 87589502 / 89388218 / -2.0% 157341279 / 157935497 / -0.4% 0.56 / 0.57 / -1.6%
clickbench_q06/datafusion:parquet 1268132 / 1247492 / +1.7% 48652868 / 49860473 / -2.4% 0.03 / 0.03 / +4.2%
clickbench_q07/datafusion:parquet 16687206 / 16844414 / -0.9% 67177088 / 67110170 / +0.1% 0.25 / 0.25 / -1.0%
clickbench_q08/datafusion:parquet 86695216 / 85805378 / +1.0% 162933748 / 160618520 / +1.4% 0.53 / 0.53 / -0.4%
clickbench_q09/datafusion:parquet 184356294 / 187483740 / -1.7% 270907705 / 273970246 / -1.1% 0.68 / 0.68 / -0.6%
clickbench_q10/datafusion:parquet 35769233 / 35933968 / -0.5% 100932429 / 99356253 / +1.6% 0.35 / 0.36 / -2.0%
clickbench_q11/datafusion:parquet 42776252 / 42619872 / +0.4% 109992693 / 107756386 / +2.1% 0.39 / 0.40 / -1.7%
clickbench_q12/datafusion:parquet 96661568 / 96266114 / +0.4% 162319784 / 162038776 / +0.2% 0.60 / 0.59 / +0.2%
clickbench_q13/datafusion:parquet 146414730 / 146539911 / -0.1% 227968194 / 227411999 / +0.2% 0.64 / 0.64 / -0.3%
clickbench_q14/datafusion:parquet 101371613 / 102721975 / -1.3% 170106277 / 174323102 / -2.4% 0.60 / 0.59 / +1.1%
clickbench_q15/datafusion:parquet 70971922 / 72072821 / -1.5% 130375985 / 130369029 / +0.0% 0.54 / 0.55 / -1.5%
clickbench_q16/datafusion:parquet 155844000 / 155655536 / +0.1% 234222826 / 242072681 / -3.2% 0.67 / 0.64 / +3.5%
clickbench_q17/datafusion:parquet 156527011 / 156748302 / -0.1% 236906164 / 234690281 / +0.9% 0.66 / 0.67 / -1.1%
clickbench_q18/datafusion:parquet 308845683 / 311937038 / -1.0% 420460824 / 429885360 / -2.2% 0.73 / 0.73 / +1.2%
clickbench_q19/datafusion:parquet 19029178 / 18985055 / +0.2% 77692864 / 76428879 / +1.7% 0.24 / 0.25 / -1.4%
clickbench_q20/datafusion:parquet 178549388 / 178201950 / +0.2% 280839434 / 277984119 / +1.0% 0.64 / 0.64 / -0.8%
clickbench_q21/datafusion:parquet 174226578 / 174353110 / -0.1% 298211427 / 298763106 / -0.2% 0.58 / 0.58 / +0.1%
clickbench_q22/datafusion:parquet 260341506 / 264644574 / -1.6% 421397540 / 427231380 / -1.4% 0.62 / 0.62 / -0.3%
clickbench_q23/datafusion:parquet 1004089364 / 1015310230 / -1.1% 1182526571 / 1186767292 / -0.4% 0.85 / 0.86 / -0.8%
clickbench_q24/datafusion:parquet 29722626 / 30461840 / -2.4% 88182870 / 89550560 / -1.5% 0.34 / 0.34 / -0.9%
clickbench_q25/datafusion:parquet 35983286 / 36461936 / -1.3% 105166057 / 103796692 / +1.3% 0.34 / 0.35 / -2.6%
clickbench_q26/datafusion:parquet 30289862 / 30640387 / -1.1% 88683759 / 89946311 / -1.4% 0.34 / 0.34 / +0.3%
clickbench_q27/datafusion:parquet 192222058 / 192726410 / -0.3% 287740748 / 288972174 / -0.4% 0.67 / 0.67 / +0.2%
clickbench_q28/datafusion:parquet 615315868 / 621473269 / -1.0% 704760983 / 715604342 / -1.5% 0.87 / 0.87 / +0.5%
clickbench_q29/datafusion:parquet 29053588 / 28657065 / +1.4% 93336509 / 90415523 / +3.2% 0.31 / 0.32 / -1.8%
clickbench_q30/datafusion:parquet 90596621 / 91351340 / -0.8% 172406531 / 172111509 / +0.2% 0.53 / 0.53 / -1.0%
clickbench_q31/datafusion:parquet 101324396 / 102634058 / -1.3% 197818132 / 198577852 / -0.4% 0.51 / 0.52 / -0.9%
clickbench_q32/datafusion:parquet 308442308 / 311819602 / -1.1% 427300443 / 434802281 / -1.7% 0.72 / 0.72 / +0.7%
clickbench_q33/datafusion:parquet 378887910 / 380089808 / -0.3% 478365267 / 473796518 / +1.0% 0.79 / 0.80 / -1.3%
clickbench_q34/datafusion:parquet 376561525 / 376914011 / -0.1% 478987594 / 477819866 / +0.2% 0.79 / 0.79 / -0.3%
clickbench_q35/datafusion:parquet 63896140 / 65520001 / -2.5% 124918287 / 122720394 / +1.8% 0.51 / 0.53 / -4.2%
clickbench_q36/datafusion:parquet 73607650 / 73697400 / -0.1% 135148206 / 136472185 / -1.0% 0.54 / 0.54 / +0.9%
clickbench_q37/datafusion:parquet 35626600 / 35543201 / +0.2% 89799635 / 91265731 / -1.6% 0.40 / 0.39 / +1.9%
clickbench_q38/datafusion:parquet 47579900 / 48184051 / -1.3% 106283255 / 110190286 / -3.5% 0.45 / 0.44 / +2.4%
clickbench_q39/datafusion:parquet 143202227 / 143896086 / -0.5% 209675131 / 213345420 / -1.7% 0.68 / 0.67 / +1.3%
clickbench_q40/datafusion:parquet 20033531 / 20053370 / -0.1% 75781012 / 78117633 / -3.0% 0.26 / 0.26 / +3.0%
clickbench_q41/datafusion:parquet 18584462 / 18881718 / -1.6% 74644930 / 76285755 / -2.2% 0.25 / 0.25 / +0.6%
clickbench_q42/datafusion:parquet 18798434 / 19347004 / -2.8% 74042231 / 74154859 / -0.2% 0.25 / 0.26 / -2.7%
duckdb / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2156670 / 2237106 / -3.6% 26955092 / 25307876 / +6.5% 0.08 / 0.09 / -9.5%
clickbench_q01/duckdb:vortex-file-compressed 7537510 / 7655398 / -1.5% 30468186 / 30911132 / -1.4% 0.25 / 0.25 / -0.1%
clickbench_q02/duckdb:vortex-file-compressed 9088481 / 9039239 / +0.5% 35694905 / 38103656 / -6.3% 0.25 / 0.24 / +7.3%
clickbench_q03/duckdb:vortex-file-compressed 13644100 / 14038454 / -2.8% 50103782 / 51361504 / -2.4% 0.27 / 0.27 / -0.4%
clickbench_q04/duckdb:vortex-file-compressed 56679800 / 55959632 / +1.3% 91087289 / 90702001 / +0.4% 0.62 / 0.62 / +0.9%
clickbench_q05/duckdb:vortex-file-compressed 63911075 / 63897903 / +0.0% 94015629 / 96923586 / -3.0% 0.68 / 0.66 / +3.1%
clickbench_q06/duckdb:vortex-file-compressed 2582470 / 2644494 / -2.3% 28793961 / 29217110 / -1.4% 0.09 / 0.09 / -0.9%
clickbench_q07/duckdb:vortex-file-compressed 9748101 / 9511088 / +2.5% 30025286 / 30810489 / -2.5% 0.32 / 0.31 / +5.2%
clickbench_q08/duckdb:vortex-file-compressed 69191470 / 69255778 / -0.1% 105635897 / 107914279 / -2.1% 0.65 / 0.64 / +2.1%
clickbench_q09/duckdb:vortex-file-compressed 94481320 / 92548142 / +2.1% 130378487 / 128409391 / +1.5% 0.72 / 0.72 / +0.5%
clickbench_q10/duckdb:vortex-file-compressed 27857948 / 27689274 / +0.6% 72940146 / 72148281 / +1.1% 0.38 / 0.38 / -0.5%
clickbench_q11/duckdb:vortex-file-compressed 30670030 / 30540370 / +0.4% 76423841 / 79204582 / -3.5% 0.40 / 0.39 / +4.1%
clickbench_q12/duckdb:vortex-file-compressed 69830800 / 69892491 / -0.1% 101017762 / 100654921 / +0.4% 0.69 / 0.69 / -0.4%
clickbench_q13/duckdb:vortex-file-compressed 125884980 / 127172012 / -1.0% 167856860 / 169732824 / -1.1% 0.75 / 0.75 / +0.1%
clickbench_q14/duckdb:vortex-file-compressed 74743664 / 74951316 / -0.3% 108998219 / 108241821 / +0.7% 0.69 / 0.69 / -1.0%
clickbench_q15/duckdb:vortex-file-compressed 76491778 / 75857344 / +0.8% 111764894 / 109421143 / +2.1% 0.68 / 0.69 / -1.3%
clickbench_q16/duckdb:vortex-file-compressed 134772202 / 133718120 / +0.8% 175340889 / 172972559 / +1.4% 0.77 / 0.77 / -0.6%
clickbench_q17/duckdb:vortex-file-compressed 136937650 / 139145834 / -1.6% 171560509 / 176256527 / -2.7% 0.80 / 0.79 / +1.1%
clickbench_q18/duckdb:vortex-file-compressed 258701800 / 261284120 / -1.0% 309393097 / 305972300 / +1.1% 0.84 / 0.85 / -2.1%
clickbench_q19/duckdb:vortex-file-compressed 9134652 / 9433455 / -3.2% 38121024 / 38621943 / -1.3% 0.24 / 0.24 / -1.9%
clickbench_q20/duckdb:vortex-file-compressed 67651835 / 67552078 / +0.1% 168696075 / 169737178 / -0.6% 0.40 / 0.40 / +0.8%
clickbench_q21/duckdb:vortex-file-compressed 83724449 / 85506677 / -2.1% 193670448 / 194027861 / -0.2% 0.43 / 0.44 / -1.9%
clickbench_q22/duckdb:vortex-file-compressed 176689326 / 176474637 / +0.1% 353800650 / 345523729 / +2.4% 0.50 / 0.51 / -2.2%
clickbench_q23/duckdb:vortex-file-compressed 40742506 / 41929978 / -2.8% 84198229 / 90293247 / -6.8% 0.48 / 0.46 / +4.2%
clickbench_q24/duckdb:vortex-file-compressed 14361287 / 14160536 / +1.4% 34396203 / 39660096 / -13.3% 🟢 0.42 / 0.36 / +16.9%
clickbench_q25/duckdb:vortex-file-compressed 19085707 / 19419968 / -1.7% 54766059 / 54403251 / +0.7% 0.35 / 0.36 / -2.4%
clickbench_q26/duckdb:vortex-file-compressed 11520225 / 11388071 / +1.2% 35732612 / 39205981 / -8.9% 0.32 / 0.29 / +11.0%
clickbench_q27/duckdb:vortex-file-compressed 52598758 / 55108350 / -4.6% 178262038 / 180380940 / -1.2% 0.30 / 0.31 / -3.4%
clickbench_q28/duckdb:vortex-file-compressed 514122888 / 516077988 / -0.4% 563428603 / 559514013 / +0.7% 0.91 / 0.92 / -1.1%
clickbench_q29/duckdb:vortex-file-compressed 16927497 / 16801554 / +0.7% 48596126 / 43120020 / +12.7% 🔴 0.35 / 0.39 / -10.6%
clickbench_q30/duckdb:vortex-file-compressed 60840530 / 60694336 / +0.2% 106960595 / 112438538 / -4.9% 0.57 / 0.54 / +5.4%
clickbench_q31/duckdb:vortex-file-compressed 101061666 / 110928932 / -8.9% 199597373 / 200481515 / -0.4% 0.51 / 0.55 / -8.5%
clickbench_q32/duckdb:vortex-file-compressed 380742316 / 376905062 / +1.0% 400034132 / 411978991 / -2.9% 0.95 / 0.91 / +4.0%
clickbench_q33/duckdb:vortex-file-compressed 348604846 / 346800168 / +0.5% 411334074 / 400039829 / +2.8% 0.85 / 0.87 / -2.2%
clickbench_q34/duckdb:vortex-file-compressed 356339690 / 358757820 / -0.7% 420866329 / 415394371 / +1.3% 0.85 / 0.86 / -2.0%
clickbench_q35/duckdb:vortex-file-compressed 57739236 / 57165394 / +1.0% 91520365 / 89565873 / +2.2% 0.63 / 0.64 / -1.2%
clickbench_q36/duckdb:vortex-file-compressed 11733798 / 11736720 / -0.0% 32535700 / 31701737 / +2.6% 0.36 / 0.37 / -2.6%
clickbench_q37/duckdb:vortex-file-compressed 8250152 / 8307028 / -0.7% 28619435 / 28390029 / +0.8% 0.29 / 0.29 / -1.5%
clickbench_q38/duckdb:vortex-file-compressed 8720139 / 9089105 / -4.1% 28416765 / 28411635 / +0.0% 0.31 / 0.32 / -4.1%
clickbench_q39/duckdb:vortex-file-compressed 19190144 / 18985566 / +1.1% 40482250 / 41519995 / -2.5% 0.47 / 0.46 / +3.7%
clickbench_q40/duckdb:vortex-file-compressed 7526324 / 7541189 / -0.2% 28950599 / 26930257 / +7.5% 0.26 / 0.28 / -7.2%
clickbench_q41/duckdb:vortex-file-compressed 8499918 / 8447401 / +0.6% 30358747 / 30600085 / -0.8% 0.28 / 0.28 / +1.4%
clickbench_q42/duckdb:vortex-file-compressed 7565320 / 7460622 / +1.4% 28943457 / 28688927 / +0.9% 0.26 / 0.26 / +0.5%
duckdb / parquet / ns (0.988x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9359806 / 9718106 / -3.7% 14511979 / 14404944 / +0.7% 0.64 / 0.67 / -4.4%
clickbench_q01/duckdb:parquet 15325092 / 15834801 / -3.2% 21262023 / 20779530 / +2.3% 0.72 / 0.76 / -5.4%
clickbench_q02/duckdb:parquet 22495751 / 22998262 / -2.2% 29929354 / 30933941 / -3.2% 0.75 / 0.74 / +1.1%
clickbench_q03/duckdb:parquet 22957948 / 22952789 / +0.0% 35433079 / 36373798 / -2.6% 0.65 / 0.63 / +2.7%
clickbench_q04/duckdb:parquet 61327969 / 61553110 / -0.4% 73228854 / 78571229 / -6.8% 0.84 / 0.78 / +6.9%
clickbench_q05/duckdb:parquet 82003856 / 82357820 / -0.4% 96869373 / 96778532 / +0.1% 0.85 / 0.85 / -0.5%
clickbench_q06/duckdb:parquet 20499802 / 20631596 / -0.6% 27197094 / 27932745 / -2.6% 0.75 / 0.74 / +2.0%
clickbench_q07/duckdb:parquet 17017563 / 17411882 / -2.3% 23978782 / 23086324 / +3.9% 0.71 / 0.75 / -5.9%
clickbench_q08/duckdb:parquet 74839056 / 74193970 / +0.9% 91541740 / 88499093 / +3.4% 0.82 / 0.84 / -2.5%
clickbench_q09/duckdb:parquet 102617008 / 102344946 / +0.3% 118558635 / 118287242 / +0.2% 0.87 / 0.87 / +0.0%
clickbench_q10/duckdb:parquet 41973977 / 41585957 / +0.9% 55226794 / 53914290 / +2.4% 0.76 / 0.77 / -1.5%
clickbench_q11/duckdb:parquet 46670509 / 46376690 / +0.6% 61263404 / 62469950 / -1.9% 0.76 / 0.74 / +2.6%
clickbench_q12/duckdb:parquet 90504500 / 93246466 / -2.9% 104054785 / 106709132 / -2.5% 0.87 / 0.87 / -0.5%
clickbench_q13/duckdb:parquet 148787984 / 151353115 / -1.7% 167601826 / 168774480 / -0.7% 0.89 / 0.90 / -1.0%
clickbench_q14/duckdb:parquet 100668762 / 101132109 / -0.5% 115644640 / 121484338 / -4.8% 0.87 / 0.83 / +4.6%
clickbench_q15/duckdb:parquet 86859734 / 87152113 / -0.3% 99847347 / 99157583 / +0.7% 0.87 / 0.88 / -1.0%
clickbench_q16/duckdb:parquet 161148212 / 161518198 / -0.2% 178105837 / 177677559 / +0.2% 0.90 / 0.91 / -0.5%
clickbench_q17/duckdb:parquet 161988642 / 163501751 / -0.9% 181818150 / 179044078 / +1.5% 0.89 / 0.91 / -2.4%
clickbench_q18/duckdb:parquet 293417728 / 297760434 / -1.5% 319090623 / 317638716 / +0.5% 0.92 / 0.94 / -1.9%
clickbench_q19/duckdb:parquet 19773634 / 20044906 / -1.4% 26915476 / 26219883 / +2.7% 0.73 / 0.76 / -3.9%
clickbench_q20/duckdb:parquet 181589281 / 190656931 / -4.8% 238328458 / 223372775 / +6.7% 0.76 / 0.85 / -10.7%
clickbench_q21/duckdb:parquet 218401576 / 221775748 / -1.5% 266653346 / 270636772 / -1.5% 0.82 / 0.82 / -0.1%
clickbench_q22/duckdb:parquet 308736556 / 316494844 / -2.5% 354622444 / 356496439 / -0.5% 0.87 / 0.89 / -1.9%
clickbench_q23/duckdb:parquet 170123396 / 172903391 / -1.6% 240574898 / 233746562 / +2.9% 0.71 / 0.74 / -4.4%
clickbench_q24/duckdb:parquet 30092904 / 30525626 / -1.4% 47287194 / 44919682 / +5.3% 0.64 / 0.68 / -6.4%
clickbench_q25/duckdb:parquet 41424666 / 43279324 / -4.3% 55789486 / 55176174 / +1.1% 0.74 / 0.78 / -5.3%
clickbench_q26/duckdb:parquet 30039351 / 29909380 / +0.4% 46260546 / 47593911 / -2.8% 0.65 / 0.63 / +3.3%
clickbench_q27/duckdb:parquet 192884904 / 190317469 / +1.3% 225538717 / 230460935 / -2.1% 0.86 / 0.83 / +3.6%
clickbench_q28/duckdb:parquet 957495450 / 966912630 / -1.0% 954184021 / 939906810 / +1.5% 1.00 / 1.03 / -2.5%
clickbench_q29/duckdb:parquet 23800524 / 23708308 / +0.4% 31172094 / 31487776 / -1.0% 0.76 / 0.75 / +1.4%
clickbench_q30/duckdb:parquet 106281909 / 107434616 / -1.1% 128320529 / 126651318 / +1.3% 0.83 / 0.85 / -2.4%
clickbench_q31/duckdb:parquet 135324414 / 146264200 / -7.5% 177134026 / 172955499 / +2.4% 0.76 / 0.85 / -9.7%
clickbench_q32/duckdb:parquet 396144842 / 392919146 / +0.8% 413310886 / 417034375 / -0.9% 0.96 / 0.94 / +1.7%
clickbench_q33/duckdb:parquet 474655710 / 489452036 / -3.0% 461080489 / 442277693 / +4.3% 1.03 / 1.11 / -7.0%
clickbench_q34/duckdb:parquet 478155990 / 466236417 / +2.6% 466006627 / 469010681 / -0.6% 1.03 / 0.99 / +3.2%
clickbench_q35/duckdb:parquet 61177870 / 61471326 / -0.5% 73469624 / 75534239 / -2.7% 0.83 / 0.81 / +2.3%
clickbench_q36/duckdb:parquet 29643710 / 30715884 / -3.5% 35934219 / 36664389 / -2.0% 0.82 / 0.84 / -1.5%
clickbench_q37/duckdb:parquet 23713092 / 23465799 / +1.1% 29384579 / 29463089 / -0.3% 0.81 / 0.80 / +1.3%
clickbench_q38/duckdb:parquet 23078005 / 23803284 / -3.0% 29103262 / 30067802 / -3.2% 0.79 / 0.79 / +0.2%
clickbench_q39/duckdb:parquet 52933049 / 53454965 / -1.0% 60637316 / 60267957 / +0.6% 0.87 / 0.89 / -1.6%
clickbench_q40/duckdb:parquet 14547985 / 14620130 / -0.5% 19886524 / 20417625 / -2.6% 0.73 / 0.72 / +2.2%
clickbench_q41/duckdb:parquet 15608438 / 15522580 / +0.6% 20107398 / 20561068 / -2.2% 0.78 / 0.75 / +2.8%
clickbench_q42/duckdb:parquet 14456218 / 14508395 / -0.4% 20792716 / 21329381 / -2.5% 0.70 / 0.68 / +2.2%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 0e95e7b8 vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +5.0%
Engines: DataFusion No clear signal (+5.4%, low confidence) · DuckDB No clear signal (+4.5%, low confidence)
Vortex (geomean): hot 1.053x ➖ · cold 0.978x ➖
Parquet (geomean): hot 1.003x ➖ · cold 1.034x ➖
Shifts: Parquet (control) +0.3% · Median polish +1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.062x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 5928384 / 6024191 / -1.6% 19137215 / 21309376 / -10.2% 🟢 0.31 / 0.28 / +9.6%
fineweb_q01/datafusion:vortex-file-compressed 10456328 / 9747476 / +7.3% 38268545 / 42020755 / -8.9% 0.27 / 0.23 / +17.8%
fineweb_q02/datafusion:vortex-file-compressed 11381550 / 11618604 / -2.0% 42667341 / 41766392 / +2.2% 0.27 / 0.28 / -4.1%
fineweb_q03/datafusion:vortex-file-compressed 23608845 / 17329895 / +36.2% 🔴 118205498 / 108086646 / +9.4% 0.20 / 0.16 / +24.6%
fineweb_q04/datafusion:vortex-file-compressed 65801407 / 65737414 / +0.1% 148310403 / 145352776 / +2.0% 0.44 / 0.45 / -1.9%
fineweb_q05/datafusion:vortex-file-compressed 63288248 / 61795532 / +2.4% 144132965 / 137019662 / +5.2% 0.44 / 0.45 / -2.6%
fineweb_q06/datafusion:vortex-file-compressed 17793348 / 18066823 / -1.5% 105499575 / 104665880 / +0.8% 0.17 / 0.17 / -2.3%
fineweb_q07/datafusion:vortex-file-compressed 17219974 / 18844782 / -8.6% 106161153 / 103604493 / +2.5% 0.16 / 0.18 / -10.8%
fineweb_q08/datafusion:vortex-file-compressed 9861728 / 7447691 / +32.4% 🔴 34090011 / 30345802 / +12.3% 🔴 0.29 / 0.25 / +17.9%
datafusion / parquet / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9540028 / 9347190 / +2.1% 34414051 / 33061275 / +4.1% 0.28 / 0.28 / -1.9%
fineweb_q01/datafusion:parquet 73469294 / 74932425 / -2.0% 159265507 / 150742572 / +5.7% 0.46 / 0.50 / -7.2%
fineweb_q02/datafusion:parquet 76382758 / 74583498 / +2.4% 161191829 / 163418319 / -1.4% 0.47 / 0.46 / +3.8%
fineweb_q03/datafusion:parquet 73154105 / 73245926 / -0.1% 170606688 / 146136322 / +16.7% 🔴 0.43 / 0.50 / -14.5%
fineweb_q04/datafusion:parquet 82694988 / 81855403 / +1.0% 167103832 / 149348852 / +11.9% 🔴 0.49 / 0.55 / -9.7%
fineweb_q05/datafusion:parquet 80829568 / 79554145 / +1.6% 155036291 / 154855107 / +0.1% 0.52 / 0.51 / +1.5%
fineweb_q06/datafusion:parquet 76011629 / 75032262 / +1.3% 165975779 / 149137469 / +11.3% 🔴 0.46 / 0.50 / -9.0%
fineweb_q07/datafusion:parquet 73864084 / 73707845 / +0.2% 157952510 / 147218019 / +7.3% 0.47 / 0.50 / -6.6%
fineweb_q08/datafusion:parquet 74112208 / 73897006 / +0.3% 164746153 / 148685620 / +10.8% 🔴 0.45 / 0.50 / -9.5%
duckdb / vortex-file-compressed / ns (1.043x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2118309 / 2054080 / +3.1% 7192590 / 8030872 / -10.4% 🟢 0.29 / 0.26 / +15.1%
fineweb_q01/duckdb:vortex-file-compressed 7863156 / 8039040 / -2.2% 26445672 / 27088970 / -2.4% 0.30 / 0.30 / +0.2%
fineweb_q02/duckdb:vortex-file-compressed 9365352 / 9083977 / +3.1% 29213379 / 31774590 / -8.1% 0.32 / 0.29 / +12.1%
fineweb_q03/duckdb:vortex-file-compressed 25972122 / 19157832 / +35.6% 🔴 94528041 / 98793352 / -4.3% 0.27 / 0.19 / +41.7%
fineweb_q04/duckdb:vortex-file-compressed 65226924 / 65255572 / -0.0% 104668314 / 112260318 / -6.8% 0.62 / 0.58 / +7.2%
fineweb_q05/duckdb:vortex-file-compressed 65168910 / 65341412 / -0.3% 101208330 / 108297733 / -6.5% 0.64 / 0.60 / +6.7%
fineweb_q06/duckdb:vortex-file-compressed 18656498 / 18257114 / +2.2% 90457024 / 91068935 / -0.7% 0.21 / 0.20 / +2.9%
fineweb_q07/duckdb:vortex-file-compressed 18784848 / 17490810 / +7.4% 89991543 / 91425750 / -1.6% 0.21 / 0.19 / +9.1%
fineweb_q08/duckdb:vortex-file-compressed 4685646 / 4946861 / -5.3% 11774043 / 13182286 / -10.7% 🟢 0.40 / 0.38 / +6.0%
duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23536708 / 23445777 / +0.4% 28141168 / 28195844 / -0.2% 0.84 / 0.83 / +0.6%
fineweb_q01/duckdb:parquet 54284782 / 53982162 / +0.6% 71036053 / 71997604 / -1.3% 0.76 / 0.75 / +1.9%
fineweb_q02/duckdb:parquet 56913730 / 57294482 / -0.7% 82909140 / 77346633 / +7.2% 0.69 / 0.74 / -7.3%
fineweb_q03/duckdb:parquet 117837336 / 117275600 / +0.5% 177706949 / 177695815 / +0.0% 0.66 / 0.66 / +0.5%
fineweb_q04/duckdb:parquet 159784178 / 162362744 / -1.6% 201561799 / 207889629 / -3.0% 0.79 / 0.78 / +1.5%
fineweb_q05/duckdb:parquet 160609222 / 154398161 / +4.0% 193309619 / 198729928 / -2.7% 0.83 / 0.78 / +6.9%
fineweb_q06/duckdb:parquet 87005435 / 87783252 / -0.9% 146907776 / 145322183 / +1.1% 0.59 / 0.60 / -2.0%
fineweb_q07/duckdb:parquet 90334768 / 91502205 / -1.3% 142011943 / 144300475 / -1.6% 0.64 / 0.63 / +0.3%
fineweb_q08/duckdb:parquet 28408432 / 29233083 / -2.8% 29445040 / 29945779 / -1.7% 0.96 / 0.98 / -1.2%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 0e95e7b8 vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (-1.0%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 0.997x ➖
Parquet (geomean): hot 0.999x ➖ · cold 0.988x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.987x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 93534627 / 92421374 / +1.2% 154803182 / 147337644 / +5.1% 0.60 / 0.63 / -3.7%
tpch_q02/datafusion:vortex-file-compressed 64663874 / 65027104 / -0.6% 98218465 / 94796662 / +3.6% 0.66 / 0.69 / -4.0%
tpch_q03/datafusion:vortex-file-compressed 62451513 / 63028520 / -0.9% 116973909 / 120349559 / -2.8% 0.53 / 0.52 / +1.9%
tpch_q04/datafusion:vortex-file-compressed 33769921 / 33815475 / -0.1% 72368278 / 69506239 / +4.1% 0.47 / 0.49 / -4.1%
tpch_q05/datafusion:vortex-file-compressed 118500809 / 117313380 / +1.0% 173708711 / 176710106 / -1.7% 0.68 / 0.66 / +2.8%
tpch_q06/datafusion:vortex-file-compressed 9868619 / 10725012 / -8.0% 58029425 / 57362676 / +1.2% 0.17 / 0.19 / -9.0%
tpch_q07/datafusion:vortex-file-compressed 133016755 / 134275774 / -0.9% 193183158 / 209952759 / -8.0% 0.69 / 0.64 / +7.7%
tpch_q08/datafusion:vortex-file-compressed 143600844 / 142650106 / +0.7% 213189445 / 221708280 / -3.8% 0.67 / 0.64 / +4.7%
tpch_q09/datafusion:vortex-file-compressed 184236141 / 184132835 / +0.1% 259675594 / 257568148 / +0.8% 0.71 / 0.71 / -0.8%
tpch_q10/datafusion:vortex-file-compressed 68907313 / 69455539 / -0.8% 142759128 / 134716861 / +6.0% 0.48 / 0.52 / -6.4%
tpch_q11/datafusion:vortex-file-compressed 43172317 / 43143661 / +0.1% 66345533 / 67640381 / -1.9% 0.65 / 0.64 / +2.0%
tpch_q12/datafusion:vortex-file-compressed 34295978 / 35061881 / -2.2% 78723905 / 85227270 / -7.6% 0.44 / 0.41 / +5.9%
tpch_q13/datafusion:vortex-file-compressed 46755480 / 48574220 / -3.7% 80759509 / 87462734 / -7.7% 0.58 / 0.56 / +4.2%
tpch_q14/datafusion:vortex-file-compressed 20918077 / 21632584 / -3.3% 82905352 / 86011756 / -3.6% 0.25 / 0.25 / +0.3%
tpch_q15/datafusion:vortex-file-compressed 33421096 / 33883815 / -1.4% 91289866 / 91939519 / -0.7% 0.37 / 0.37 / -0.7%
tpch_q16/datafusion:vortex-file-compressed 36348468 / 37360931 / -2.7% 66032224 / 67235326 / -1.8% 0.55 / 0.56 / -0.9%
tpch_q17/datafusion:vortex-file-compressed 175165220 / 179258740 / -2.3% 219750646 / 225548853 / -2.6% 0.80 / 0.79 / +0.3%
tpch_q18/datafusion:vortex-file-compressed 205958074 / 208064713 / -1.0% 275835469 / 265841334 / +3.8% 0.75 / 0.78 / -4.6%
tpch_q19/datafusion:vortex-file-compressed 30147357 / 30852811 / -2.3% 86282871 / 90459069 / -4.6% 0.35 / 0.34 / +2.4%
tpch_q20/datafusion:vortex-file-compressed 60387778 / 60119739 / +0.4% 120937286 / 116242771 / +4.0% 0.50 / 0.52 / -3.5%
tpch_q21/datafusion:vortex-file-compressed 178632724 / 179920903 / -0.7% 237426783 / 236016105 / +0.6% 0.75 / 0.76 / -1.3%
tpch_q22/datafusion:vortex-file-compressed 24867517 / 24937759 / -0.3% 52087110 / 53553354 / -2.7% 0.48 / 0.47 / +2.5%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87082605 / 87372046 / -0.3% 124802188 / 127117134 / -1.8% 0.70 / 0.69 / +1.5%
tpch_q02/datafusion:parquet 175345544 / 173541457 / +1.0% 197098299 / 200787531 / -1.8% 0.89 / 0.86 / +2.9%
tpch_q03/datafusion:parquet 134699159 / 135400852 / -0.5% 178343647 / 177515979 / +0.5% 0.76 / 0.76 / -1.0%
tpch_q04/datafusion:parquet 56899295 / 57301728 / -0.7% 91093504 / 90634805 / +0.5% 0.62 / 0.63 / -1.2%
tpch_q05/datafusion:parquet 166097793 / 167450726 / -0.8% 218557526 / 216918602 / +0.8% 0.76 / 0.77 / -1.6%
tpch_q06/datafusion:parquet 36180861 / 36759711 / -1.6% 74025033 / 73377160 / +0.9% 0.49 / 0.50 / -2.4%
tpch_q07/datafusion:parquet 217231201 / 217452485 / -0.1% 270694262 / 278757728 / -2.9% 0.80 / 0.78 / +2.9%
tpch_q08/datafusion:parquet 217613983 / 217547432 / +0.0% 282282756 / 281050041 / +0.4% 0.77 / 0.77 / -0.4%
tpch_q09/datafusion:parquet 309293568 / 309992739 / -0.2% 366483748 / 377617099 / -2.9% 0.84 / 0.82 / +2.8%
tpch_q10/datafusion:parquet 311033463 / 312607055 / -0.5% 370302406 / 374635413 / -1.2% 0.84 / 0.83 / +0.7%
tpch_q11/datafusion:parquet 127558555 / 126904955 / +0.5% 149264316 / 152092729 / -1.9% 0.85 / 0.83 / +2.4%
tpch_q12/datafusion:parquet 82526446 / 82490217 / +0.0% 119762125 / 119609598 / +0.1% 0.69 / 0.69 / -0.1%
tpch_q13/datafusion:parquet 210215072 / 210792627 / -0.3% 240449936 / 238505978 / +0.8% 0.87 / 0.88 / -1.1%
tpch_q14/datafusion:parquet 85284094 / 86178289 / -1.0% 194867724 / 190854700 / +2.1% 0.44 / 0.45 / -3.1%
tpch_q15/datafusion:parquet 105883237 / 106397081 / -0.5% 153080097 / 152062782 / +0.7% 0.69 / 0.70 / -1.1%
tpch_q16/datafusion:parquet 94780434 / 95891635 / -1.2% 123059762 / 122835240 / +0.2% 0.77 / 0.78 / -1.3%
tpch_q17/datafusion:parquet 213620327 / 215828919 / -1.0% 255285765 / 258232254 / -1.1% 0.84 / 0.84 / +0.1%
tpch_q18/datafusion:parquet 267467102 / 267911042 / -0.2% 312876382 / 315891179 / -1.0% 0.85 / 0.85 / +0.8%
tpch_q19/datafusion:parquet 108904911 / 108165843 / +0.7% 165662114 / 161949085 / +2.3% 0.66 / 0.67 / -1.6%
tpch_q20/datafusion:parquet 185305365 / 185545816 / -0.1% 252163683 / 247539770 / +1.9% 0.73 / 0.75 / -2.0%
tpch_q21/datafusion:parquet 244592055 / 244526968 / +0.0% 310275861 / 313261935 / -1.0% 0.79 / 0.78 / +1.0%
tpch_q22/datafusion:parquet 150260845 / 150249864 / +0.0% 171462442 / 175023324 / -2.0% 0.88 / 0.86 / +2.1%
duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 33461790 / 33717250 / -0.8% 75223189 / 72546071 / +3.7% 0.44 / 0.46 / -4.3%
tpch_q02/duckdb:vortex-file-compressed 28874169 / 28535483 / +1.2% 42633975 / 42812168 / -0.4% 0.68 / 0.67 / +1.6%
tpch_q03/duckdb:vortex-file-compressed 52992448 / 52395190 / +1.1% 106341039 / 107856916 / -1.4% 0.50 / 0.49 / +2.6%
tpch_q04/duckdb:vortex-file-compressed 51315900 / 51642374 / -0.6% 93287227 / 90715191 / +2.8% 0.55 / 0.57 / -3.4%
tpch_q05/duckdb:vortex-file-compressed 68563021 / 68284064 / +0.4% 113063460 / 112287453 / +0.7% 0.61 / 0.61 / -0.3%
tpch_q06/duckdb:vortex-file-compressed 15634357 / 15523980 / +0.7% 52203331 / 54001994 / -3.3% 0.30 / 0.29 / +4.2%
tpch_q07/duckdb:vortex-file-compressed 55385518 / 56289317 / -1.6% 111136468 / 109517607 / +1.5% 0.50 / 0.51 / -3.0%
tpch_q08/duckdb:vortex-file-compressed 89364538 / 87993665 / +1.6% 136202140 / 136034326 / +0.1% 0.66 / 0.65 / +1.4%
tpch_q09/duckdb:vortex-file-compressed 102734895 / 104478542 / -1.7% 160908623 / 160545830 / +0.2% 0.64 / 0.65 / -1.9%
tpch_q10/duckdb:vortex-file-compressed 97186554 / 96530974 / +0.7% 147568746 / 149480239 / -1.3% 0.66 / 0.65 / +2.0%
tpch_q11/duckdb:vortex-file-compressed 13198800 / 13271624 / -0.5% 29388073 / 28437282 / +3.3% 0.45 / 0.47 / -3.8%
tpch_q12/duckdb:vortex-file-compressed 43529841 / 44829286 / -2.9% 84317270 / 82101250 / +2.7% 0.52 / 0.55 / -5.5%
tpch_q13/duckdb:vortex-file-compressed 72538534 / 73482635 / -1.3% 103595401 / 100644151 / +2.9% 0.70 / 0.73 / -4.1%
tpch_q14/duckdb:vortex-file-compressed 28537623 / 28597524 / -0.2% 73827421 / 75301257 / -2.0% 0.39 / 0.38 / +1.8%
tpch_q15/duckdb:vortex-file-compressed 24802780 / 24850425 / -0.2% 65439254 / 64680737 / +1.2% 0.38 / 0.38 / -1.3%
tpch_q16/duckdb:vortex-file-compressed 48478180 / 48665139 / -0.4% 58911202 / 57917111 / +1.7% 0.82 / 0.84 / -2.1%
tpch_q17/duckdb:vortex-file-compressed 35460009 / 35017407 / +1.3% 68081104 / 68787564 / -1.0% 0.52 / 0.51 / +2.3%
tpch_q18/duckdb:vortex-file-compressed 108510754 / 101349193 / +7.1% 123850217 / 121104468 / +2.3% 0.88 / 0.84 / +4.7%
tpch_q19/duckdb:vortex-file-compressed 27171769 / 27586274 / -1.5% 74298865 / 75468750 / -1.6% 0.37 / 0.37 / +0.0%
tpch_q20/duckdb:vortex-file-compressed 42164384 / 42028653 / +0.3% 93493715 / 94143242 / -0.7% 0.45 / 0.45 / +1.0%
tpch_q21/duckdb:vortex-file-compressed 95773245 / 92926669 / +3.1% 149574676 / 149459387 / +0.1% 0.64 / 0.62 / +3.0%
tpch_q22/duckdb:vortex-file-compressed 33427376 / 32967821 / +1.4% 48849299 / 50673568 / -3.6% 0.68 / 0.65 / +5.2%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67790377 / 68059780 / -0.4% 86411122 / 89550266 / -3.5% 0.78 / 0.76 / +3.2%
tpch_q02/duckdb:parquet 86505861 / 87335480 / -0.9% 97518101 / 97718209 / -0.2% 0.89 / 0.89 / -0.7%
tpch_q03/duckdb:parquet 110386841 / 110511015 / -0.1% 140115451 / 142463897 / -1.6% 0.79 / 0.78 / +1.6%
tpch_q04/duckdb:parquet 76887713 / 76502436 / +0.5% 98189839 / 99440715 / -1.3% 0.78 / 0.77 / +1.8%
tpch_q05/duckdb:parquet 122796840 / 124172926 / -1.1% 155251947 / 157124433 / -1.2% 0.79 / 0.79 / +0.1%
tpch_q06/duckdb:parquet 35716478 / 35619223 / +0.3% 58478079 / 66005123 / -11.4% 🟢 0.61 / 0.54 / +13.2%
tpch_q07/duckdb:parquet 117017784 / 117398526 / -0.3% 153444840 / 154106673 / -0.4% 0.76 / 0.76 / +0.1%
tpch_q08/duckdb:parquet 148795435 / 147136506 / +1.1% 189601581 / 191273949 / -0.9% 0.78 / 0.77 / +2.0%
tpch_q09/duckdb:parquet 237046847 / 236712079 / +0.1% 280260994 / 283406742 / -1.1% 0.85 / 0.84 / +1.3%
tpch_q10/duckdb:parquet 313352176 / 314185931 / -0.3% 335753047 / 343372079 / -2.2% 0.93 / 0.92 / +2.0%
tpch_q11/duckdb:parquet 43468675 / 43742423 / -0.6% 50808338 / 50965528 / -0.3% 0.86 / 0.86 / -0.3%
tpch_q12/duckdb:parquet 70005939 / 71137236 / -1.6% 91290453 / 91779500 / -0.5% 0.77 / 0.78 / -1.1%
tpch_q13/duckdb:parquet 292902580 / 293366910 / -0.2% 307636432 / 308621731 / -0.3% 0.95 / 0.95 / +0.2%
tpch_q14/duckdb:parquet 101526861 / 102273386 / -0.7% 136828828 / 141851063 / -3.5% 0.74 / 0.72 / +2.9%
tpch_q15/duckdb:parquet 59009060 / 57070305 / +3.4% 86120911 / 86533692 / -0.5% 0.69 / 0.66 / +3.9%
tpch_q16/duckdb:parquet 100597679 / 100916878 / -0.3% 107061916 / 107993358 / -0.9% 0.94 / 0.93 / +0.6%
tpch_q17/duckdb:parquet 83134093 / 82884448 / +0.3% 110967247 / 124989202 / -11.2% 🟢 0.75 / 0.66 / +13.0%
tpch_q18/duckdb:parquet 157830628 / 157350187 / +0.3% 171681139 / 174516370 / -1.6% 0.92 / 0.90 / +2.0%
tpch_q19/duckdb:parquet 98795287 / 98221882 / +0.6% 130321660 / 134004453 / -2.7% 0.76 / 0.73 / +3.4%
tpch_q20/duckdb:parquet 146793142 / 147378796 / -0.4% 183719685 / 187264562 / -1.9% 0.80 / 0.79 / +1.5%
tpch_q21/duckdb:parquet 253370825 / 251811968 / +0.6% 279189277 / 275521800 / +1.3% 0.91 / 0.91 / -0.7%
tpch_q22/duckdb:parquet 169111806 / 168385842 / +0.4% 180001735 / 180610188 / -0.3% 0.94 / 0.93 / +0.8%

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant