Skip to content

Re-prune and re-filter Scan V2 chunks when dynamic bounds tighten - #11145

Draft
joseph-isaacs wants to merge 3 commits into
developfrom
ji/scan-v2-dynamic-filter-recheck
Draft

joseph-isaacs wants to merge 3 commits into
developfrom
ji/scan-v2-dynamic-filter-recheck

Conversation

@joseph-isaacs

Copy link
Copy Markdown
Contributor

Summary

Split out of #10964. Stacked on #11144 and #11143, whose commits it includes. Review only the top commit.

A chunk evaluated a dynamic conjunct, such as a TopK or join bound, once, against the bound that existed when the chunk started. Chunks queued behind a scan's first results therefore read and filtered data that a tightened bound already excluded, and passed rows to projection that a later bound rejects.

Changes

  • Before prefetching a chunk's data, the chunk is pruned again with each dynamic conjunct whose bound changed since its rows were pruned, and newly excluded edge zones are trimmed.
  • Before projecting, the chunk is filtered again with each dynamic conjunct whose bound changed since it was evaluated.
  • Versions are sampled before evaluation, so an update during IO or compute is checked again. Rechecks do not train the conjunct order.
  • Tests cover a queued chunk re-pruning after a tightened bound (with read counts) and a re-filter after another conjunct.

Local validation

4 vCPU cloud VM, TPC-H SF10 Vortex files, Scan V2, 2 alternating (ABBA) rounds × 5 iterations. Base-vs-base noise: +1.3% geomean, up to ±8% per query.

Engine vs develop (median / min)
DuckDB +1.8% / +0.1% (noise)

TPC-H has no TopK over a base table, so dynamic filters barely occur there. The target workloads are ClickBench-style ORDER BY … LIMIT queries, which the CI ClickBench run covers. The DataFusion run is still in progress locally.

  • cargo nextest run -p vortex-layout: 750 passed.
  • Pinned-nightly rustfmt --check on changed files: clean.
  • cargo clippy: not yet run.

Generated by Claude Code

joseph-isaacs and others added 3 commits November 3, 2026 11:48
Every conjunct plan was wrapped in a Filter, which compiled the predicate over all rows of the
chunk and only then applied the rows earlier conjuncts kept. A selective first conjunct
therefore saved no decoding or evaluation work for later ones. Plan conjuncts unwrapped so the
selected rows reach their leaves, and wrap only when at least half of the rows remain, where
evaluating the whole batch vectorized is cheaper than gathering it.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniB9gdaaoxAeUkYj48Q3
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Conjuncts ran in an order picked from selectivity alone, so an expensive but selective
predicate, such as a string match, could run before a cheap numeric filter that rejects
nearly as many rows. Share per-file estimates of each conjunct's CPU cost per row and pass
rate, and order chunks by expected cost per rejected row once every conjunct has a few
observations, switching only for a clear estimated gain. Recent observations are weighted
more, a new dynamic bound resets its conjunct's estimates, and an occasional chunk swaps two
neighbours so a conjunct hidden by short-circuiting is still measured. Chunks keep the order
they started with.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniB9gdaaoxAeUkYj48Q3
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
A chunk evaluated a dynamic conjunct, such as a TopK or join bound, once, against whatever
bound existed when the chunk started. Chunks queued behind a scan's first results therefore
read and filtered data the tightened bound already excluded, and passed rows to projection
that a later bound rejects.

Before prefetching a chunk's data, prune it again with each dynamic conjunct whose bound
changed since the chunk's rows were pruned, and trim the newly excluded edge zones. Before
projecting, filter again with each dynamic conjunct whose bound changed since it was
evaluated. Versions are sampled before evaluation, so an update during IO or compute is
checked again. Rechecks do not train the conjunct order.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniB9gdaaoxAeUkYj48Q3
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added changelog/performance A performance improvement action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Nov 3, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 3, 2026
@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 0a0c827 clickbench-nvme 1 Explore Profiling Data
🟢 Done 0a0c827 tpcds-nvme 1 Explore Profiling Data
🟢 Done 0a0c827 tpch-nvme 1 Explore Profiling Data
🟢 Done 0a0c827 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 0a0c827 polarsignals 1 Explore Profiling Data
🟢 Done 0a0c827 tpch-s3 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 0a0c827a vs base 246a397e
Vortex (geomean): hot 0.995x ➖ · cold 0.971x ➖


datafusion / vortex-file-compressed / ns (0.995x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44167060 / 44174877 / -0.0% 84718656 / 83381591 / +1.6% 0.52 / 0.53 / -1.6%
polarsignals_q01/datafusion:vortex-file-compressed 52818084 / 59498684 / -11.2% 🟢 112150897 / 113392846 / -1.1% 0.47 / 0.52 / -10.2%
polarsignals_q02/datafusion:vortex-file-compressed 11961304 / 11978216 / -0.1% 42228811 / 49588551 / -14.8% 🟢 0.28 / 0.24 / +17.3%
polarsignals_q03/datafusion:vortex-file-compressed 56303880 / 54233533 / +3.8% 114629205 / 112439358 / +1.9% 0.49 / 0.48 / +1.8%
polarsignals_q04/datafusion:vortex-file-compressed 9182698 / 9157702 / +0.3% 37830095 / 40279396 / -6.1% 0.24 / 0.23 / +6.8%
polarsignals_q05/datafusion:vortex-file-compressed 11550828 / 11581688 / -0.3% 43071137 / 44512288 / -3.2% 0.27 / 0.26 / +3.1%
polarsignals_q06/datafusion:vortex-file-compressed 22821196 / 23169506 / -1.5% 52683526 / 52769004 / -0.2% 0.43 / 0.44 / -1.3%
polarsignals_q07/datafusion:vortex-file-compressed 10507208 / 10570672 / -0.6% 39838671 / 41644590 / -4.3% 0.26 / 0.25 / +3.9%
polarsignals_q08/datafusion:vortex-file-compressed 98663060 / 97258934 / +1.4% 158508602 / 150877578 / +5.1% 0.62 / 0.64 / -3.4%
polarsignals_q09/datafusion:vortex-file-compressed 10177590 / 9737686 / +4.5% 36833550 / 39267571 / -6.2% 0.28 / 0.25 / +11.4%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 0a0c827a vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Engines: DataFusion No clear signal (-0.9%, low confidence) · DuckDB No clear signal (-0.5%, low confidence)
Vortex (geomean): hot 0.991x ➖ · cold 0.970x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.985x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.991x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15550549 / 16263915 / -4.4% 41899332 / 44263199 / -5.3% 0.37 / 0.37 / +1.0%
tpch_q02/datafusion:vortex-file-compressed 16935491 / 16894974 / +0.2% 34726420 / 36611616 / -5.1% 0.49 / 0.46 / +5.7%
tpch_q03/datafusion:vortex-file-compressed 19728393 / 19527766 / +1.0% 45987040 / 49847443 / -7.7% 0.43 / 0.39 / +9.5%
tpch_q04/datafusion:vortex-file-compressed 10981552 / 10188611 / +7.8% 31704358 / 35817404 / -11.5% 🟢 0.35 / 0.28 / +21.8%
tpch_q05/datafusion:vortex-file-compressed 36874254 / 37541382 / -1.8% 63743361 / 67849249 / -6.1% 0.58 / 0.55 / +4.5%
tpch_q06/datafusion:vortex-file-compressed 5938292 / 5955274 / -0.3% 25955282 / 28481717 / -8.9% 0.23 / 0.21 / +9.4%
tpch_q07/datafusion:vortex-file-compressed 51690421 / 51398304 / +0.6% 80201363 / 82045194 / -2.2% 0.64 / 0.63 / +2.9%
tpch_q08/datafusion:vortex-file-compressed 52034856 / 51875388 / +0.3% 73823569 / 80701452 / -8.5% 0.70 / 0.64 / +9.7%
tpch_q09/datafusion:vortex-file-compressed 47782071 / 47995869 / -0.4% 74701779 / 80826300 / -7.6% 0.64 / 0.59 / +7.7%
tpch_q10/datafusion:vortex-file-compressed 17085932 / 17741482 / -3.7% 47849290 / 53082340 / -9.9% 0.36 / 0.33 / +6.8%
tpch_q11/datafusion:vortex-file-compressed 14129520 / 14031627 / +0.7% 32164527 / 33512469 / -4.0% 0.44 / 0.42 / +4.9%
tpch_q12/datafusion:vortex-file-compressed 18525885 / 18328359 / +1.1% 41975450 / 45157861 / -7.0% 0.44 / 0.41 / +8.7%
tpch_q13/datafusion:vortex-file-compressed 19466870 / 19616934 / -0.8% 40340963 / 38185157 / +5.6% 0.48 / 0.51 / -6.1%
tpch_q14/datafusion:vortex-file-compressed 14655622 / 14594152 / +0.4% 43475550 / 39735581 / +9.4% 0.34 / 0.37 / -8.2%
tpch_q15/datafusion:vortex-file-compressed 19112248 / 18763971 / +1.9% 41940757 / 43533246 / -3.7% 0.46 / 0.43 / +5.7%
tpch_q16/datafusion:vortex-file-compressed 18038211 / 18234276 / -1.1% 39494554 / 37635522 / +4.9% 0.46 / 0.48 / -5.7%
tpch_q17/datafusion:vortex-file-compressed 28154937 / 28378421 / -0.8% 59970302 / 61847418 / -3.0% 0.47 / 0.46 / +2.3%
tpch_q18/datafusion:vortex-file-compressed 35582355 / 35305543 / +0.8% 56963456 / 61599150 / -7.5% 0.62 / 0.57 / +9.0%
tpch_q19/datafusion:vortex-file-compressed 9812862 / 11827307 / -17.0% 🟢 37485963 / 35891404 / +4.4% 0.26 / 0.33 / -20.6%
tpch_q20/datafusion:vortex-file-compressed 20292476 / 20441467 / -0.7% 42744294 / 46957425 / -9.0% 0.47 / 0.44 / +9.1%
tpch_q21/datafusion:vortex-file-compressed 38390965 / 38735030 / -0.9% 71778443 / 69895942 / +2.7% 0.53 / 0.55 / -3.5%
tpch_q22/datafusion:vortex-file-compressed 10645373 / 10820078 / -1.6% 29948235 / 29933093 / +0.1% 0.36 / 0.36 / -1.7%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71892410 / 71895679 / -0.0% 86776663 / 90101832 / -3.7% 0.83 / 0.80 / +3.8%
tpch_q02/datafusion:parquet 75998424 / 76098843 / -0.1% 90152503 / 90855700 / -0.8% 0.84 / 0.84 / +0.6%
tpch_q03/datafusion:parquet 81787581 / 81802859 / -0.0% 103052980 / 104624570 / -1.5% 0.79 / 0.78 / +1.5%
tpch_q04/datafusion:parquet 39262120 / 39443450 / -0.5% 55327926 / 56105007 / -1.4% 0.71 / 0.70 / +0.9%
tpch_q05/datafusion:parquet 110452317 / 110243073 / +0.2% 135087363 / 137233632 / -1.6% 0.82 / 0.80 / +1.8%
tpch_q06/datafusion:parquet 31312545 / 31285870 / +0.1% 46409504 / 48958203 / -5.2% 0.67 / 0.64 / +5.6%
tpch_q07/datafusion:parquet 112864905 / 112628638 / +0.2% 136038113 / 140164965 / -2.9% 0.83 / 0.80 / +3.2%
tpch_q08/datafusion:parquet 117518274 / 117365432 / +0.1% 142383020 / 144858333 / -1.7% 0.83 / 0.81 / +1.9%
tpch_q09/datafusion:parquet 138107912 / 137648335 / +0.3% 164448227 / 165675523 / -0.7% 0.84 / 0.83 / +1.1%
tpch_q10/datafusion:parquet 103652050 / 104232599 / -0.6% 124596471 / 131557659 / -5.3% 0.83 / 0.79 / +5.0%
tpch_q11/datafusion:parquet 63091101 / 61117621 / +3.2% 81670177 / 83469534 / -2.2% 0.77 / 0.73 / +5.5%
tpch_q12/datafusion:parquet 63662037 / 63935260 / -0.4% 83959705 / 85713684 / -2.0% 0.76 / 0.75 / +1.7%
tpch_q13/datafusion:parquet 143750469 / 143039529 / +0.5% 160447364 / 163205266 / -1.7% 0.90 / 0.88 / +2.2%
tpch_q14/datafusion:parquet 47381874 / 47461665 / -0.2% 67343889 / 70523444 / -4.5% 0.70 / 0.67 / +4.5%
tpch_q15/datafusion:parquet 74554798 / 73406392 / +1.6% 92864291 / 92742867 / +0.1% 0.80 / 0.79 / +1.4%
tpch_q16/datafusion:parquet 42673862 / 43563928 / -2.0% 61102728 / 63270122 / -3.4% 0.70 / 0.69 / +1.4%
tpch_q17/datafusion:parquet 123558522 / 123301020 / +0.2% 144834465 / 147211074 / -1.6% 0.85 / 0.84 / +1.9%
tpch_q18/datafusion:parquet 120380817 / 121046192 / -0.5% 141883367 / 142737474 / -0.6% 0.85 / 0.85 / +0.0%
tpch_q19/datafusion:parquet 56658563 / 57598916 / -1.6% 80105292 / 84233107 / -4.9% 0.71 / 0.68 / +3.4%
tpch_q20/datafusion:parquet 78554749 / 77933849 / +0.8% 96604916 / 103206085 / -6.4% 0.81 / 0.76 / +7.7%
tpch_q21/datafusion:parquet 113322122 / 113408807 / -0.1% 137956375 / 138663269 / -0.5% 0.82 / 0.82 / +0.4%
tpch_q22/datafusion:parquet 51587766 / 52165988 / -1.1% 67729028 / 67936274 / -0.3% 0.76 / 0.77 / -0.8%
duckdb / vortex-file-compressed / ns (0.991x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 8350900 / 9761332 / -14.4% 🟢 19490032 / 18912466 / +3.1% 0.43 / 0.52 / -17.0%
tpch_q02/duckdb:vortex-file-compressed 15192680 / 15133618 / +0.4% 24853113 / 25240568 / -1.5% 0.61 / 0.60 / +2.0%
tpch_q03/duckdb:vortex-file-compressed 18590539 / 18478693 / +0.6% 34269028 / 35420760 / -3.3% 0.54 / 0.52 / +4.0%
tpch_q04/duckdb:vortex-file-compressed 12515434 / 12526559 / -0.1% 25542694 / 26797289 / -4.7% 0.49 / 0.47 / +4.8%
tpch_q05/duckdb:vortex-file-compressed 20565384 / 19984330 / +2.9% 35521480 / 35135251 / +1.1% 0.58 / 0.57 / +1.8%
tpch_q06/duckdb:vortex-file-compressed 4815531 / 4707229 / +2.3% 13304506 / 14897236 / -10.7% 🟢 0.36 / 0.32 / +14.5%
tpch_q07/duckdb:vortex-file-compressed 24355703 / 24433501 / -0.3% 37567889 / 40669053 / -7.6% 0.65 / 0.60 / +7.9%
tpch_q08/duckdb:vortex-file-compressed 21129651 / 21158117 / -0.1% 36361631 / 37360088 / -2.7% 0.58 / 0.57 / +2.6%
tpch_q09/duckdb:vortex-file-compressed 22435021 / 21780886 / +3.0% 38551512 / 39377115 / -2.1% 0.58 / 0.55 / +5.2%
tpch_q10/duckdb:vortex-file-compressed 22373465 / 23061494 / -3.0% 39091523 / 40021706 / -2.3% 0.57 / 0.58 / -0.7%
tpch_q11/duckdb:vortex-file-compressed 8023832 / 8190706 / -2.0% 17191812 / 17311375 / -0.7% 0.47 / 0.47 / -1.4%
tpch_q12/duckdb:vortex-file-compressed 14595653 / 14552453 / +0.3% 26559847 / 27518794 / -3.5% 0.55 / 0.53 / +3.9%
tpch_q13/duckdb:vortex-file-compressed 20164089 / 19645042 / +2.6% 31678182 / 32940206 / -3.8% 0.64 / 0.60 / +6.7%
tpch_q14/duckdb:vortex-file-compressed 11373953 / 11380023 / -0.1% 23552282 / 24837163 / -5.2% 0.48 / 0.46 / +5.4%
tpch_q15/duckdb:vortex-file-compressed 8452922 / 8545626 / -1.1% 19242265 / 20629863 / -6.7% 0.44 / 0.41 / +6.0%
tpch_q16/duckdb:vortex-file-compressed 16744219 / 16616443 / +0.8% 23718626 / 22882070 / +3.7% 0.71 / 0.73 / -2.8%
tpch_q17/duckdb:vortex-file-compressed 12417376 / 12625912 / -1.7% 27414839 / 26443070 / +3.7% 0.45 / 0.48 / -5.1%
tpch_q18/duckdb:vortex-file-compressed 23948106 / 24532908 / -2.4% 32738264 / 34479790 / -5.1% 0.73 / 0.71 / +2.8%
tpch_q19/duckdb:vortex-file-compressed 11564719 / 12047148 / -4.0% 25708496 / 25716209 / -0.0% 0.45 / 0.47 / -4.0%
tpch_q20/duckdb:vortex-file-compressed 14280897 / 14345954 / -0.5% 30048010 / 30444524 / -1.3% 0.48 / 0.47 / +0.9%
tpch_q21/duckdb:vortex-file-compressed 36902583 / 37122052 / -0.6% 56292076 / 57121904 / -1.5% 0.66 / 0.65 / +0.9%
tpch_q22/duckdb:vortex-file-compressed 16823132 / 16816566 / +0.0% 27199640 / 25979595 / +4.7% 0.62 / 0.65 / -4.4%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47611706 / 47858045 / -0.5% 53731934 / 54404459 / -1.2% 0.89 / 0.88 / +0.7%
tpch_q02/duckdb:parquet 48286229 / 48336474 / -0.1% 55240144 / 55353685 / -0.2% 0.87 / 0.87 / +0.1%
tpch_q03/duckdb:parquet 60157740 / 60227192 / -0.1% 67768239 / 68349323 / -0.9% 0.89 / 0.88 / +0.7%
tpch_q04/duckdb:parquet 34674175 / 34720265 / -0.1% 42682873 / 43310065 / -1.4% 0.81 / 0.80 / +1.3%
tpch_q05/duckdb:parquet 66931544 / 67254941 / -0.5% 77460116 / 77626992 / -0.2% 0.86 / 0.87 / -0.3%
tpch_q06/duckdb:parquet 21416294 / 21944900 / -2.4% 27977664 / 27248080 / +2.7% 0.77 / 0.81 / -5.0%
tpch_q07/duckdb:parquet 63769619 / 63950143 / -0.3% 71386369 / 73664982 / -3.1% 0.89 / 0.87 / +2.9%
tpch_q08/duckdb:parquet 75416236 / 75776774 / -0.5% 86548296 / 86626463 / -0.1% 0.87 / 0.87 / -0.4%
tpch_q09/duckdb:parquet 107652248 / 107707033 / -0.1% 118539114 / 119514067 / -0.8% 0.91 / 0.90 / +0.8%
tpch_q10/duckdb:parquet 105587669 / 105854709 / -0.3% 116780913 / 118365462 / -1.3% 0.90 / 0.89 / +1.1%
tpch_q11/duckdb:parquet 29295400 / 29396110 / -0.3% 34642622 / 34577937 / +0.2% 0.85 / 0.85 / -0.5%
tpch_q12/duckdb:parquet 37105088 / 37190745 / -0.2% 43918556 / 44080916 / -0.4% 0.84 / 0.84 / +0.1%
tpch_q13/duckdb:parquet 175025895 / 174943548 / +0.0% 182143784 / 181832631 / +0.2% 0.96 / 0.96 / -0.1%
tpch_q14/duckdb:parquet 42393611 / 42368298 / +0.1% 50560552 / 51640657 / -2.1% 0.84 / 0.82 / +2.2%
tpch_q15/duckdb:parquet 32672517 / 32604664 / +0.2% 40667008 / 41186217 / -1.3% 0.80 / 0.79 / +1.5%
tpch_q16/duckdb:parquet 47149510 / 47438886 / -0.6% 52876175 / 52839714 / +0.1% 0.89 / 0.90 / -0.7%
tpch_q17/duckdb:parquet 47908064 / 47948653 / -0.1% 57413955 / 56916284 / +0.9% 0.83 / 0.84 / -1.0%
tpch_q18/duckdb:parquet 73731976 / 74218067 / -0.7% 79728114 / 81836806 / -2.6% 0.92 / 0.91 / +2.0%
tpch_q19/duckdb:parquet 47021806 / 47859814 / -1.8% 56048202 / 54599501 / +2.7% 0.84 / 0.88 / -4.3%
tpch_q20/duckdb:parquet 63516977 / 63470737 / +0.1% 72702299 / 74451035 / -2.3% 0.87 / 0.85 / +2.5%
tpch_q21/duckdb:parquet 106633634 / 106811631 / -0.2% 114602458 / 115756341 / -1.0% 0.93 / 0.92 / +0.8%
tpch_q22/duckdb:parquet 50416780 / 50510487 / -0.2% 58118335 / 58832593 / -1.2% 0.87 / 0.86 / +1.0%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 0a0c827a vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): hot 0.998x ➖ · cold 0.978x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.988x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 92792985 / 92421374 / +0.4% 154851922 / 147337644 / +5.1% 0.60 / 0.63 / -4.5%
tpch_q02/datafusion:vortex-file-compressed 64702775 / 65027104 / -0.5% 94997946 / 94796662 / +0.2% 0.68 / 0.69 / -0.7%
tpch_q03/datafusion:vortex-file-compressed 63947369 / 63028520 / +1.5% 120206884 / 120349559 / -0.1% 0.53 / 0.52 / +1.6%
tpch_q04/datafusion:vortex-file-compressed 33681987 / 33815475 / -0.4% 72456951 / 69506239 / +4.2% 0.46 / 0.49 / -4.5%
tpch_q05/datafusion:vortex-file-compressed 118600919 / 117313380 / +1.1% 170533039 / 176710106 / -3.5% 0.70 / 0.66 / +4.8%
tpch_q06/datafusion:vortex-file-compressed 10186937 / 10725012 / -5.0% 58119353 / 57362676 / +1.3% 0.18 / 0.19 / -6.3%
tpch_q07/datafusion:vortex-file-compressed 135286522 / 134275774 / +0.8% 195699502 / 209952759 / -6.8% 0.69 / 0.64 / +8.1%
tpch_q08/datafusion:vortex-file-compressed 145483571 / 142650106 / +2.0% 216882569 / 221708280 / -2.2% 0.67 / 0.64 / +4.3%
tpch_q09/datafusion:vortex-file-compressed 184696331 / 184132835 / +0.3% 270838025 / 257568148 / +5.2% 0.68 / 0.71 / -4.6%
tpch_q10/datafusion:vortex-file-compressed 70040379 / 69455539 / +0.8% 136171102 / 134716861 / +1.1% 0.51 / 0.52 / -0.2%
tpch_q11/datafusion:vortex-file-compressed 43489857 / 43143661 / +0.8% 71444558 / 67640381 / +5.6% 0.61 / 0.64 / -4.6%
tpch_q12/datafusion:vortex-file-compressed 34911117 / 35061881 / -0.4% 84582587 / 85227270 / -0.8% 0.41 / 0.41 / +0.3%
tpch_q13/datafusion:vortex-file-compressed 48556564 / 48574220 / -0.0% 86615934 / 87462734 / -1.0% 0.56 / 0.56 / +0.9%
tpch_q14/datafusion:vortex-file-compressed 21061705 / 21632584 / -2.6% 87725507 / 86011756 / +2.0% 0.24 / 0.25 / -4.5%
tpch_q15/datafusion:vortex-file-compressed 33328924 / 33883815 / -1.6% 90490425 / 91939519 / -1.6% 0.37 / 0.37 / -0.1%
tpch_q16/datafusion:vortex-file-compressed 37132924 / 37360931 / -0.6% 68737344 / 67235326 / +2.2% 0.54 / 0.56 / -2.8%
tpch_q17/datafusion:vortex-file-compressed 176691934 / 179258740 / -1.4% 232962571 / 225548853 / +3.3% 0.76 / 0.79 / -4.6%
tpch_q18/datafusion:vortex-file-compressed 204701596 / 208064713 / -1.6% 276790527 / 265841334 / +4.1% 0.74 / 0.78 / -5.5%
tpch_q19/datafusion:vortex-file-compressed 29788023 / 30852811 / -3.5% 89635542 / 90459069 / -0.9% 0.33 / 0.34 / -2.6%
tpch_q20/datafusion:vortex-file-compressed 59845447 / 60119739 / -0.5% 118529616 / 116242771 / +2.0% 0.50 / 0.52 / -2.4%
tpch_q21/datafusion:vortex-file-compressed 177046726 / 179920903 / -1.6% 241085885 / 236016105 / +2.1% 0.73 / 0.76 / -3.7%
tpch_q22/datafusion:vortex-file-compressed 25008818 / 24937759 / +0.3% 54986929 / 53553354 / +2.7% 0.45 / 0.47 / -2.3%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87988165 / 87372046 / +0.7% 125550990 / 127117134 / -1.2% 0.70 / 0.69 / +2.0%
tpch_q02/datafusion:parquet 173736327 / 173541457 / +0.1% 200147538 / 200787531 / -0.3% 0.87 / 0.86 / +0.4%
tpch_q03/datafusion:parquet 134878377 / 135400852 / -0.4% 177519701 / 177515979 / +0.0% 0.76 / 0.76 / -0.4%
tpch_q04/datafusion:parquet 57076028 / 57301728 / -0.4% 88513620 / 90634805 / -2.3% 0.64 / 0.63 / +2.0%
tpch_q05/datafusion:parquet 167963798 / 167450726 / +0.3% 218280127 / 216918602 / +0.6% 0.77 / 0.77 / -0.3%
tpch_q06/datafusion:parquet 36267132 / 36759711 / -1.3% 75828631 / 73377160 / +3.3% 0.48 / 0.50 / -4.5%
tpch_q07/datafusion:parquet 215510643 / 217452485 / -0.9% 271040944 / 278757728 / -2.8% 0.80 / 0.78 / +1.9%
tpch_q08/datafusion:parquet 217036455 / 217547432 / -0.2% 284219458 / 281050041 / +1.1% 0.76 / 0.77 / -1.3%
tpch_q09/datafusion:parquet 308327995 / 309992739 / -0.5% 371659544 / 377617099 / -1.6% 0.83 / 0.82 / +1.1%
tpch_q10/datafusion:parquet 311240198 / 312607055 / -0.4% 363387762 / 374635413 / -3.0% 0.86 / 0.83 / +2.6%
tpch_q11/datafusion:parquet 126860560 / 126904955 / -0.0% 149893362 / 152092729 / -1.4% 0.85 / 0.83 / +1.4%
tpch_q12/datafusion:parquet 82758122 / 82490217 / +0.3% 116051514 / 119609598 / -3.0% 0.71 / 0.69 / +3.4%
tpch_q13/datafusion:parquet 210310043 / 210792627 / -0.2% 239700982 / 238505978 / +0.5% 0.88 / 0.88 / -0.7%
tpch_q14/datafusion:parquet 85210261 / 86178289 / -1.1% 183017180 / 190854700 / -4.1% 0.47 / 0.45 / +3.1%
tpch_q15/datafusion:parquet 104185525 / 106397081 / -2.1% 156243203 / 152062782 / +2.7% 0.67 / 0.70 / -4.7%
tpch_q16/datafusion:parquet 95199039 / 95891635 / -0.7% 123315368 / 122835240 / +0.4% 0.77 / 0.78 / -1.1%
tpch_q17/datafusion:parquet 212829849 / 215828919 / -1.4% 256426169 / 258232254 / -0.7% 0.83 / 0.84 / -0.7%
tpch_q18/datafusion:parquet 267102257 / 267911042 / -0.3% 312872849 / 315891179 / -1.0% 0.85 / 0.85 / +0.7%
tpch_q19/datafusion:parquet 108599133 / 108165843 / +0.4% 169377760 / 161949085 / +4.6% 0.64 / 0.67 / -4.0%
tpch_q20/datafusion:parquet 186457080 / 185545816 / +0.5% 249341997 / 247539770 / +0.7% 0.75 / 0.75 / -0.2%
tpch_q21/datafusion:parquet 243808710 / 244526968 / -0.3% 307152381 / 313261935 / -2.0% 0.79 / 0.78 / +1.7%
tpch_q22/datafusion:parquet 150895944 / 150249864 / +0.4% 176125075 / 175023324 / +0.6% 0.86 / 0.86 / -0.2%
duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 34343100 / 33717250 / +1.9% 61984615 / 72546071 / -14.6% 🟢 0.55 / 0.46 / +19.2%
tpch_q02/duckdb:vortex-file-compressed 28869821 / 28535483 / +1.2% 42745896 / 42812168 / -0.2% 0.68 / 0.67 / +1.3%
tpch_q03/duckdb:vortex-file-compressed 53473729 / 52395190 / +2.1% 98056252 / 107856916 / -9.1% 0.55 / 0.49 / +12.3%
tpch_q04/duckdb:vortex-file-compressed 51961646 / 51642374 / +0.6% 84019763 / 90715191 / -7.4% 0.62 / 0.57 / +8.6%
tpch_q05/duckdb:vortex-file-compressed 68909833 / 68284064 / +0.9% 107270566 / 112287453 / -4.5% 0.64 / 0.61 / +5.6%
tpch_q06/duckdb:vortex-file-compressed 15435715 / 15523980 / -0.6% 47760383 / 54001994 / -11.6% 🟢 0.32 / 0.29 / +12.4%
tpch_q07/duckdb:vortex-file-compressed 54698857 / 56289317 / -2.8% 101820796 / 109517607 / -7.0% 0.54 / 0.51 / +4.5%
tpch_q08/duckdb:vortex-file-compressed 87565343 / 87993665 / -0.5% 128849754 / 136034326 / -5.3% 0.68 / 0.65 / +5.1%
tpch_q09/duckdb:vortex-file-compressed 101424150 / 104478542 / -2.9% 149734014 / 160545830 / -6.7% 0.68 / 0.65 / +4.1%
tpch_q10/duckdb:vortex-file-compressed 95673369 / 96530974 / -0.9% 140534290 / 149480239 / -6.0% 0.68 / 0.65 / +5.4%
tpch_q11/duckdb:vortex-file-compressed 13428518 / 13271624 / +1.2% 29548167 / 28437282 / +3.9% 0.45 / 0.47 / -2.6%
tpch_q12/duckdb:vortex-file-compressed 43564877 / 44829286 / -2.8% 76611619 / 82101250 / -6.7% 0.57 / 0.55 / +4.1%
tpch_q13/duckdb:vortex-file-compressed 70977777 / 73482635 / -3.4% 95521284 / 100644151 / -5.1% 0.74 / 0.73 / +1.8%
tpch_q14/duckdb:vortex-file-compressed 28245441 / 28597524 / -1.2% 70736917 / 75301257 / -6.1% 0.40 / 0.38 / +5.1%
tpch_q15/duckdb:vortex-file-compressed 24781447 / 24850425 / -0.3% 60220554 / 64680737 / -6.9% 0.41 / 0.38 / +7.1%
tpch_q16/duckdb:vortex-file-compressed 48859270 / 48665139 / +0.4% 58981072 / 57917111 / +1.8% 0.83 / 0.84 / -1.4%
tpch_q17/duckdb:vortex-file-compressed 35203752 / 35017407 / +0.5% 63543759 / 68787564 / -7.6% 0.55 / 0.51 / +8.8%
tpch_q18/duckdb:vortex-file-compressed 107032401 / 101349193 / +5.6% 121033185 / 121104468 / -0.1% 0.88 / 0.84 / +5.7%
tpch_q19/duckdb:vortex-file-compressed 27506244 / 27586274 / -0.3% 73852955 / 75468750 / -2.1% 0.37 / 0.37 / +1.9%
tpch_q20/duckdb:vortex-file-compressed 41970427 / 42028653 / -0.1% 90621250 / 94143242 / -3.7% 0.46 / 0.45 / +3.7%
tpch_q21/duckdb:vortex-file-compressed 96310368 / 92926669 / +3.6% 143511396 / 149459387 / -4.0% 0.67 / 0.62 / +7.9%
tpch_q22/duckdb:vortex-file-compressed 33055858 / 32967821 / +0.3% 46985727 / 50673568 / -7.3% 0.70 / 0.65 / +8.1%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67337555 / 68059780 / -1.1% 84572887 / 89550266 / -5.6% 0.80 / 0.76 / +4.8%
tpch_q02/duckdb:parquet 86525311 / 87335480 / -0.9% 95655947 / 97718209 / -2.1% 0.90 / 0.89 / +1.2%
tpch_q03/duckdb:parquet 109793106 / 110511015 / -0.6% 140891681 / 142463897 / -1.1% 0.78 / 0.78 / +0.5%
tpch_q04/duckdb:parquet 76551939 / 76502436 / +0.1% 97760737 / 99440715 / -1.7% 0.78 / 0.77 / +1.8%
tpch_q05/duckdb:parquet 122757228 / 124172926 / -1.1% 155399164 / 157124433 / -1.1% 0.79 / 0.79 / -0.0%
tpch_q06/duckdb:parquet 35411979 / 35619223 / -0.6% 60530234 / 66005123 / -8.3% 0.59 / 0.54 / +8.4%
tpch_q07/duckdb:parquet 117182578 / 117398526 / -0.2% 154417925 / 154106673 / +0.2% 0.76 / 0.76 / -0.4%
tpch_q08/duckdb:parquet 148811938 / 147136506 / +1.1% 189192613 / 191273949 / -1.1% 0.79 / 0.77 / +2.3%
tpch_q09/duckdb:parquet 236013156 / 236712079 / -0.3% 276160467 / 283406742 / -2.6% 0.85 / 0.84 / +2.3%
tpch_q10/duckdb:parquet 313349012 / 314185931 / -0.3% 336328665 / 343372079 / -2.1% 0.93 / 0.92 / +1.8%
tpch_q11/duckdb:parquet 43318108 / 43742423 / -1.0% 50657845 / 50965528 / -0.6% 0.86 / 0.86 / -0.4%
tpch_q12/duckdb:parquet 70873818 / 71137236 / -0.4% 91088952 / 91779500 / -0.8% 0.78 / 0.78 / +0.4%
tpch_q13/duckdb:parquet 292756148 / 293366910 / -0.2% 309997486 / 308621731 / +0.4% 0.94 / 0.95 / -0.7%
tpch_q14/duckdb:parquet 101346628 / 102273386 / -0.9% 138705387 / 141851063 / -2.2% 0.73 / 0.72 / +1.3%
tpch_q15/duckdb:parquet 58198924 / 57070305 / +2.0% 87500640 / 86533692 / +1.1% 0.67 / 0.66 / +0.9%
tpch_q16/duckdb:parquet 100502461 / 100916878 / -0.4% 106818072 / 107993358 / -1.1% 0.94 / 0.93 / +0.7%
tpch_q17/duckdb:parquet 82250836 / 82884448 / -0.8% 112462857 / 124989202 / -10.0% 🟢 0.73 / 0.66 / +10.3%
tpch_q18/duckdb:parquet 155537454 / 157350187 / -1.2% 170394292 / 174516370 / -2.4% 0.91 / 0.90 / +1.2%
tpch_q19/duckdb:parquet 97785597 / 98221882 / -0.4% 131993375 / 134004453 / -1.5% 0.74 / 0.73 / +1.1%
tpch_q20/duckdb:parquet 147141350 / 147378796 / -0.2% 184595775 / 187264562 / -1.4% 0.80 / 0.79 / +1.3%
tpch_q21/duckdb:parquet 251786798 / 251811968 / -0.0% 276320649 / 275521800 / +0.3% 0.91 / 0.91 / -0.3%
tpch_q22/duckdb:parquet 168239227 / 168385842 / -0.1% 179872585 / 180610188 / -0.4% 0.94 / 0.93 / +0.3%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 0a0c827a vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 0.990x ➖
Parquet (geomean): hot 1.002x ➖ · cold 1.000x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 20848748 / 21075930 / -1.1% 37565012 / 38638247 / -2.8% 0.56 / 0.55 / +1.7%
tpcds_q02/datafusion:vortex-file-compressed 44007212 / 44337330 / -0.7% 64853172 / 64322678 / +0.8% 0.68 / 0.69 / -1.6%
tpcds_q03/datafusion:vortex-file-compressed 11041738 / 11162676 / -1.1% 28832412 / 27874319 / +3.4% 0.38 / 0.40 / -4.4%
tpcds_q04/datafusion:vortex-file-compressed 86929671 / 86734277 / +0.2% 122863965 / 118451152 / +3.7% 0.71 / 0.73 / -3.4%
tpcds_q05/datafusion:vortex-file-compressed 55728053 / 56827797 / -1.9% 76989833 / 76114099 / +1.2% 0.72 / 0.75 / -3.1%
tpcds_q06/datafusion:vortex-file-compressed 22732480 / 22692446 / +0.2% 41922207 / 42045614 / -0.3% 0.54 / 0.54 / +0.5%
tpcds_q07/datafusion:vortex-file-compressed 29057038 / 28756891 / +1.0% 51534579 / 50270298 / +2.5% 0.56 / 0.57 / -1.4%
tpcds_q08/datafusion:vortex-file-compressed 24644729 / 24565008 / +0.3% 44820324 / 44075611 / +1.7% 0.55 / 0.56 / -1.3%
tpcds_q09/datafusion:vortex-file-compressed 20798196 / 21207415 / -1.9% 36389049 / 35851284 / +1.5% 0.57 / 0.59 / -3.4%
tpcds_q10/datafusion:vortex-file-compressed 27286464 / 27171788 / +0.4% 47507203 / 48716984 / -2.5% 0.57 / 0.56 / +3.0%
tpcds_q11/datafusion:vortex-file-compressed 52795071 / 52909560 / -0.2% 81660554 / 79987379 / +2.1% 0.65 / 0.66 / -2.3%
tpcds_q12/datafusion:vortex-file-compressed 14784164 / 14883221 / -0.7% 31686245 / 31358319 / +1.0% 0.47 / 0.47 / -1.7%
tpcds_q13/datafusion:vortex-file-compressed 30820071 / 31185554 / -1.2% 55953299 / 56269502 / -0.6% 0.55 / 0.55 / -0.6%
tpcds_q14/datafusion:vortex-file-compressed 486469059 / 489067088 / -0.5% 543880183 / 543494011 / +0.1% 0.89 / 0.90 / -0.6%
tpcds_q15/datafusion:vortex-file-compressed 12372147 / 12361730 / +0.1% 33956826 / 32624708 / +4.1% 0.36 / 0.38 / -3.8%
tpcds_q16/datafusion:vortex-file-compressed 18859834 / 18767600 / +0.5% 38595254 / 37497209 / +2.9% 0.49 / 0.50 / -2.4%
tpcds_q17/datafusion:vortex-file-compressed 53390466 / 54689321 / -2.4% 75236947 / 71444295 / +5.3% 0.71 / 0.77 / -7.3%
tpcds_q18/datafusion:vortex-file-compressed 62863820 / 62745430 / +0.2% 85280304 / 84923290 / +0.4% 0.74 / 0.74 / -0.2%
tpcds_q19/datafusion:vortex-file-compressed 16685004 / 16953830 / -1.6% 39375196 / 38328755 / +2.7% 0.42 / 0.44 / -4.2%
tpcds_q20/datafusion:vortex-file-compressed 16232066 / 15971812 / +1.6% 34776797 / 36958911 / -5.9% 0.47 / 0.43 / +8.0%
tpcds_q21/datafusion:vortex-file-compressed 16080572 / 16341850 / -1.6% 36563031 / 37152728 / -1.6% 0.44 / 0.44 / -0.0%
tpcds_q22/datafusion:vortex-file-compressed 49214265 / 49281792 / -0.1% 71494650 / 72884478 / -1.9% 0.69 / 0.68 / +1.8%
tpcds_q23/datafusion:vortex-file-compressed 70378890 / 70660138 / -0.4% 96158070 / 98187087 / -2.1% 0.73 / 0.72 / +1.7%
tpcds_q24/datafusion:vortex-file-compressed 64761696 / 64849742 / -0.1% 86020719 / 85912267 / +0.1% 0.75 / 0.75 / -0.3%
tpcds_q25/datafusion:vortex-file-compressed 48529194 / 48102446 / +0.9% 67167132 / 73606543 / -8.7% 0.72 / 0.65 / +10.6%
tpcds_q26/datafusion:vortex-file-compressed 25611952 / 25675571 / -0.2% 46150088 / 46144233 / +0.0% 0.55 / 0.56 / -0.3%
tpcds_q27/datafusion:vortex-file-compressed 59664382 / 57037719 / +4.6% 81384077 / 79256017 / +2.7% 0.73 / 0.72 / +1.9%
tpcds_q28/datafusion:vortex-file-compressed 23342350 / 24421590 / -4.4% 41098003 / 41637022 / -1.3% 0.57 / 0.59 / -3.2%
tpcds_q29/datafusion:vortex-file-compressed 53464206 / 53192800 / +0.5% 66682128 / 75657345 / -11.9% 🟢 0.80 / 0.70 / +14.0%
tpcds_q30/datafusion:vortex-file-compressed 26131921 / 25828708 / +1.2% 44411937 / 43291925 / +2.6% 0.59 / 0.60 / -1.4%
tpcds_q31/datafusion:vortex-file-compressed 58224084 / 58867606 / -1.1% 83122476 / 83455412 / -0.4% 0.70 / 0.71 / -0.7%
tpcds_q32/datafusion:vortex-file-compressed 12380889 / 12386412 / -0.0% 29797898 / 28927311 / +3.0% 0.42 / 0.43 / -3.0%
tpcds_q33/datafusion:vortex-file-compressed 27081724 / 27251526 / -0.6% 51837261 / 48738507 / +6.4% 0.52 / 0.56 / -6.6%
tpcds_q34/datafusion:vortex-file-compressed 17412380 / 17480834 / -0.4% 35592093 / 34421823 / +3.4% 0.49 / 0.51 / -3.7%
tpcds_q35/datafusion:vortex-file-compressed 29740840 / 30075320 / -1.1% 53990675 / 53053102 / +1.8% 0.55 / 0.57 / -2.8%
tpcds_q36/datafusion:vortex-file-compressed 47292392 / 46675208 / +1.3% 70829956 / 69079110 / +2.5% 0.67 / 0.68 / -1.2%
tpcds_q37/datafusion:vortex-file-compressed 11829258 / 11904318 / -0.6% 33677976 / 33415021 / +0.8% 0.35 / 0.36 / -1.4%
tpcds_q38/datafusion:vortex-file-compressed 25752556 / 25706742 / +0.2% 48593174 / 46753111 / +3.9% 0.53 / 0.55 / -3.6%
tpcds_q39/datafusion:vortex-file-compressed 64566007 / 64869784 / -0.5% 90049190 / 89570934 / +0.5% 0.72 / 0.72 / -1.0%
tpcds_q40/datafusion:vortex-file-compressed 23541398 / 23325174 / +0.9% 42067607 / 42047023 / +0.0% 0.56 / 0.55 / +0.9%
tpcds_q41/datafusion:vortex-file-compressed 20898816 / 20342688 / +2.7% 33847523 / 31695807 / +6.8% 0.62 / 0.64 / -3.8%
tpcds_q42/datafusion:vortex-file-compressed 10967647 / 10755524 / +2.0% 27237580 / 26462137 / +2.9% 0.40 / 0.41 / -0.9%
tpcds_q43/datafusion:vortex-file-compressed 12235823 / 12549322 / -2.5% 31855503 / 31280405 / +1.8% 0.38 / 0.40 / -4.3%
tpcds_q44/datafusion:vortex-file-compressed 28747310 / 28515654 / +0.8% 49796976 / 50995861 / -2.4% 0.58 / 0.56 / +3.2%
tpcds_q45/datafusion:vortex-file-compressed 16228982 / 16298120 / -0.4% 34665402 / 33457337 / +3.6% 0.47 / 0.49 / -3.9%
tpcds_q46/datafusion:vortex-file-compressed 23159546 / 23229427 / -0.3% 45761431 / 44755548 / +2.2% 0.51 / 0.52 / -2.5%
tpcds_q47/datafusion:vortex-file-compressed 74518474 / 74695810 / -0.2% 103281297 / 101833669 / +1.4% 0.72 / 0.73 / -1.6%
tpcds_q48/datafusion:vortex-file-compressed 28924928 / 28485442 / +1.5% 50268633 / 50825432 / -1.1% 0.58 / 0.56 / +2.7%
tpcds_q49/datafusion:vortex-file-compressed 56091868 / 56616678 / -0.9% 81305204 / 79193807 / +2.7% 0.69 / 0.71 / -3.5%
tpcds_q50/datafusion:vortex-file-compressed 30297858 / 30225275 / +0.2% 52027837 / 51542216 / +0.9% 0.58 / 0.59 / -0.7%
tpcds_q51/datafusion:vortex-file-compressed 65852621 / 66238316 / -0.6% 87123932 / 85961923 / +1.4% 0.76 / 0.77 / -1.9%
tpcds_q52/datafusion:vortex-file-compressed 11281810 / 11173757 / +1.0% 27891839 / 26707892 / +4.4% 0.40 / 0.42 / -3.3%
tpcds_q53/datafusion:vortex-file-compressed 17710513 / 17815272 / -0.6% 37923968 / 38592794 / -1.7% 0.47 / 0.46 / +1.2%
tpcds_q54/datafusion:vortex-file-compressed 31427850 / 31294044 / +0.4% 54710900 / 54411096 / +0.6% 0.57 / 0.58 / -0.1%
tpcds_q55/datafusion:vortex-file-compressed 10921789 / 10977064 / -0.5% 26646481 / 26445815 / +0.8% 0.41 / 0.42 / -1.3%
tpcds_q56/datafusion:vortex-file-compressed 26320698 / 26267608 / +0.2% 46818036 / 47242232 / -0.9% 0.56 / 0.56 / +1.1%
tpcds_q57/datafusion:vortex-file-compressed 61235456 / 61853212 / -1.0% 86182912 / 86088207 / +0.1% 0.71 / 0.72 / -1.1%
tpcds_q58/datafusion:vortex-file-compressed 38045143 / 38380444 / -0.9% 61742783 / 63376054 / -2.6% 0.62 / 0.61 / +1.7%
tpcds_q59/datafusion:vortex-file-compressed 29340378 / 29424571 / -0.3% 54226044 / 53366384 / +1.6% 0.54 / 0.55 / -1.9%
tpcds_q60/datafusion:vortex-file-compressed 25833874 / 25428852 / +1.6% 47468473 / 46248957 / +2.6% 0.54 / 0.55 / -1.0%
tpcds_q61/datafusion:vortex-file-compressed 20954888 / 21069785 / -0.5% 42378495 / 42650322 / -0.6% 0.49 / 0.49 / +0.1%
tpcds_q62/datafusion:vortex-file-compressed 16208318 / 16464280 / -1.6% 34439590 / 34481569 / -0.1% 0.47 / 0.48 / -1.4%
tpcds_q63/datafusion:vortex-file-compressed 17692386 / 17537600 / +0.9% 38984248 / 37514994 / +3.9% 0.45 / 0.47 / -2.9%
tpcds_q64/datafusion:vortex-file-compressed 210156150 / 209658176 / +0.2% 249067735 / 244014821 / +2.1% 0.84 / 0.86 / -1.8%
tpcds_q65/datafusion:vortex-file-compressed 72207441 / 71931186 / +0.4% 94764678 / 93293623 / +1.6% 0.76 / 0.77 / -1.2%
tpcds_q66/datafusion:vortex-file-compressed 49766745 / 50314022 / -1.1% 72098329 / 73443461 / -1.8% 0.69 / 0.69 / +0.8%
tpcds_q67/datafusion:vortex-file-compressed 50383362 / 50809885 / -0.8% 82306063 / 80439935 / +2.3% 0.61 / 0.63 / -3.1%
tpcds_q68/datafusion:vortex-file-compressed 22879646 / 22935066 / -0.2% 44724604 / 46212376 / -3.2% 0.51 / 0.50 / +3.1%
tpcds_q69/datafusion:vortex-file-compressed 25513022 / 25957220 / -1.7% 46674961 / 48199065 / -3.2% 0.55 / 0.54 / +1.5%
tpcds_q70/datafusion:vortex-file-compressed 71139037 / 70921686 / +0.3% 91578968 / 91526378 / +0.1% 0.78 / 0.77 / +0.2%
tpcds_q71/datafusion:vortex-file-compressed 18192252 / 19479654 / -6.6% 39672811 / 39385822 / +0.7% 0.46 / 0.49 / -7.3%
tpcds_q72/datafusion:vortex-file-compressed 360947635 / 349635619 / +3.2% 384680545 / 390053124 / -1.4% 0.94 / 0.90 / +4.7%
tpcds_q73/datafusion:vortex-file-compressed 16431551 / 16370256 / +0.4% 37308426 / 35825318 / +4.1% 0.44 / 0.46 / -3.6%
tpcds_q74/datafusion:vortex-file-compressed 39778690 / 40729710 / -2.3% 67924316 / 66101755 / +2.8% 0.59 / 0.62 / -5.0%
tpcds_q75/datafusion:vortex-file-compressed 133764592 / 133231577 / +0.4% 160609354 / 159508865 / +0.7% 0.83 / 0.84 / -0.3%
tpcds_q76/datafusion:vortex-file-compressed 29342086 / 29878010 / -1.8% 47579576 / 49131830 / -3.2% 0.62 / 0.61 / +1.4%
tpcds_q77/datafusion:vortex-file-compressed 44798552 / 44794824 / +0.0% 67930734 / 68725579 / -1.2% 0.66 / 0.65 / +1.2%
tpcds_q78/datafusion:vortex-file-compressed 63783384 / 64149016 / -0.6% 89671053 / 91826652 / -2.3% 0.71 / 0.70 / +1.8%
tpcds_q79/datafusion:vortex-file-compressed 19459838 / 19747138 / -1.5% 42475062 / 41330856 / +2.8% 0.46 / 0.48 / -4.1%
tpcds_q80/datafusion:vortex-file-compressed 71852764 / 73516756 / -2.3% 104922712 / 103399339 / +1.5% 0.68 / 0.71 / -3.7%
tpcds_q81/datafusion:vortex-file-compressed 26311652 / 26433507 / -0.5% 44538468 / 44049315 / +1.1% 0.59 / 0.60 / -1.6%
tpcds_q82/datafusion:vortex-file-compressed 11702644 / 12061347 / -3.0% 33737309 / 33334269 / +1.2% 0.35 / 0.36 / -4.1%
tpcds_q83/datafusion:vortex-file-compressed 32694794 / 32437804 / +0.8% 51948163 / 52048289 / -0.2% 0.63 / 0.62 / +1.0%
tpcds_q84/datafusion:vortex-file-compressed 9772142 / 10107068 / -3.3% 25351272 / 25586667 / -0.9% 0.39 / 0.40 / -2.4%
tpcds_q85/datafusion:vortex-file-compressed 54196034 / 53327322 / +1.6% 81099313 / 79919547 / +1.5% 0.67 / 0.67 / +0.2%
tpcds_q86/datafusion:vortex-file-compressed 15874670 / 15658314 / +1.4% 33830207 / 32167556 / +5.2% 0.47 / 0.49 / -3.6%
tpcds_q87/datafusion:vortex-file-compressed 25614121 / 26232334 / -2.4% 47517344 / 48269535 / -1.6% 0.54 / 0.54 / -0.8%
tpcds_q88/datafusion:vortex-file-compressed 31363653 / 31404654 / -0.1% 50972793 / 50217706 / +1.5% 0.62 / 0.63 / -1.6%
tpcds_q89/datafusion:vortex-file-compressed 20887420 / 20857143 / +0.1% 42666685 / 40998842 / +4.1% 0.49 / 0.51 / -3.8%
tpcds_q90/datafusion:vortex-file-compressed 9921595 / 9857710 / +0.6% 24979104 / 24004775 / +4.1% 0.40 / 0.41 / -3.3%
tpcds_q91/datafusion:vortex-file-compressed 16865505 / 16590985 / +1.7% 36139241 / 36406808 / -0.7% 0.47 / 0.46 / +2.4%
tpcds_q92/datafusion:vortex-file-compressed 13086824 / 12785642 / +2.4% 28836863 / 28212901 / +2.2% 0.45 / 0.45 / +0.1%
tpcds_q93/datafusion:vortex-file-compressed 20060136 / 20514612 / -2.2% 39477220 / 39172325 / +0.8% 0.51 / 0.52 / -3.0%
tpcds_q94/datafusion:vortex-file-compressed 18016252 / 18329141 / -1.7% 37047459 / 37017769 / +0.1% 0.49 / 0.50 / -1.8%
tpcds_q95/datafusion:vortex-file-compressed 41627840 / 41892583 / -0.6% 62411084 / 60792282 / +2.7% 0.67 / 0.69 / -3.2%
tpcds_q96/datafusion:vortex-file-compressed 7757618 / 7680347 / +1.0% 26345483 / 24590568 / +7.1% 0.29 / 0.31 / -5.7%
tpcds_q97/datafusion:vortex-file-compressed 17026642 / 16976546 / +0.3% 37866269 / 36962622 / +2.4% 0.45 / 0.46 / -2.1%
tpcds_q98/datafusion:vortex-file-compressed 16231748 / 16323012 / -0.6% 37698108 / 35491744 / +6.2% 0.43 / 0.46 / -6.4%
tpcds_q99/datafusion:vortex-file-compressed 15788466 / 16055726 / -1.7% 34468429 / 34645287 / -0.5% 0.46 / 0.46 / -1.2%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 41482292 / 42790168 / -3.1% 59682299 / 57645148 / +3.5% 0.70 / 0.74 / -6.4%
tpcds_q02/datafusion:parquet 54446976 / 54765044 / -0.6% 70426945 / 70421354 / +0.0% 0.77 / 0.78 / -0.6%
tpcds_q03/datafusion:parquet 19065679 / 19097265 / -0.2% 31379850 / 30445091 / +3.1% 0.61 / 0.63 / -3.1%
tpcds_q04/datafusion:parquet 177044486 / 178887614 / -1.0% 205469157 / 202039145 / +1.7% 0.86 / 0.89 / -2.7%
tpcds_q05/datafusion:parquet 66266633 / 67878001 / -2.4% 89068470 / 89709488 / -0.7% 0.74 / 0.76 / -1.7%
tpcds_q06/datafusion:parquet 34450215 / 33778804 / +2.0% 47745623 / 45692699 / +4.5% 0.72 / 0.74 / -2.4%
tpcds_q07/datafusion:parquet 46302910 / 47393786 / -2.3% 65622299 / 65545052 / +0.1% 0.71 / 0.72 / -2.4%
tpcds_q08/datafusion:parquet 31353540 / 30786170 / +1.8% 45723378 / 43159155 / +5.9% 0.69 / 0.71 / -3.9%
tpcds_q09/datafusion:parquet 33163780 / 30591208 / +8.4% 37254282 / 42974319 / -13.3% 🟢 0.89 / 0.71 / +25.1%
tpcds_q10/datafusion:parquet 43803456 / 43909954 / -0.2% 60843115 / 58393927 / +4.2% 0.72 / 0.75 / -4.3%
tpcds_q11/datafusion:parquet 96770563 / 97359220 / -0.6% 117025851 / 119001225 / -1.7% 0.83 / 0.82 / +1.1%
tpcds_q12/datafusion:parquet 23575612 / 23515044 / +0.3% 38651431 / 34010680 / +13.6% 🔴 0.61 / 0.69 / -11.8%
tpcds_q13/datafusion:parquet 46153844 / 46313484 / -0.3% 66669658 / 68018563 / -2.0% 0.69 / 0.68 / +1.7%
tpcds_q14/datafusion:parquet 535144448 / 534683184 / +0.1% 581502608 / 582375794 / -0.1% 0.92 / 0.92 / +0.2%
tpcds_q15/datafusion:parquet 24023872 / 24175697 / -0.6% 38175088 / 36583322 / +4.4% 0.63 / 0.66 / -4.8%
tpcds_q16/datafusion:parquet 36527512 / 37052644 / -1.4% 51526909 / 49572893 / +3.9% 0.71 / 0.75 / -5.2%
tpcds_q17/datafusion:parquet 74978550 / 75207760 / -0.3% 97602485 / 98319183 / -0.7% 0.77 / 0.76 / +0.4%
tpcds_q18/datafusion:parquet 65005937 / 67278429 / -3.4% 90884780 / 89472378 / +1.6% 0.72 / 0.75 / -4.9%
tpcds_q19/datafusion:parquet 29590968 / 29426323 / +0.6% 41478562 / 42286597 / -1.9% 0.71 / 0.70 / +2.5%
tpcds_q20/datafusion:parquet 25569926 / 24728196 / +3.4% 37486300 / 35453048 / +5.7% 0.68 / 0.70 / -2.2%
tpcds_q21/datafusion:parquet 19901354 / 19988597 / -0.4% 31508081 / 33163707 / -5.0% 0.63 / 0.60 / +4.8%
tpcds_q22/datafusion:parquet 76824035 / 77207674 / -0.5% 88768909 / 87517272 / +1.4% 0.87 / 0.88 / -1.9%
tpcds_q23/datafusion:parquet 92719212 / 91103138 / +1.8% 114722918 / 115810894 / -0.9% 0.81 / 0.79 / +2.7%
tpcds_q24/datafusion:parquet 90565390 / 90312194 / +0.3% 113954955 / 114753768 / -0.7% 0.79 / 0.79 / +1.0%
tpcds_q25/datafusion:parquet 81478348 / 82183728 / -0.9% 100185232 / 101090115 / -0.9% 0.81 / 0.81 / +0.0%
tpcds_q26/datafusion:parquet 43181399 / 43975604 / -1.8% 60418481 / 60140227 / +0.5% 0.71 / 0.73 / -2.3%
tpcds_q27/datafusion:parquet 76942049 / 75256415 / +2.2% 100484290 / 96796596 / +3.8% 0.77 / 0.78 / -1.5%
tpcds_q28/datafusion:parquet 28047933 / 28282492 / -0.8% 42122064 / 40540051 / +3.9% 0.67 / 0.70 / -4.6%
tpcds_q29/datafusion:parquet 76184222 / 76327373 / -0.2% 95098337 / 95497789 / -0.4% 0.80 / 0.80 / +0.2%
tpcds_q30/datafusion:parquet 44853008 / 44172996 / +1.5% 55069242 / 56428909 / -2.4% 0.81 / 0.78 / +4.0%
tpcds_q31/datafusion:parquet 80606768 / 81059734 / -0.6% 95189572 / 97847034 / -2.7% 0.85 / 0.83 / +2.2%
tpcds_q32/datafusion:parquet 27034012 / 26106716 / +3.6% 38720722 / 38996408 / -0.7% 0.70 / 0.67 / +4.3%
tpcds_q33/datafusion:parquet 38162634 / 36632188 / +4.2% 54203148 / 51696853 / +4.8% 0.70 / 0.71 / -0.6%
tpcds_q34/datafusion:parquet 24407183 / 24283762 / +0.5% 36120669 / 35496823 / +1.8% 0.68 / 0.68 / -1.2%
tpcds_q35/datafusion:parquet 51729700 / 51092331 / +1.2% 64630091 / 63128294 / +2.4% 0.80 / 0.81 / -1.1%
tpcds_q36/datafusion:parquet 52514024 / 52133216 / +0.7% 69460033 / 73276361 / -5.2% 0.76 / 0.71 / +6.3%
tpcds_q37/datafusion:parquet 21472946 / 21186441 / +1.4% 33593174 / 32501720 / +3.4% 0.64 / 0.65 / -1.9%
tpcds_q38/datafusion:parquet 44985877 / 44473320 / +1.2% 60884365 / 60661224 / +0.4% 0.74 / 0.73 / +0.8%
tpcds_q39/datafusion:parquet 68344014 / 67893870 / +0.7% 84677218 / 85512997 / -1.0% 0.81 / 0.79 / +1.7%
tpcds_q40/datafusion:parquet 30133530 / 30116612 / +0.1% 49603222 / 50944751 / -2.6% 0.61 / 0.59 / +2.8%
tpcds_q41/datafusion:parquet 19987148 / 19875884 / +0.6% 32574895 / 30988887 / +5.1% 0.61 / 0.64 / -4.3%
tpcds_q42/datafusion:parquet 18342600 / 18263912 / +0.4% 30207635 / 31580411 / -4.3% 0.61 / 0.58 / +5.0%
tpcds_q43/datafusion:parquet 19180523 / 19328598 / -0.8% 32572711 / 32363765 / +0.6% 0.59 / 0.60 / -1.4%
tpcds_q44/datafusion:parquet 36161992 / 34729506 / +4.1% 50062716 / 49650609 / +0.8% 0.72 / 0.70 / +3.3%
tpcds_q45/datafusion:parquet 27606840 / 27674712 / -0.2% 39468889 / 40581829 / -2.7% 0.70 / 0.68 / +2.6%
tpcds_q46/datafusion:parquet 29013068 / 28849347 / +0.6% 45957147 / 44446206 / +3.4% 0.63 / 0.65 / -2.7%
tpcds_q47/datafusion:parquet 97389389 / 97767068 / -0.4% 118654930 / 116071791 / +2.2% 0.82 / 0.84 / -2.6%
tpcds_q48/datafusion:parquet 42801734 / 42223134 / +1.4% 58324522 / 58362840 / -0.1% 0.73 / 0.72 / +1.4%
tpcds_q49/datafusion:parquet 71990576 / 71584984 / +0.6% 91523859 / 93559482 / -2.2% 0.79 / 0.77 / +2.8%
tpcds_q50/datafusion:parquet 48243448 / 47188732 / +2.2% 66729463 / 65957634 / +1.2% 0.72 / 0.72 / +1.1%
tpcds_q51/datafusion:parquet 75775544 / 75687516 / +0.1% 94921971 / 93987537 / +1.0% 0.80 / 0.81 / -0.9%
tpcds_q52/datafusion:parquet 18570710 / 18477546 / +0.5% 31160347 / 30516528 / +2.1% 0.60 / 0.61 / -1.6%
tpcds_q53/datafusion:parquet 22292438 / 22069787 / +1.0% 38473906 / 37394397 / +2.9% 0.58 / 0.59 / -1.8%
tpcds_q54/datafusion:parquet 53669752 / 53068499 / +1.1% 71961826 / 66798825 / +7.7% 0.75 / 0.79 / -6.1%
tpcds_q55/datafusion:parquet 18025207 / 18177591 / -0.8% 30618061 / 29615062 / +3.4% 0.59 / 0.61 / -4.1%
tpcds_q56/datafusion:parquet 39824218 / 40536538 / -1.8% 58267586 / 51702806 / +12.7% 🔴 0.68 / 0.78 / -12.8%
tpcds_q57/datafusion:parquet 101150406 / 100992704 / +0.2% 121814432 / 119321534 / +2.1% 0.83 / 0.85 / -1.9%
tpcds_q58/datafusion:parquet 65163666 / 65003510 / +0.2% 82206941 / 81993727 / +0.3% 0.79 / 0.79 / -0.0%
tpcds_q59/datafusion:parquet 47314554 / 47142071 / +0.4% 63427798 / 64332209 / -1.4% 0.75 / 0.73 / +1.8%
tpcds_q60/datafusion:parquet 38802918 / 41143805 / -5.7% 52269712 / 56528494 / -7.5% 0.74 / 0.73 / +2.0%
tpcds_q61/datafusion:parquet 37026814 / 37070528 / -0.1% 51523663 / 50658408 / +1.7% 0.72 / 0.73 / -1.8%
tpcds_q62/datafusion:parquet 25158821 / 25299585 / -0.6% 38215824 / 37400865 / +2.2% 0.66 / 0.68 / -2.7%
tpcds_q63/datafusion:parquet 22042022 / 22137338 / -0.4% 38628147 / 37267059 / +3.7% 0.57 / 0.59 / -3.9%
tpcds_q64/datafusion:parquet 285280164 / 283491307 / +0.6% 317262046 / 324365594 / -2.2% 0.90 / 0.87 / +2.9%
tpcds_q65/datafusion:parquet 121106906 / 121796900 / -0.6% 140446384 / 140340790 / +0.1% 0.86 / 0.87 / -0.6%
tpcds_q66/datafusion:parquet 59664837 / 60159790 / -0.8% 78101894 / 74271493 / +5.2% 0.76 / 0.81 / -5.7%
tpcds_q67/datafusion:parquet 68102470 / 69200688 / -1.6% 91839738 / 92158955 / -0.3% 0.74 / 0.75 / -1.2%
tpcds_q68/datafusion:parquet 28649512 / 28638674 / +0.0% 47768503 / 47694525 / +0.2% 0.60 / 0.60 / -0.1%
tpcds_q69/datafusion:parquet 43474318 / 43345552 / +0.3% 59048566 / 54686235 / +8.0% 0.74 / 0.79 / -7.1%
tpcds_q70/datafusion:parquet 80290964 / 80271896 / +0.0% 97452736 / 100088952 / -2.6% 0.82 / 0.80 / +2.7%
tpcds_q71/datafusion:parquet 25011867 / 24373552 / +2.6% 37638898 / 38366867 / -1.9% 0.66 / 0.64 / +4.6%
tpcds_q72/datafusion:parquet 525590166 / 527329837 / -0.3% 543898860 / 560736807 / -3.0% 0.97 / 0.94 / +2.8%
tpcds_q73/datafusion:parquet 23692183 / 23675195 / +0.1% 35667762 / 35651529 / +0.0% 0.66 / 0.66 / +0.0%
tpcds_q74/datafusion:parquet 68285948 / 69750544 / -2.1% 89867913 / 88419484 / +1.6% 0.76 / 0.79 / -3.7%
tpcds_q75/datafusion:parquet 153428098 / 154280426 / -0.6% 178545096 / 175992735 / +1.5% 0.86 / 0.88 / -2.0%
tpcds_q76/datafusion:parquet 33330335 / 32552642 / +2.4% 47267600 / 46197310 / +2.3% 0.71 / 0.70 / +0.1%
tpcds_q77/datafusion:parquet 56989526 / 55912258 / +1.9% 77338925 / 75401961 / +2.6% 0.74 / 0.74 / -0.6%
tpcds_q78/datafusion:parquet 86664196 / 86298158 / +0.4% 117613604 / 119573989 / -1.6% 0.74 / 0.72 / +2.1%
tpcds_q79/datafusion:parquet 26533128 / 26941018 / -1.5% 42089423 / 41670899 / +1.0% 0.63 / 0.65 / -2.5%
tpcds_q80/datafusion:parquet 81256113 / 79571648 / +2.1% 109571976 / 107798298 / +1.6% 0.74 / 0.74 / +0.5%
tpcds_q81/datafusion:parquet 38705772 / 37708022 / +2.6% 54284280 / 49644780 / +9.3% 0.71 / 0.76 / -6.1%
tpcds_q82/datafusion:parquet 22839392 / 22862742 / -0.1% 34672532 / 35659042 / -2.8% 0.66 / 0.64 / +2.7%
tpcds_q83/datafusion:parquet 58165319 / 58728850 / -1.0% 74413215 / 73572759 / +1.1% 0.78 / 0.80 / -2.1%
tpcds_q84/datafusion:parquet 25753742 / 27588446 / -6.7% 39969070 / 37424130 / +6.8% 0.64 / 0.74 / -12.6%
tpcds_q85/datafusion:parquet 79223023 / 80037900 / -1.0% 102282325 / 103303133 / -1.0% 0.77 / 0.77 / -0.0%
tpcds_q86/datafusion:parquet 20816306 / 20803682 / +0.1% 33958667 / 32694603 / +3.9% 0.61 / 0.64 / -3.7%
tpcds_q87/datafusion:parquet 43730942 / 44953774 / -2.7% 61163747 / 58673543 / +4.2% 0.71 / 0.77 / -6.7%
tpcds_q88/datafusion:parquet 36980218 / 37194222 / -0.6% 50347039 / 51481242 / -2.2% 0.73 / 0.72 / +1.7%
tpcds_q89/datafusion:parquet 25458724 / 25767740 / -1.2% 41802759 / 40885679 / +2.2% 0.61 / 0.63 / -3.4%
tpcds_q90/datafusion:parquet 15561043 / 15051543 / +3.4% 26348650 / 27168268 / -3.0% 0.59 / 0.55 / +6.6%
tpcds_q91/datafusion:parquet 32069445 / 32426770 / -1.1% 47580353 / 45756299 / +4.0% 0.67 / 0.71 / -4.9%
tpcds_q92/datafusion:parquet 27087010 / 26788312 / +1.1% 39988787 / 39570067 / +1.1% 0.68 / 0.68 / +0.1%
tpcds_q93/datafusion:parquet 27136449 / 26826836 / +1.2% 46163883 / 45720426 / +1.0% 0.59 / 0.59 / +0.2%
tpcds_q94/datafusion:parquet 35200394 / 35612212 / -1.2% 49138516 / 47235641 / +4.0% 0.72 / 0.75 / -5.0%
tpcds_q95/datafusion:parquet 64329330 / 64407442 / -0.1% 78395333 / 79417285 / -1.3% 0.82 / 0.81 / +1.2%
tpcds_q96/datafusion:parquet 13025746 / 13109518 / -0.6% 23808497 / 25052704 / -5.0% 0.55 / 0.52 / +4.6%
tpcds_q97/datafusion:parquet 35738014 / 35212817 / +1.5% 52237536 / 51110766 / +2.2% 0.68 / 0.69 / -0.7%
tpcds_q98/datafusion:parquet 24490696 / 24928664 / -1.8% 39905583 / 36311664 / +9.9% 0.61 / 0.69 / -10.6%
tpcds_q99/datafusion:parquet 29606602 / 29956348 / -1.2% 41918680 / 41613620 / +0.7% 0.71 / 0.72 / -1.9%
duckdb / vortex-file-compressed / ns (1.004x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 16171338 / 16142117 / +0.2% 24397247 / 24883739 / -2.0% 0.66 / 0.65 / +2.2%
tpcds_q02/duckdb:vortex-file-compressed 18617992 / 16709276 / +11.4% 🔴 22232236 / 22051108 / +0.8% 0.84 / 0.76 / +10.5%
tpcds_q03/duckdb:vortex-file-compressed 7031642 / 7045657 / -0.2% 14995201 / 16301596 / -8.0% 0.47 / 0.43 / +8.5%
tpcds_q04/duckdb:vortex-file-compressed 45619774 / 45758252 / -0.3% 56136119 / 56479163 / -0.6% 0.81 / 0.81 / +0.3%
tpcds_q05/duckdb:vortex-file-compressed 23038042 / 23036528 / +0.0% 32187306 / 32578849 / -1.2% 0.72 / 0.71 / +1.2%
tpcds_q06/duckdb:vortex-file-compressed 24433895 / 24423028 / +0.0% 37354223 / 38193338 / -2.2% 0.65 / 0.64 / +2.3%
tpcds_q07/duckdb:vortex-file-compressed 13498167 / 13353038 / +1.1% 22862914 / 24712568 / -7.5% 0.59 / 0.54 / +9.3%
tpcds_q08/duckdb:vortex-file-compressed 17334508 / 17520489 / -1.1% 25244476 / 25721441 / -1.9% 0.69 / 0.68 / +0.8%
tpcds_q09/duckdb:vortex-file-compressed 19061505 / 19111982 / -0.3% 30189071 / 29348465 / +2.9% 0.63 / 0.65 / -3.0%
tpcds_q10/duckdb:vortex-file-compressed 27822838 / 27612226 / +0.8% 39893078 / 40320225 / -1.1% 0.70 / 0.68 / +1.8%
tpcds_q11/duckdb:vortex-file-compressed 37038491 / 36903964 / +0.4% 45955582 / 46177346 / -0.5% 0.81 / 0.80 / +0.8%
tpcds_q12/duckdb:vortex-file-compressed 10221820 / 10200694 / +0.2% 16614245 / 17187152 / -3.3% 0.62 / 0.59 / +3.7%
tpcds_q13/duckdb:vortex-file-compressed 21013976 / 21263297 / -1.2% 33190774 / 32547269 / +2.0% 0.63 / 0.65 / -3.1%
tpcds_q14/duckdb:vortex-file-compressed 57406024 / 57809828 / -0.7% 65387731 / 68046783 / -3.9% 0.88 / 0.85 / +3.3%
tpcds_q15/duckdb:vortex-file-compressed 11250228 / 11119113 / +1.2% 16994659 / 18816176 / -9.7% 0.66 / 0.59 / +12.0%
tpcds_q16/duckdb:vortex-file-compressed 24076476 / 24266849 / -0.8% 34803511 / 34786209 / +0.0% 0.69 / 0.70 / -0.8%
tpcds_q17/duckdb:vortex-file-compressed 24418408 / 24227736 / +0.8% 35091456 / 36525117 / -3.9% 0.70 / 0.66 / +4.9%
tpcds_q18/duckdb:vortex-file-compressed 31597416 / 31509080 / +0.3% 41666224 / 41766543 / -0.2% 0.76 / 0.75 / +0.5%
tpcds_q19/duckdb:vortex-file-compressed 77260740 / 77960863 / -0.9% 86921136 / 89377861 / -2.7% 0.89 / 0.87 / +1.9%
tpcds_q20/duckdb:vortex-file-compressed 10845800 / 10971804 / -1.1% 17671177 / 17747764 / -0.4% 0.61 / 0.62 / -0.7%
tpcds_q21/duckdb:vortex-file-compressed 10079644 / 9745305 / +3.4% 21294124 / 20923879 / +1.8% 0.47 / 0.47 / +1.6%
tpcds_q22/duckdb:vortex-file-compressed 17508732 / 17585292 / -0.4% 29553361 / 29572488 / -0.1% 0.59 / 0.59 / -0.4%
tpcds_q23/duckdb:vortex-file-compressed 39084696 / 38130006 / +2.5% 50288405 / 49924896 / +0.7% 0.78 / 0.76 / +1.8%
tpcds_q24/duckdb:vortex-file-compressed 26837522 / 26574018 / +1.0% 34885177 / 36642246 / -4.8% 0.77 / 0.73 / +6.1%
tpcds_q25/duckdb:vortex-file-compressed 23284462 / 23695962 / -1.7% 34422939 / 36381968 / -5.4% 0.68 / 0.65 / +3.9%
tpcds_q26/duckdb:vortex-file-compressed 13009728 / 13100696 / -0.7% 20690171 / 21291607 / -2.8% 0.63 / 0.62 / +2.2%
tpcds_q27/duckdb:vortex-file-compressed 16071617 / 15963922 / +0.7% 25601882 / 27540444 / -7.0% 0.63 / 0.58 / +8.3%
tpcds_q28/duckdb:vortex-file-compressed 15131864 / 15588588 / -2.9% 24674010 / 26167172 / -5.7% 0.61 / 0.60 / +2.9%
tpcds_q29/duckdb:vortex-file-compressed 23028336 / 22710729 / +1.4% 34580559 / 34899355 / -0.9% 0.67 / 0.65 / +2.3%
tpcds_q30/duckdb:vortex-file-compressed 16240206 / 15872199 / +2.3% 24261948 / 24336692 / -0.3% 0.67 / 0.65 / +2.6%
tpcds_q31/duckdb:vortex-file-compressed 17868848 / 18069675 / -1.1% 25623437 / 26891648 / -4.7% 0.70 / 0.67 / +3.8%
tpcds_q32/duckdb:vortex-file-compressed 11753956 / 11623212 / +1.1% 20839627 / 20950684 / -0.5% 0.56 / 0.55 / +1.7%
tpcds_q33/duckdb:vortex-file-compressed 18634750 / 18357493 / +1.5% 29308515 / 28185569 / +4.0% 0.64 / 0.65 / -2.4%
tpcds_q34/duckdb:vortex-file-compressed 13116003 / 13014242 / +0.8% 22616442 / 23047270 / -1.9% 0.58 / 0.56 / +2.7%
tpcds_q35/duckdb:vortex-file-compressed 28066182 / 27929879 / +0.5% 37691458 / 39014716 / -3.4% 0.74 / 0.72 / +4.0%
tpcds_q36/duckdb:vortex-file-compressed 14165765 / 13908706 / +1.8% 22933455 / 23970044 / -4.3% 0.62 / 0.58 / +6.5%
tpcds_q37/duckdb:vortex-file-compressed 9436758 / 9515167 / -0.8% 24235991 / 24340830 / -0.4% 0.39 / 0.39 / -0.4%
tpcds_q38/duckdb:vortex-file-compressed 24468710 / 24300837 / +0.7% 32653044 / 32361884 / +0.9% 0.75 / 0.75 / -0.2%
tpcds_q39/duckdb:vortex-file-compressed 19039840 / 18334157 / +3.8% 29501746 / 33896858 / -13.0% 🟢 0.65 / 0.54 / +19.3%
tpcds_q40/duckdb:vortex-file-compressed 14130113 / 14107318 / +0.2% 20711296 / 20388858 / +1.6% 0.68 / 0.69 / -1.4%
tpcds_q41/duckdb:vortex-file-compressed 18910638 / 18789802 / +0.6% 25312179 / 25592058 / -1.1% 0.75 / 0.73 / +1.8%
tpcds_q42/duckdb:vortex-file-compressed 7106770 / 7115361 / -0.1% 15691853 / 16445425 / -4.6% 0.45 / 0.43 / +4.7%
tpcds_q43/duckdb:vortex-file-compressed 9796972 / 9847942 / -0.5% 18466077 / 19094789 / -3.3% 0.53 / 0.52 / +2.9%
tpcds_q44/duckdb:vortex-file-compressed 12551493 / 12546484 / +0.0% 23615445 / 24279354 / -2.7% 0.53 / 0.52 / +2.9%
tpcds_q45/duckdb:vortex-file-compressed 23322322 / 23264362 / +0.2% 30045772 / 31280867 / -3.9% 0.78 / 0.74 / +4.4%
tpcds_q46/duckdb:vortex-file-compressed 19353166 / 19680982 / -1.7% 27531609 / 27352411 / +0.7% 0.70 / 0.72 / -2.3%
tpcds_q47/duckdb:vortex-file-compressed 34817616 / 34836730 / -0.1% 43939370 / 45045037 / -2.5% 0.79 / 0.77 / +2.5%
tpcds_q48/duckdb:vortex-file-compressed 23551558 / 23197005 / +1.5% 34251940 / 36376826 / -5.8% 0.69 / 0.64 / +7.8%
tpcds_q49/duckdb:vortex-file-compressed 18674582 / 18947468 / -1.4% 28932242 / 31460092 / -8.0% 0.65 / 0.60 / +7.2%
tpcds_q50/duckdb:vortex-file-compressed 16850431 / 16868396 / -0.1% 26545690 / 27316563 / -2.8% 0.63 / 0.62 / +2.8%
tpcds_q51/duckdb:vortex-file-compressed 49557992 / 48747450 / +1.7% 57161597 / 76407317 / -25.2% 🟢 0.87 / 0.64 / +35.9%
tpcds_q52/duckdb:vortex-file-compressed 7286040 / 7223788 / +0.9% 15319065 / 16544978 / -7.4% 0.48 / 0.44 / +8.9%
tpcds_q53/duckdb:vortex-file-compressed 11594424 / 11580455 / +0.1% 20413347 / 20950001 / -2.6% 0.57 / 0.55 / +2.8%
tpcds_q54/duckdb:vortex-file-compressed 20759982 / 20288914 / +2.3% 29920702 / 30647003 / -2.4% 0.69 / 0.66 / +4.8%
tpcds_q55/duckdb:vortex-file-compressed 6855788 / 6902994 / -0.7% 14919151 / 15931120 / -6.4% 0.46 / 0.43 / +6.1%
tpcds_q56/duckdb:vortex-file-compressed 18181144 / 17960990 / +1.2% 28100095 / 27713372 / +1.4% 0.65 / 0.65 / -0.2%
tpcds_q57/duckdb:vortex-file-compressed 26017538 / 26098614 / -0.3% 33983950 / 34582639 / -1.7% 0.77 / 0.75 / +1.4%
tpcds_q58/duckdb:vortex-file-compressed 20394555 / 20331842 / +0.3% 29893846 / 30877019 / -3.2% 0.68 / 0.66 / +3.6%
tpcds_q59/duckdb:vortex-file-compressed 19635600 / 19688060 / -0.3% 26204177 / 27058532 / -3.2% 0.75 / 0.73 / +3.0%
tpcds_q60/duckdb:vortex-file-compressed 18873932 / 18617518 / +1.4% 28652269 / 29659067 / -3.4% 0.66 / 0.63 / +4.9%
tpcds_q61/duckdb:vortex-file-compressed 25567954 / 25605872 / -0.1% 33460669 / 34595872 / -3.3% 0.76 / 0.74 / +3.2%
tpcds_q62/duckdb:vortex-file-compressed 11851720 / 11685066 / +1.4% 18081350 / 18455703 / -2.0% 0.66 / 0.63 / +3.5%
tpcds_q63/duckdb:vortex-file-compressed 11058681 / 10996244 / +0.6% 19606228 / 20737428 / -5.5% 0.56 / 0.53 / +6.4%
tpcds_q64/duckdb:vortex-file-compressed 49288842 / 49381384 / -0.2% 64098408 / 66047661 / -3.0% 0.77 / 0.75 / +2.8%
tpcds_q65/duckdb:vortex-file-compressed 13200268 / 13292210 / -0.7% 22563864 / 23558633 / -4.2% 0.59 / 0.56 / +3.7%
tpcds_q66/duckdb:vortex-file-compressed 29444188 / 29707612 / -0.9% 34318803 / 35612347 / -3.6% 0.86 / 0.83 / +2.8%
tpcds_q67/duckdb:vortex-file-compressed 58652278 / 58292138 / +0.6% 66255446 / 66652555 / -0.6% 0.89 / 0.87 / +1.2%
tpcds_q68/duckdb:vortex-file-compressed 19489202 / 19064728 / +2.2% 27758380 / 27773620 / -0.1% 0.70 / 0.69 / +2.3%
tpcds_q69/duckdb:vortex-file-compressed 22828783 / 22826429 / +0.0% 36574873 / 37192445 / -1.7% 0.62 / 0.61 / +1.7%
tpcds_q70/duckdb:vortex-file-compressed 15820020 / 16314066 / -3.0% 27442983 / 27191282 / +0.9% 0.58 / 0.60 / -3.9%
tpcds_q71/duckdb:vortex-file-compressed 13125354 / 12617499 / +4.0% 23263359 / 23746617 / -2.0% 0.56 / 0.53 / +6.2%
tpcds_q72/duckdb:vortex-file-compressed 51618290 / 51945424 / -0.6% 62623853 / 62476510 / +0.2% 0.82 / 0.83 / -0.9%
tpcds_q73/duckdb:vortex-file-compressed 11967806 / 11909118 / +0.5% 20604571 / 21101470 / -2.4% 0.58 / 0.56 / +2.9%
tpcds_q74/duckdb:vortex-file-compressed 26106756 / 26041908 / +0.2% 33321910 / 34022832 / -2.1% 0.78 / 0.77 / +2.4%
tpcds_q75/duckdb:vortex-file-compressed 27876121 / 28133652 / -0.9% 37739887 / 38375865 / -1.7% 0.74 / 0.73 / +0.8%
tpcds_q76/duckdb:vortex-file-compressed 12931970 / 12764356 / +1.3% 22375923 / 22963071 / -2.6% 0.58 / 0.56 / +4.0%
tpcds_q77/duckdb:vortex-file-compressed 21190877 / 21418045 / -1.1% 30970548 / 32708962 / -5.3% 0.68 / 0.65 / +4.5%
tpcds_q78/duckdb:vortex-file-compressed 43358776 / 43337642 / +0.0% 52949939 / 53885227 / -1.7% 0.82 / 0.80 / +1.8%
tpcds_q79/duckdb:vortex-file-compressed 13115146 / 13232534 / -0.9% 21007641 / 21910779 / -4.1% 0.62 / 0.60 / +3.4%
tpcds_q80/duckdb:vortex-file-compressed 37230844 / 36847054 / +1.0% 48807649 / 49501801 / -1.4% 0.76 / 0.74 / +2.5%
tpcds_q81/duckdb:vortex-file-compressed 21457808 / 21429800 / +0.1% 29060258 / 30095533 / -3.4% 0.74 / 0.71 / +3.7%
tpcds_q82/duckdb:vortex-file-compressed 9509042 / 9708050 / -2.0% 23376448 / 25061879 / -6.7% 0.41 / 0.39 / +5.0%
tpcds_q83/duckdb:vortex-file-compressed 17595558 / 17427131 / +1.0% 24318817 / 24376519 / -0.2% 0.72 / 0.71 / +1.2%
tpcds_q84/duckdb:vortex-file-compressed 15825453 / 15770181 / +0.4% 22336104 / 23129342 / -3.4% 0.71 / 0.68 / +3.9%
tpcds_q85/duckdb:vortex-file-compressed 24703315 / 24403894 / +1.2% 35453738 / 36380296 / -2.5% 0.70 / 0.67 / +3.9%
tpcds_q86/duckdb:vortex-file-compressed 10052730 / 9717139 / +3.5% 15874401 / 15906721 / -0.2% 0.63 / 0.61 / +3.7%
tpcds_q87/duckdb:vortex-file-compressed 26402958 / 26017050 / +1.5% 33224281 / 33396290 / -0.5% 0.79 / 0.78 / +2.0%
tpcds_q88/duckdb:vortex-file-compressed 30459418 / 30324574 / +0.4% 37071433 / 38572757 / -3.9% 0.82 / 0.79 / +4.5%
tpcds_q89/duckdb:vortex-file-compressed 12075890 / 12106472 / -0.3% 20996715 / 20820791 / +0.8% 0.58 / 0.58 / -1.1%
tpcds_q90/duckdb:vortex-file-compressed 8064502 / 7989972 / +0.9% 15011464 / 15308508 / -1.9% 0.54 / 0.52 / +2.9%
tpcds_q91/duckdb:vortex-file-compressed 14567294 / 14428822 / +1.0% 21228670 / 23070665 / -8.0% 0.69 / 0.63 / +9.7%
tpcds_q92/duckdb:vortex-file-compressed 12259832 / 12093567 / +1.4% 20003435 / 20435129 / -2.1% 0.61 / 0.59 / +3.6%
tpcds_q93/duckdb:vortex-file-compressed 10263931 / 10489510 / -2.2% 21577982 / 23114016 / -6.6% 0.48 / 0.45 / +4.8%
tpcds_q94/duckdb:vortex-file-compressed 22478956 / 21924813 / +2.5% 31693392 / 32104172 / -1.3% 0.71 / 0.68 / +3.9%
tpcds_q95/duckdb:vortex-file-compressed 63256224 / 62938576 / +0.5% 71473539 / 71963612 / -0.7% 0.89 / 0.87 / +1.2%
tpcds_q96/duckdb:vortex-file-compressed 6860702 / 6838084 / +0.3% 14114849 / 14762606 / -4.4% 0.49 / 0.46 / +4.9%
tpcds_q97/duckdb:vortex-file-compressed 23411680 / 23163218 / +1.1% 31478537 / 31012754 / +1.5% 0.74 / 0.75 / -0.4%
tpcds_q98/duckdb:vortex-file-compressed 11509929 / 11360176 / +1.3% 19242550 / 19475284 / -1.2% 0.60 / 0.58 / +2.5%
tpcds_q99/duckdb:vortex-file-compressed 14676279 / 14668948 / +0.0% 22148991 / 22813440 / -2.9% 0.66 / 0.64 / +3.1%
duckdb / parquet / ns (1.002x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23867408 / 23966969 / -0.4% 30434847 / 30829019 / -1.3% 0.78 / 0.78 / +0.9%
tpcds_q02/duckdb:parquet 17878904 / 17973470 / -0.5% 24043562 / 23889142 / +0.6% 0.74 / 0.75 / -1.2%
tpcds_q03/duckdb:parquet 9740840 / 9784454 / -0.4% 15317319 / 15698965 / -2.4% 0.64 / 0.62 / +2.0%
tpcds_q04/duckdb:parquet 117584190 / 117912489 / -0.3% 125829489 / 126089418 / -0.2% 0.93 / 0.94 / -0.1%
tpcds_q05/duckdb:parquet 28101516 / 28395371 / -1.0% 32721896 / 32582262 / +0.4% 0.86 / 0.87 / -1.5%
tpcds_q06/duckdb:parquet 26366598 / 26216986 / +0.6% 35119413 / 35588221 / -1.3% 0.75 / 0.74 / +1.9%
tpcds_q07/duckdb:parquet 33190601 / 33420428 / -0.7% 38054142 / 38430436 / -1.0% 0.87 / 0.87 / +0.3%
tpcds_q08/duckdb:parquet 19746853 / 19585998 / +0.8% 25565008 / 26172260 / -2.3% 0.77 / 0.75 / +3.2%
tpcds_q09/duckdb:parquet 26486582 / 27371152 / -3.2% 30542988 / 29649948 / +3.0% 0.87 / 0.92 / -6.1%
tpcds_q10/duckdb:parquet 32322252 / 32361482 / -0.1% 39468465 / 40184705 / -1.8% 0.82 / 0.81 / +1.7%
tpcds_q11/duckdb:parquet 70253383 / 68514487 / +2.5% 75241133 / 76389272 / -1.5% 0.93 / 0.90 / +4.1%
tpcds_q12/duckdb:parquet 14126328 / 13876876 / +1.8% 18487606 / 19186188 / -3.6% 0.76 / 0.72 / +5.6%
tpcds_q13/duckdb:parquet 31904930 / 30368470 / +5.1% 39597036 / 40187836 / -1.5% 0.81 / 0.76 / +6.6%
tpcds_q14/duckdb:parquet 65391450 / 63510142 / +3.0% 66949617 / 67941108 / -1.5% 0.98 / 0.93 / +4.5%
tpcds_q15/duckdb:parquet 16585905 / 16546332 / +0.2% 22116902 / 22895550 / -3.4% 0.75 / 0.72 / +3.8%
tpcds_q16/duckdb:parquet 30043968 / 30007520 / +0.1% 36646528 / 36406547 / +0.7% 0.82 / 0.82 / -0.5%
tpcds_q17/duckdb:parquet 34469506 / 34177397 / +0.9% 39598475 / 40441172 / -2.1% 0.87 / 0.85 / +3.0%
tpcds_q18/duckdb:parquet 47286316 / 47042055 / +0.5% 54477651 / 54456240 / +0.0% 0.87 / 0.86 / +0.5%
tpcds_q19/duckdb:parquet 18706036 / 18502952 / +1.1% 25089938 / 25759438 / -2.6% 0.75 / 0.72 / +3.8%
tpcds_q20/duckdb:parquet 14942382 / 14883558 / +0.4% 19648169 / 19539428 / +0.6% 0.76 / 0.76 / -0.2%
tpcds_q21/duckdb:parquet 10264214 / 10610768 / -3.3% 16248138 / 17113867 / -5.1% 0.63 / 0.62 / +1.9%
tpcds_q22/duckdb:parquet 20721696 / 20553610 / +0.8% 26316064 / 26725059 / -1.5% 0.79 / 0.77 / +2.4%
tpcds_q23/duckdb:parquet 42973744 / 43575614 / -1.4% 49240728 / 46598579 / +5.7% 0.87 / 0.94 / -6.7%
tpcds_q24/duckdb:parquet 30509500 / 30367457 / +0.5% 35809622 / 36478211 / -1.8% 0.85 / 0.83 / +2.3%
tpcds_q25/duckdb:parquet 30265139 / 30221780 / +0.1% 36650611 / 36937818 / -0.8% 0.83 / 0.82 / +0.9%
tpcds_q26/duckdb:parquet 28745029 / 28776880 / -0.1% 35033696 / 35302112 / -0.8% 0.82 / 0.82 / +0.7%
tpcds_q27/duckdb:parquet 35926626 / 35523786 / +1.1% 41213425 / 41611405 / -1.0% 0.87 / 0.85 / +2.1%
tpcds_q28/duckdb:parquet 26108491 / 26328432 / -0.8% 35127743 / 34309155 / +2.4% 0.74 / 0.77 / -3.1%
tpcds_q29/duckdb:parquet 32197513 / 31825925 / +1.2% 38447456 / 38870785 / -1.1% 0.84 / 0.82 / +2.3%
tpcds_q30/duckdb:parquet 34990750 / 35121615 / -0.4% 43394207 / 44712118 / -2.9% 0.81 / 0.79 / +2.7%
tpcds_q31/duckdb:parquet 35457945 / 35271778 / +0.5% 42371548 / 42481930 / -0.3% 0.84 / 0.83 / +0.8%
tpcds_q32/duckdb:parquet 14162344 / 14057028 / +0.7% 20676949 / 20598153 / +0.4% 0.68 / 0.68 / +0.4%
tpcds_q33/duckdb:parquet 24155326 / 23124152 / +4.5% 28592347 / 29167207 / -2.0% 0.84 / 0.79 / +6.6%
tpcds_q34/duckdb:parquet 16924632 / 16934344 / -0.1% 23906107 / 24303526 / -1.6% 0.71 / 0.70 / +1.6%
tpcds_q35/duckdb:parquet 34981468 / 35187535 / -0.6% 43046129 / 43708254 / -1.5% 0.81 / 0.81 / +0.9%
tpcds_q36/duckdb:parquet 40457740 / 39353736 / +2.8% 47290733 / 47971471 / -1.4% 0.86 / 0.82 / +4.3%
tpcds_q37/duckdb:parquet 12868978 / 12699916 / +1.3% 18984906 / 19775516 / -4.0% 0.68 / 0.64 / +5.6%
tpcds_q38/duckdb:parquet 29640558 / 29409083 / +0.8% 33397408 / 33644782 / -0.7% 0.89 / 0.87 / +1.5%
tpcds_q39/duckdb:parquet 23168611 / 23268776 / -0.4% 29617781 / 30173448 / -1.8% 0.78 / 0.77 / +1.4%
tpcds_q40/duckdb:parquet 15842849 / 15818668 / +0.2% 20974045 / 21350935 / -1.8% 0.76 / 0.74 / +2.0%
tpcds_q41/duckdb:parquet 11896318 / 11937368 / -0.3% 17760219 / 17654837 / +0.6% 0.67 / 0.68 / -0.9%
tpcds_q42/duckdb:parquet 9412453 / 9467242 / -0.6% 15219215 / 15390992 / -1.1% 0.62 / 0.62 / +0.5%
tpcds_q43/duckdb:parquet 11954363 / 13469714 / -11.3% 🟢 17880052 / 18054883 / -1.0% 0.67 / 0.75 / -10.4%
tpcds_q44/duckdb:parquet 21028284 / 21728390 / -3.2% 26820366 / 27212840 / -1.4% 0.78 / 0.80 / -1.8%
tpcds_q45/duckdb:parquet 20886516 / 20743408 / +0.7% 27194067 / 27840154 / -2.3% 0.77 / 0.75 / +3.1%
tpcds_q46/duckdb:parquet 35930114 / 36989149 / -2.9% 43081168 / 44071441 / -2.2% 0.83 / 0.84 / -0.6%
tpcds_q47/duckdb:parquet 34173837 / 34549854 / -1.1% 41455086 / 41188971 / +0.6% 0.82 / 0.84 / -1.7%
tpcds_q48/duckdb:parquet 30837976 / 30458733 / +1.2% 36404360 / 37126578 / -1.9% 0.85 / 0.82 / +3.3%
tpcds_q49/duckdb:parquet 29099908 / 30077962 / -3.3% 35443294 / 35486466 / -0.1% 0.82 / 0.85 / -3.1%
tpcds_q50/duckdb:parquet 19341796 / 19303932 / +0.2% 25322691 / 25663854 / -1.3% 0.76 / 0.75 / +1.5%
tpcds_q51/duckdb:parquet 52800778 / 51972089 / +1.6% 59936577 / 60028308 / -0.2% 0.88 / 0.87 / +1.7%
tpcds_q52/duckdb:parquet 9574180 / 9584687 / -0.1% 15603149 / 15536302 / +0.4% 0.61 / 0.62 / -0.5%
tpcds_q53/duckdb:parquet 15012322 / 13859535 / +8.3% 20694806 / 21051270 / -1.7% 0.73 / 0.66 / +10.2%
tpcds_q54/duckdb:parquet 24663774 / 24769012 / -0.4% 31524287 / 32317507 / -2.5% 0.78 / 0.77 / +2.1%
tpcds_q55/duckdb:parquet 9441343 / 9458322 / -0.2% 15182271 / 15628508 / -2.9% 0.62 / 0.61 / +2.8%
tpcds_q56/duckdb:parquet 25740558 / 24451846 / +5.3% 29820435 / 30263945 / -1.5% 0.86 / 0.81 / +6.8%
tpcds_q57/duckdb:parquet 30305879 / 30496694 / -0.6% 35666356 / 36082806 / -1.2% 0.85 / 0.85 / +0.5%
tpcds_q58/duckdb:parquet 23868594 / 24048685 / -0.7% 29390444 / 29574418 / -0.6% 0.81 / 0.81 / -0.1%
tpcds_q59/duckdb:parquet 22609676 / 22781209 / -0.8% 28187073 / 28822798 / -2.2% 0.80 / 0.79 / +1.5%
tpcds_q60/duckdb:parquet 27751044 / 26326926 / +5.4% 31733818 / 32439784 / -2.2% 0.87 / 0.81 / +7.8%
tpcds_q61/duckdb:parquet 25245368 / 24386621 / +3.5% 28243592 / 28840820 / -2.1% 0.89 / 0.85 / +5.7%
tpcds_q62/duckdb:parquet 12709573 / 12837852 / -1.0% 17571926 / 18021543 / -2.5% 0.72 / 0.71 / +1.5%
tpcds_q63/duckdb:parquet 13464142 / 13411461 / +0.4% 22131689 / 20165946 / +9.7% 0.61 / 0.67 / -8.5%
tpcds_q64/duckdb:parquet 70156633 / 70200230 / -0.1% 78985108 / 80412181 / -1.8% 0.89 / 0.87 / +1.7%
tpcds_q65/duckdb:parquet 20071978 / 18687231 / +7.4% 25506772 / 26192155 / -2.6% 0.79 / 0.71 / +10.3%
tpcds_q66/duckdb:parquet 33197682 / 33369771 / -0.5% 37882491 / 37725314 / +0.4% 0.88 / 0.88 / -0.9%
tpcds_q67/duckdb:parquet 61154386 / 60819089 / +0.6% 66904505 / 67228661 / -0.5% 0.91 / 0.90 / +1.0%
tpcds_q68/duckdb:parquet 29335154 / 29259984 / +0.3% 35944676 / 36839271 / -2.4% 0.82 / 0.79 / +2.8%
tpcds_q69/duckdb:parquet 25597401 / 25569940 / +0.1% 33834137 / 34423942 / -1.7% 0.76 / 0.74 / +1.9%
tpcds_q70/duckdb:parquet 19140892 / 19192084 / -0.3% 26878312 / 26739741 / +0.5% 0.71 / 0.72 / -0.8%
tpcds_q71/duckdb:parquet 17017439 / 17054927 / -0.2% 23469207 / 23954836 / -2.0% 0.73 / 0.71 / +1.8%
tpcds_q72/duckdb:parquet 53562930 / 52932942 / +1.2% 58297945 / 59845214 / -2.6% 0.92 / 0.88 / +3.9%
tpcds_q73/duckdb:parquet 15426271 / 14661652 / +5.2% 21332925 / 21893138 / -2.6% 0.72 / 0.67 / +8.0%
tpcds_q74/duckdb:parquet 83973826 / 84390668 / -0.5% 90641939 / 91452584 / -0.9% 0.93 / 0.92 / +0.4%
tpcds_q75/duckdb:parquet 44172808 / 44687585 / -1.2% 49415500 / 50609140 / -2.4% 0.89 / 0.88 / +1.2%
tpcds_q76/duckdb:parquet 17833771 / 19040094 / -6.3% 23118118 / 23607159 / -2.1% 0.77 / 0.81 / -4.4%
tpcds_q77/duckdb:parquet 25425391 / 25425972 / -0.0% 30427562 / 32155175 / -5.4% 0.84 / 0.79 / +5.7%
tpcds_q78/duckdb:parquet 78205574 / 77093010 / +1.4% 85561190 / 84250182 / +1.6% 0.91 / 0.92 / -0.1%
tpcds_q79/duckdb:parquet 21349678 / 21130690 / +1.0% 28567718 / 29307556 / -2.5% 0.75 / 0.72 / +3.7%
tpcds_q80/duckdb:parquet 37843930 / 37184819 / +1.8% 43142013 / 43847529 / -1.6% 0.88 / 0.85 / +3.4%
tpcds_q81/duckdb:parquet 36182401 / 35976995 / +0.6% 44459038 / 44333291 / +0.3% 0.81 / 0.81 / +0.3%
tpcds_q82/duckdb:parquet 13363826 / 13373336 / -0.1% 19770333 / 20170460 / -2.0% 0.68 / 0.66 / +2.0%
tpcds_q83/duckdb:parquet 19978170 / 20056018 / -0.4% 24820843 / 24832676 / -0.0% 0.80 / 0.81 / -0.3%
tpcds_q84/duckdb:parquet 22947624 / 22552006 / +1.8% 28279787 / 28863502 / -2.0% 0.81 / 0.78 / +3.9%
tpcds_q85/duckdb:parquet 32456104 / 32295063 / +0.5% 38861968 / 39757757 / -2.3% 0.84 / 0.81 / +2.8%
tpcds_q86/duckdb:parquet 11721115 / 11671840 / +0.4% 16350905 / 17041774 / -4.1% 0.72 / 0.68 / +4.7%
tpcds_q87/duckdb:parquet 31617970 / 31295030 / +1.0% 34545072 / 35573309 / -2.9% 0.92 / 0.88 / +4.0%
tpcds_q88/duckdb:parquet 38229540 / 38174937 / +0.1% 45147798 / 41231775 / +9.5% 0.85 / 0.93 / -8.5%
tpcds_q89/duckdb:parquet 14134311 / 15086220 / -6.3% 21220030 / 21158011 / +0.3% 0.67 / 0.71 / -6.6%
tpcds_q90/duckdb:parquet 10042815 / 9834406 / +2.1% 14942490 / 15371268 / -2.8% 0.67 / 0.64 / +5.0%
tpcds_q91/duckdb:parquet 20848588 / 20811260 / +0.2% 27609274 / 28789486 / -4.1% 0.76 / 0.72 / +4.5%
tpcds_q92/duckdb:parquet 15393178 / 15505942 / -0.7% 21916899 / 21884251 / +0.1% 0.70 / 0.71 / -0.9%
tpcds_q93/duckdb:parquet 14017114 / 14008072 / +0.1% 19842657 / 20243382 / -2.0% 0.71 / 0.69 / +2.1%
tpcds_q94/duckdb:parquet 25295183 / 25514996 / -0.9% 32707747 / 32909651 / -0.6% 0.77 / 0.78 / -0.2%
tpcds_q95/duckdb:parquet 43629690 / 43842982 / -0.5% 49209001 / 49538887 / -0.7% 0.89 / 0.89 / +0.2%
tpcds_q96/duckdb:parquet 8242284 / 8142782 / +1.2% 13483306 / 13576831 / -0.7% 0.61 / 0.60 / +1.9%
tpcds_q97/duckdb:parquet 27199199 / 27093344 / +0.4% 33764218 / 32358898 / +4.3% 0.81 / 0.84 / -3.8%
tpcds_q98/duckdb:parquet 16353006 / 16374839 / -0.1% 22603633 / 23141567 / -2.3% 0.72 / 0.71 / +2.2%
tpcds_q99/duckdb:parquet 18678240 / 18656013 / +0.1% 24526967 / 24696138 / -0.7% 0.76 / 0.76 / +0.8%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 0a0c827a vs base 246a397e
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (-0.7%, environment too noisy confidence) · DuckDB No clear signal (+1.1%, environment too noisy confidence)
Vortex (geomean): hot 1.054x ➖ · cold 1.056x ➖
Parquet (geomean): hot 1.053x ➖ · cold 1.021x ➖
Shifts: Parquet (control) +5.3% · Median polish +3.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.065x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 216317803 / 220831264 / -2.0% 599422818 / 576458480 / +4.0% 0.36 / 0.38 / -5.8%
tpch_q02/datafusion:vortex-file-compressed 326564309 / 308669932 / +5.8% 659844945 / 674528013 / -2.2% 0.49 / 0.46 / +8.2%
tpch_q03/datafusion:vortex-file-compressed 353408948 / 347086704 / +1.8% 983708914 / 871608881 / +12.9% 0.36 / 0.40 / -9.8%
tpch_q04/datafusion:vortex-file-compressed 200730975 / 207021749 / -3.0% 450251840 / 422384755 / +6.6% 0.45 / 0.49 / -9.0%
tpch_q05/datafusion:vortex-file-compressed 454320506 / 425586511 / +6.8% 635095369 / 613441206 / +3.5% 0.72 / 0.69 / +3.1%
tpch_q06/datafusion:vortex-file-compressed 219334075 / 141424151 / +55.1% 🔴 327881872 / 371254228 / -11.7% 0.67 / 0.38 / +75.6%
tpch_q07/datafusion:vortex-file-compressed 661866064 / 462415225 / +43.1% 🔴 2244886939 / 582547518 / +285.4% 🔴 0.29 / 0.79 / -62.9%
tpch_q08/datafusion:vortex-file-compressed 1024031815 / 427390773 / +139.6% 🔴 1083359463 / 601931393 / +80.0% 🔴 0.95 / 0.71 / +33.1%
tpch_q09/datafusion:vortex-file-compressed 262812571 / 268529658 / -2.1% 534828770 / 473357724 / +13.0% 0.49 / 0.57 / -13.4%
tpch_q10/datafusion:vortex-file-compressed 416094835 / 348508035 / +19.4% 699946489 / 528499094 / +32.4% 🔴 0.59 / 0.66 / -9.9%
tpch_q11/datafusion:vortex-file-compressed 276428586 / 257327413 / +7.4% 450835373 / 420659524 / +7.2% 0.61 / 0.61 / +0.2%
tpch_q12/datafusion:vortex-file-compressed 223532210 / 210715328 / +6.1% 391128877 / 429074710 / -8.8% 0.57 / 0.49 / +16.4%
tpch_q13/datafusion:vortex-file-compressed 135332186 / 131309055 / +3.1% 324025122 / 370354402 / -12.5% 0.42 / 0.35 / +17.8%
tpch_q14/datafusion:vortex-file-compressed 196547203 / 211521200 / -7.1% 354802269 / 383637559 / -7.5% 0.55 / 0.55 / +0.5%
tpch_q15/datafusion:vortex-file-compressed 341009315 / 292649172 / +16.5% 651520239 / 520914480 / +25.1% 0.52 / 0.56 / -6.8%
tpch_q16/datafusion:vortex-file-compressed 128469186 / 158770515 / -19.1% 275843345 / 318188188 / -13.3% 0.47 / 0.50 / -6.7%
tpch_q17/datafusion:vortex-file-compressed 290148480 / 307709054 / -5.7% 507050189 / 454845057 / +11.5% 0.57 / 0.68 / -15.4%
tpch_q18/datafusion:vortex-file-compressed 285186871 / 590427775 / -51.7% 🟢 517465989 / 723635830 / -28.5% 0.55 / 0.82 / -32.5%
tpch_q19/datafusion:vortex-file-compressed 254522862 / 216120746 / +17.8% 380685868 / 356996489 / +6.6% 0.67 / 0.61 / +10.4%
tpch_q20/datafusion:vortex-file-compressed 272436952 / 292443661 / -6.8% 649743749 / 509890552 / +27.4% 0.42 / 0.57 / -26.9%
tpch_q21/datafusion:vortex-file-compressed 519993905 / 456400316 / +13.9% 723698217 / 730212380 / -0.9% 0.72 / 0.63 / +15.0%
tpch_q22/datafusion:vortex-file-compressed 167156591 / 167024301 / +0.1% 360731017 / 388209621 / -7.1% 0.46 / 0.43 / +7.7%
datafusion / parquet / ns (1.072x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 155335185 / 150351198 / +3.3% 507639819 / 460460005 / +10.2% 0.31 / 0.33 / -6.3%
tpch_q02/datafusion:parquet 345521368 / 284014916 / +21.7% 561963454 / 458008198 / +22.7% 0.61 / 0.62 / -0.8%
tpch_q03/datafusion:parquet 277343879 / 271007543 / +2.3% 695186419 / 753951884 / -7.8% 0.40 / 0.36 / +11.0%
tpch_q04/datafusion:parquet 140274428 / 133714329 / +4.9% 284863116 / 322406865 / -11.6% 0.49 / 0.41 / +18.7%
tpch_q05/datafusion:parquet 351688446 / 342356608 / +2.7% 445432149 / 468240904 / -4.9% 0.79 / 0.73 / +8.0%
tpch_q06/datafusion:parquet 110987580 / 112055911 / -1.0% 247306685 / 226141107 / +9.4% 0.45 / 0.50 / -9.4%
tpch_q07/datafusion:parquet 351903431 / 329957349 / +6.7% 472286548 / 516179984 / -8.5% 0.75 / 0.64 / +16.6%
tpch_q08/datafusion:parquet 454952950 / 432763020 / +5.1% 536940239 / 536690978 / +0.0% 0.85 / 0.81 / +5.1%
tpch_q09/datafusion:parquet 392947942 / 373806384 / +5.1% 529976074 / 539014441 / -1.7% 0.74 / 0.69 / +6.9%
tpch_q10/datafusion:parquet 381070834 / 309340609 / +23.2% 480772724 / 417479206 / +15.2% 0.79 / 0.74 / +7.0%
tpch_q11/datafusion:parquet 368032561 / 261901027 / +40.5% 🔴 482410609 / 373704730 / +29.1% 0.76 / 0.70 / +8.9%
tpch_q12/datafusion:parquet 163196131 / 162342440 / +0.5% 269074636 / 309500458 / -13.1% 0.61 / 0.52 / +15.6%
tpch_q13/datafusion:parquet 270069211 / 276376623 / -2.3% 449421448 / 436081873 / +3.1% 0.60 / 0.63 / -5.2%
tpch_q14/datafusion:parquet 151343163 / 157906152 / -4.2% 274676894 / 273555838 / +0.4% 0.55 / 0.58 / -4.5%
tpch_q15/datafusion:parquet 300131970 / 317865748 / -5.6% 519166926 / 523121657 / -0.8% 0.58 / 0.61 / -4.9%
tpch_q16/datafusion:parquet 115059925 / 111322386 / +3.4% 269690065 / 231410953 / +16.5% 0.43 / 0.48 / -11.3%
tpch_q17/datafusion:parquet 318862441 / 272274209 / +17.1% 472851539 / 526187695 / -10.1% 0.67 / 0.52 / +30.3%
tpch_q18/datafusion:parquet 343805987 / 341966792 / +0.5% 459824119 / 503106611 / -8.6% 0.75 / 0.68 / +10.0%
tpch_q19/datafusion:parquet 215065808 / 157601017 / +36.5% 🔴 308749355 / 273426259 / +12.9% 0.70 / 0.58 / +20.8%
tpch_q20/datafusion:parquet 258866456 / 235515300 / +9.9% 447535317 / 397076072 / +12.7% 0.58 / 0.59 / -2.5%
tpch_q21/datafusion:parquet 316523980 / 292874917 / +8.1% 456285080 / 463033836 / -1.5% 0.69 / 0.63 / +9.7%
tpch_q22/datafusion:parquet 152013673 / 160199804 / -5.1% 374707660 / 388871374 / -3.6% 0.41 / 0.41 / -1.5%
duckdb / vortex-file-compressed / ns (1.044x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 249140748 / 247509334 / +0.7% 325059703 / 267181463 / +21.7% 0.77 / 0.93 / -17.3%
tpch_q02/duckdb:vortex-file-compressed 393052572 / 408988212 / -3.9% 515419397 / 495524216 / +4.0% 0.76 / 0.83 / -7.6%
tpch_q03/duckdb:vortex-file-compressed 425313189 / 416179552 / +2.2% 442679906 / 484765981 / -8.7% 0.96 / 0.86 / +11.9%
tpch_q04/duckdb:vortex-file-compressed 429853548 / 273734107 / +57.0% 🔴 284964828 / 309747374 / -8.0% 1.51 / 0.88 / +70.7%
tpch_q05/duckdb:vortex-file-compressed 1301891825 / 585375507 / +122.4% 🔴 839661787 / 657952067 / +27.6% 1.55 / 0.89 / +74.3%
tpch_q06/duckdb:vortex-file-compressed 173302850 / 203012163 / -14.6% 181452070 / 217053599 / -16.4% 0.96 / 0.94 / +2.1%
tpch_q07/duckdb:vortex-file-compressed 434437376 / 433499388 / +0.2% 503202432 / 491006362 / +2.5% 0.86 / 0.88 / -2.2%
tpch_q08/duckdb:vortex-file-compressed 584398602 / 856662362 / -31.8% 🟢 614797146 / 924712147 / -33.5% 🟢 0.95 / 0.93 / +2.6%
tpch_q09/duckdb:vortex-file-compressed 386315910 / 430063376 / -10.2% 421819944 / 472261724 / -10.7% 0.92 / 0.91 / +0.6%
tpch_q10/duckdb:vortex-file-compressed 544247709 / 562615415 / -3.3% 565662084 / 577179328 / -2.0% 0.96 / 0.97 / -1.3%
tpch_q11/duckdb:vortex-file-compressed 721189608 / 295453825 / +144.1% 🔴 591022690 / 295294530 / +100.1% 🔴 1.22 / 1.00 / +22.0%
tpch_q12/duckdb:vortex-file-compressed 247371636 / 281391065 / -12.1% 272433440 / 342314564 / -20.4% 0.91 / 0.82 / +10.5%
tpch_q13/duckdb:vortex-file-compressed 223417919 / 257839733 / -13.4% 281506551 / 337095202 / -16.5% 0.79 / 0.76 / +3.8%
tpch_q14/duckdb:vortex-file-compressed 261726455 / 215999117 / +21.2% 327244514 / 312373489 / +4.8% 0.80 / 0.69 / +15.7%
tpch_q15/duckdb:vortex-file-compressed 256028180 / 339636073 / -24.6% 345850478 / 292926502 / +18.1% 0.74 / 1.16 / -36.2%
tpch_q16/duckdb:vortex-file-compressed 201297776 / 210376153 / -4.3% 240333931 / 230946559 / +4.1% 0.84 / 0.91 / -8.1%
tpch_q17/duckdb:vortex-file-compressed 307948911 / 324970756 / -5.2% 419333853 / 357086182 / +17.4% 0.73 / 0.91 / -19.3%
tpch_q18/duckdb:vortex-file-compressed 374711178 / 431733303 / -13.2% 378703488 / 402106068 / -5.8% 0.99 / 1.07 / -7.8%
tpch_q19/duckdb:vortex-file-compressed 319638514 / 303395982 / +5.4% 359774948 / 339697179 / +5.9% 0.89 / 0.89 / -0.5%
tpch_q20/duckdb:vortex-file-compressed 375796500 / 385636006 / -2.6% 437327334 / 483758671 / -9.6% 0.86 / 0.80 / +7.8%
tpch_q21/duckdb:vortex-file-compressed 683672205 / 656583605 / +4.1% 699823970 / 782358666 / -10.5% 0.98 / 0.84 / +16.4%
tpch_q22/duckdb:vortex-file-compressed 260231773 / 251855732 / +3.3% 332836348 / 334512025 / -0.5% 0.78 / 0.75 / +3.8%
duckdb / parquet / ns (1.033x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 169282909 / 152166910 / +11.2% 202622097 / 211204649 / -4.1% 0.84 / 0.72 / +16.0%
tpch_q02/duckdb:parquet 504969854 / 453471368 / +11.4% 522046405 / 426327264 / +22.5% 0.97 / 1.06 / -9.1%
tpch_q03/duckdb:parquet 438767439 / 358243434 / +22.5% 453956084 / 423368603 / +7.2% 0.97 / 0.85 / +14.2%
tpch_q04/duckdb:parquet 349371339 / 281717280 / +24.0% 367061923 / 332953926 / +10.2% 0.95 / 0.85 / +12.5%
tpch_q05/duckdb:parquet 490940805 / 536493872 / -8.5% 584649016 / 570606274 / +2.5% 0.84 / 0.94 / -10.7%
tpch_q06/duckdb:parquet 139729753 / 161239284 / -13.3% 174417267 / 206658661 / -15.6% 0.80 / 0.78 / +2.7%
tpch_q07/duckdb:parquet 414018707 / 436361603 / -5.1% 461113894 / 493434333 / -6.6% 0.90 / 0.88 / +1.5%
tpch_q08/duckdb:parquet 581477920 / 631844333 / -8.0% 612865745 / 652757052 / -6.1% 0.95 / 0.97 / -2.0%
tpch_q09/duckdb:parquet 554424144 / 564743109 / -1.8% 616321862 / 620443574 / -0.7% 0.90 / 0.91 / -1.2%
tpch_q10/duckdb:parquet 685511401 / 581110821 / +18.0% 584481702 / 636456873 / -8.2% 1.17 / 0.91 / +28.5%
tpch_q11/duckdb:parquet 311285512 / 285994921 / +8.8% 283586443 / 263711609 / +7.5% 1.10 / 1.08 / +1.2%
tpch_q12/duckdb:parquet 221018764 / 252866750 / -12.6% 267774236 / 291902719 / -8.3% 0.83 / 0.87 / -4.7%
tpch_q13/duckdb:parquet 344354907 / 369355879 / -6.8% 437753373 / 429176067 / +2.0% 0.79 / 0.86 / -8.6%
tpch_q14/duckdb:parquet 236670123 / 269935408 / -12.3% 258740132 / 344984516 / -25.0% 0.91 / 0.78 / +16.9%
tpch_q15/duckdb:parquet 212191926 / 212505719 / -0.1% 270961295 / 228893439 / +18.4% 0.78 / 0.93 / -15.7%
tpch_q16/duckdb:parquet 271199038 / 275747511 / -1.6% 282378242 / 327100698 / -13.7% 0.96 / 0.84 / +13.9%
tpch_q17/duckdb:parquet 274094057 / 263952606 / +3.8% 366239530 / 331901361 / +10.3% 0.75 / 0.80 / -5.9%
tpch_q18/duckdb:parquet 376306371 / 382490629 / -1.6% 429089515 / 393794532 / +9.0% 0.88 / 0.97 / -9.7%
tpch_q19/duckdb:parquet 277182017 / 266061746 / +4.2% 309601774 / 345007366 / -10.3% 0.90 / 0.77 / +16.1%
tpch_q20/duckdb:parquet 545528130 / 448150426 / +21.7% 835171437 / 480087501 / +74.0% 🔴 0.65 / 0.93 / -30.0%
tpch_q21/duckdb:parquet 654221901 / 418893862 / +56.2% 🔴 510807109 / 454759125 / +12.3% 1.28 / 0.92 / +39.0%
tpch_q22/duckdb:parquet 282569807 / 323115195 / -12.5% 337537300 / 335134028 / +0.7% 0.84 / 0.96 / -13.2%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 0a0c827a vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (-0.0%, low confidence) · DuckDB No clear signal (-0.2%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 0.998x ➖
Parquet (geomean): hot 0.996x ➖ · cold 1.006x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1233811 / 1223583 / +0.8% 22252482 / 22393554 / -0.6% 0.06 / 0.05 / +1.5%
clickbench_q01/datafusion:vortex-file-compressed 6151468 / 6046842 / +1.7% 32527082 / 29592395 / +9.9% 0.19 / 0.20 / -7.4%
clickbench_q02/datafusion:vortex-file-compressed 10945380 / 10531240 / +3.9% 45201198 / 46036487 / -1.8% 0.24 / 0.23 / +5.9%
clickbench_q03/datafusion:vortex-file-compressed 12566595 / 12387916 / +1.4% 56060164 / 56727916 / -1.2% 0.22 / 0.22 / +2.7%
clickbench_q04/datafusion:vortex-file-compressed 57414564 / 58081216 / -1.1% 99951856 / 103589636 / -3.5% 0.57 / 0.56 / +2.4%
clickbench_q05/datafusion:vortex-file-compressed 78663440 / 79014320 / -0.4% 127542404 / 128484768 / -0.7% 0.62 / 0.61 / +0.3%
clickbench_q06/datafusion:vortex-file-compressed 1224474 / 1263943 / -3.1% 23073354 / 22422362 / +2.9% 0.05 / 0.06 / -5.9%
clickbench_q07/datafusion:vortex-file-compressed 9422385 / 9508768 / -0.9% 33983721 / 33881448 / +0.3% 0.28 / 0.28 / -1.2%
clickbench_q08/datafusion:vortex-file-compressed 80397266 / 79137674 / +1.6% 124988468 / 128803436 / -3.0% 0.64 / 0.61 / +4.7%
clickbench_q09/datafusion:vortex-file-compressed 171582465 / 173755480 / -1.3% 215195788 / 207375596 / +3.8% 0.80 / 0.84 / -4.8%
clickbench_q10/datafusion:vortex-file-compressed 22746718 / 23479735 / -3.1% 71478729 / 69620750 / +2.7% 0.32 / 0.34 / -5.6%
clickbench_q11/datafusion:vortex-file-compressed 24735854 / 26005739 / -4.9% 70443334 / 70384896 / +0.1% 0.35 / 0.37 / -5.0%
clickbench_q12/datafusion:vortex-file-compressed 71451394 / 75527217 / -5.4% 125504030 / 123896189 / +1.3% 0.57 / 0.61 / -6.6%
clickbench_q13/datafusion:vortex-file-compressed 117316534 / 115900178 / +1.2% 182082260 / 187353692 / -2.8% 0.64 / 0.62 / +4.2%
clickbench_q14/datafusion:vortex-file-compressed 75568001 / 75510882 / +0.1% 126249404 / 125936863 / +0.2% 0.60 / 0.60 / -0.2%
clickbench_q15/datafusion:vortex-file-compressed 64136068 / 63030918 / +1.8% 106061913 / 100187136 / +5.9% 0.60 / 0.63 / -3.9%
clickbench_q16/datafusion:vortex-file-compressed 154993046 / 155538995 / -0.4% 213125004 / 217221220 / -1.9% 0.73 / 0.72 / +1.6%
clickbench_q17/datafusion:vortex-file-compressed 153510372 / 155207311 / -1.1% 228215199 / 226552616 / +0.7% 0.67 / 0.69 / -1.8%
clickbench_q18/datafusion:vortex-file-compressed 306374522 / 294130736 / +4.2% 386558812 / 390830976 / -1.1% 0.79 / 0.75 / +5.3%
clickbench_q19/datafusion:vortex-file-compressed 8662460 / 8303792 / +4.3% 46671162 / 48242070 / -3.3% 0.19 / 0.17 / +7.8%
clickbench_q20/datafusion:vortex-file-compressed 69605350 / 71745774 / -3.0% 246789014 / 248435282 / -0.7% 0.28 / 0.29 / -2.3%
clickbench_q21/datafusion:vortex-file-compressed 78508732 / 79455405 / -1.2% 285742185 / 288506255 / -1.0% 0.27 / 0.28 / -0.2%
clickbench_q22/datafusion:vortex-file-compressed 91498352 / 91696814 / -0.2% 386374726 / 390845073 / -1.1% 0.24 / 0.23 / +0.9%
clickbench_q23/datafusion:vortex-file-compressed 182460396 / 183993637 / -0.8% 545627039 / 539539151 / +1.1% 0.33 / 0.34 / -1.9%
clickbench_q24/datafusion:vortex-file-compressed 15492928 / 15307686 / +1.2% 70850057 / 70032970 / +1.2% 0.22 / 0.22 / +0.0%
clickbench_q25/datafusion:vortex-file-compressed 19075243 / 19863486 / -4.0% 63698709 / 62923085 / +1.2% 0.30 / 0.32 / -5.1%
clickbench_q26/datafusion:vortex-file-compressed 15586648 / 16533236 / -5.7% 73973313 / 70743668 / +4.6% 0.21 / 0.23 / -9.8%
clickbench_q27/datafusion:vortex-file-compressed 101368894 / 101740724 / -0.4% 256955302 / 251569553 / +2.1% 0.39 / 0.40 / -2.5%
clickbench_q28/datafusion:vortex-file-compressed 564457497 / 562333160 / +0.4% 648832660 / 643537242 / +0.8% 0.87 / 0.87 / -0.4%
clickbench_q29/datafusion:vortex-file-compressed 24142786 / 24245137 / -0.4% 54423645 / 53670057 / +1.4% 0.44 / 0.45 / -1.8%
clickbench_q30/datafusion:vortex-file-compressed 56379058 / 57397381 / -1.8% 119997578 / 112998342 / +6.2% 0.47 / 0.51 / -7.5%
clickbench_q31/datafusion:vortex-file-compressed 67022896 / 65356445 / +2.5% 163885857 / 163081172 / +0.5% 0.41 / 0.40 / +2.0%
clickbench_q32/datafusion:vortex-file-compressed 284300238 / 290282297 / -2.1% 383959598 / 393223115 / -2.4% 0.74 / 0.74 / +0.3%
clickbench_q33/datafusion:vortex-file-compressed 322759198 / 324626808 / -0.6% 422176775 / 432328318 / -2.3% 0.76 / 0.75 / +1.8%
clickbench_q34/datafusion:vortex-file-compressed 326027883 / 324894899 / +0.3% 427788021 / 444404496 / -3.7% 0.76 / 0.73 / +4.2%
clickbench_q35/datafusion:vortex-file-compressed 56875740 / 56027504 / +1.5% 94289071 / 93654723 / +0.7% 0.60 / 0.60 / +0.8%
clickbench_q36/datafusion:vortex-file-compressed 37755759 / 37622886 / +0.4% 68474513 / 67872658 / +0.9% 0.55 / 0.55 / -0.5%
clickbench_q37/datafusion:vortex-file-compressed 21310366 / 21259280 / +0.2% 49456215 / 47424626 / +4.3% 0.43 / 0.45 / -3.9%
clickbench_q38/datafusion:vortex-file-compressed 13070016 / 13259514 / -1.4% 41941754 / 41723747 / +0.5% 0.31 / 0.32 / -1.9%
clickbench_q39/datafusion:vortex-file-compressed 78762076 / 78839799 / -0.1% 114167117 / 111367852 / +2.5% 0.69 / 0.71 / -2.5%
clickbench_q40/datafusion:vortex-file-compressed 10356763 / 10378568 / -0.2% 36950720 / 36528657 / +1.2% 0.28 / 0.28 / -1.3%
clickbench_q41/datafusion:vortex-file-compressed 9944560 / 9976754 / -0.3% 35586491 / 34471787 / +3.2% 0.28 / 0.29 / -3.4%
clickbench_q42/datafusion:vortex-file-compressed 10443504 / 10423952 / +0.2% 35844053 / 35196628 / +1.8% 0.29 / 0.30 / -1.6%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1234356 / 1245842 / -0.9% 50642776 / 49718186 / +1.9% 0.02 / 0.03 / -2.7%
clickbench_q01/datafusion:parquet 16350968 / 15975198 / +2.4% 72091035 / 66883453 / +7.8% 0.23 / 0.24 / -5.0%
clickbench_q02/datafusion:parquet 18582730 / 19024956 / -2.3% 79923634 / 81292366 / -1.7% 0.23 / 0.23 / -0.7%
clickbench_q03/datafusion:parquet 17152599 / 17560503 / -2.3% 82750234 / 79048536 / +4.7% 0.21 / 0.22 / -6.7%
clickbench_q04/datafusion:parquet 62634313 / 62657254 / -0.0% 127625270 / 129056405 / -1.1% 0.49 / 0.49 / +1.1%
clickbench_q05/datafusion:parquet 87662789 / 89388218 / -1.9% 159658521 / 157935497 / +1.1% 0.55 / 0.57 / -3.0%
clickbench_q06/datafusion:parquet 1244116 / 1247492 / -0.3% 50445778 / 49860473 / +1.2% 0.02 / 0.03 / -1.4%
clickbench_q07/datafusion:parquet 16728467 / 16844414 / -0.7% 69497752 / 67110170 / +3.6% 0.24 / 0.25 / -4.1%
clickbench_q08/datafusion:parquet 86775955 / 85805378 / +1.1% 160054699 / 160618520 / -0.4% 0.54 / 0.53 / +1.5%
clickbench_q09/datafusion:parquet 188736595 / 187483740 / +0.7% 272712401 / 273970246 / -0.5% 0.69 / 0.68 / +1.1%
clickbench_q10/datafusion:parquet 35916302 / 35933968 / -0.0% 102746223 / 99356253 / +3.4% 0.35 / 0.36 / -3.3%
clickbench_q11/datafusion:parquet 42820096 / 42619872 / +0.5% 112014143 / 107756386 / +4.0% 0.38 / 0.40 / -3.3%
clickbench_q12/datafusion:parquet 95438701 / 96266114 / -0.9% 162843605 / 162038776 / +0.5% 0.59 / 0.59 / -1.3%
clickbench_q13/datafusion:parquet 147984960 / 146539911 / +1.0% 228553824 / 227411999 / +0.5% 0.65 / 0.64 / +0.5%
clickbench_q14/datafusion:parquet 102179714 / 102721975 / -0.5% 176396155 / 174323102 / +1.2% 0.58 / 0.59 / -1.7%
clickbench_q15/datafusion:parquet 74339480 / 72072821 / +3.1% 130636998 / 130369029 / +0.2% 0.57 / 0.55 / +2.9%
clickbench_q16/datafusion:parquet 157784756 / 155655536 / +1.4% 235375923 / 242072681 / -2.8% 0.67 / 0.64 / +4.3%
clickbench_q17/datafusion:parquet 155298852 / 156748302 / -0.9% 235481722 / 234690281 / +0.3% 0.66 / 0.67 / -1.3%
clickbench_q18/datafusion:parquet 307695396 / 311937038 / -1.4% 417290110 / 429885360 / -2.9% 0.74 / 0.73 / +1.6%
clickbench_q19/datafusion:parquet 19699519 / 18985055 / +3.8% 79898318 / 76428879 / +4.5% 0.25 / 0.25 / -0.7%
clickbench_q20/datafusion:parquet 178783140 / 178201950 / +0.3% 301536819 / 277984119 / +8.5% 0.59 / 0.64 / -7.5%
clickbench_q21/datafusion:parquet 171662850 / 174353110 / -1.5% 317177695 / 298763106 / +6.2% 0.54 / 0.58 / -7.3%
clickbench_q22/datafusion:parquet 262899624 / 264644574 / -0.7% 457593733 / 427231380 / +7.1% 0.57 / 0.62 / -7.3%
clickbench_q23/datafusion:parquet 1003423604 / 1015310230 / -1.2% 1196149377 / 1186767292 / +0.8% 0.84 / 0.86 / -1.9%
clickbench_q24/datafusion:parquet 29986634 / 30461840 / -1.6% 91596764 / 89550560 / +2.3% 0.33 / 0.34 / -3.8%
clickbench_q25/datafusion:parquet 35870613 / 36461936 / -1.6% 103750573 / 103796692 / -0.0% 0.35 / 0.35 / -1.6%
clickbench_q26/datafusion:parquet 30568416 / 30640387 / -0.2% 92209210 / 89946311 / +2.5% 0.33 / 0.34 / -2.7%
clickbench_q27/datafusion:parquet 192734743 / 192726410 / +0.0% 305993256 / 288972174 / +5.9% 0.63 / 0.67 / -5.6%
clickbench_q28/datafusion:parquet 616313886 / 621473269 / -0.8% 718303092 / 715604342 / +0.4% 0.86 / 0.87 / -1.2%
clickbench_q29/datafusion:parquet 28506396 / 28657065 / -0.5% 92700529 / 90415523 / +2.5% 0.31 / 0.32 / -3.0%
clickbench_q30/datafusion:parquet 90646964 / 91351340 / -0.8% 179697557 / 172111509 / +4.4% 0.50 / 0.53 / -5.0%
clickbench_q31/datafusion:parquet 102588662 / 102634058 / -0.0% 200196367 / 198577852 / +0.8% 0.51 / 0.52 / -0.9%
clickbench_q32/datafusion:parquet 304106766 / 311819602 / -2.5% 425300893 / 434802281 / -2.2% 0.72 / 0.72 / -0.3%
clickbench_q33/datafusion:parquet 375727282 / 380089808 / -1.1% 476276158 / 473796518 / +0.5% 0.79 / 0.80 / -1.7%
clickbench_q34/datafusion:parquet 377069440 / 376914011 / +0.0% 474629284 / 477819866 / -0.7% 0.79 / 0.79 / +0.7%
clickbench_q35/datafusion:parquet 63979200 / 65520001 / -2.4% 124331200 / 122720394 / +1.3% 0.51 / 0.53 / -3.6%
clickbench_q36/datafusion:parquet 73602574 / 73697400 / -0.1% 136774758 / 136472185 / +0.2% 0.54 / 0.54 / -0.3%
clickbench_q37/datafusion:parquet 35787943 / 35543201 / +0.7% 90782103 / 91265731 / -0.5% 0.39 / 0.39 / +1.2%
clickbench_q38/datafusion:parquet 47678678 / 48184051 / -1.0% 107788223 / 110190286 / -2.2% 0.44 / 0.44 / +1.2%
clickbench_q39/datafusion:parquet 143265678 / 143896086 / -0.4% 209786527 / 213345420 / -1.7% 0.68 / 0.67 / +1.3%
clickbench_q40/datafusion:parquet 20097394 / 20053370 / +0.2% 78698440 / 78117633 / +0.7% 0.26 / 0.26 / -0.5%
clickbench_q41/datafusion:parquet 18750508 / 18881718 / -0.7% 76683718 / 76285755 / +0.5% 0.24 / 0.25 / -1.2%
clickbench_q42/datafusion:parquet 19139564 / 19347004 / -1.1% 74771205 / 74154859 / +0.8% 0.26 / 0.26 / -1.9%
duckdb / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2200710 / 2237106 / -1.6% 25405050 / 25307876 / +0.4% 0.09 / 0.09 / -2.0%
clickbench_q01/duckdb:vortex-file-compressed 7761158 / 7655398 / +1.4% 28026352 / 30911132 / -9.3% 0.28 / 0.25 / +11.8%
clickbench_q02/duckdb:vortex-file-compressed 9055308 / 9039239 / +0.2% 36256763 / 38103656 / -4.8% 0.25 / 0.24 / +5.3%
clickbench_q03/duckdb:vortex-file-compressed 13944433 / 14038454 / -0.7% 50373453 / 51361504 / -1.9% 0.28 / 0.27 / +1.3%
clickbench_q04/duckdb:vortex-file-compressed 56096972 / 55959632 / +0.2% 89739106 / 90702001 / -1.1% 0.63 / 0.62 / +1.3%
clickbench_q05/duckdb:vortex-file-compressed 63056456 / 63897903 / -1.3% 95809331 / 96923586 / -1.1% 0.66 / 0.66 / -0.2%
clickbench_q06/duckdb:vortex-file-compressed 2629846 / 2644494 / -0.6% 33198484 / 29217110 / +13.6% 🔴 0.08 / 0.09 / -12.5%
clickbench_q07/duckdb:vortex-file-compressed 9432548 / 9511088 / -0.8% 29458386 / 30810489 / -4.4% 0.32 / 0.31 / +3.7%
clickbench_q08/duckdb:vortex-file-compressed 69581268 / 69255778 / +0.5% 105643521 / 107914279 / -2.1% 0.66 / 0.64 / +2.6%
clickbench_q09/duckdb:vortex-file-compressed 91590614 / 92548142 / -1.0% 126707153 / 128409391 / -1.3% 0.72 / 0.72 / +0.3%
clickbench_q10/duckdb:vortex-file-compressed 27534834 / 27689274 / -0.6% 70141939 / 72148281 / -2.8% 0.39 / 0.38 / +2.3%
clickbench_q11/duckdb:vortex-file-compressed 30819769 / 30540370 / +0.9% 74572125 / 79204582 / -5.8% 0.41 / 0.39 / +7.2%
clickbench_q12/duckdb:vortex-file-compressed 71517904 / 69892491 / +2.3% 99919942 / 100654921 / -0.7% 0.72 / 0.69 / +3.1%
clickbench_q13/duckdb:vortex-file-compressed 128029481 / 127172012 / +0.7% 167739369 / 169732824 / -1.2% 0.76 / 0.75 / +1.9%
clickbench_q14/duckdb:vortex-file-compressed 74493131 / 74951316 / -0.6% 105615676 / 108241821 / -2.4% 0.71 / 0.69 / +1.9%
clickbench_q15/duckdb:vortex-file-compressed 75279755 / 75857344 / -0.8% 108278597 / 109421143 / -1.0% 0.70 / 0.69 / +0.3%
clickbench_q16/duckdb:vortex-file-compressed 132870152 / 133718120 / -0.6% 173635901 / 172972559 / +0.4% 0.77 / 0.77 / -1.0%
clickbench_q17/duckdb:vortex-file-compressed 135579848 / 139145834 / -2.6% 172167456 / 176256527 / -2.3% 0.79 / 0.79 / -0.2%
clickbench_q18/duckdb:vortex-file-compressed 258631780 / 261284120 / -1.0% 303974812 / 305972300 / -0.7% 0.85 / 0.85 / -0.4%
clickbench_q19/duckdb:vortex-file-compressed 9578566 / 9433455 / +1.5% 40074994 / 38621943 / +3.8% 0.24 / 0.24 / -2.1%
clickbench_q20/duckdb:vortex-file-compressed 66273848 / 67552078 / -1.9% 164112880 / 169737178 / -3.3% 0.40 / 0.40 / +1.5%
clickbench_q21/duckdb:vortex-file-compressed 83744019 / 85506677 / -2.1% 193205298 / 194027861 / -0.4% 0.43 / 0.44 / -1.6%
clickbench_q22/duckdb:vortex-file-compressed 176634940 / 176474637 / +0.1% 350883608 / 345523729 / +1.6% 0.50 / 0.51 / -1.4%
clickbench_q23/duckdb:vortex-file-compressed 42616528 / 41929978 / +1.6% 88050567 / 90293247 / -2.5% 0.48 / 0.46 / +4.2%
clickbench_q24/duckdb:vortex-file-compressed 13751859 / 14160536 / -2.9% 35761406 / 39660096 / -9.8% 0.38 / 0.36 / +7.7%
clickbench_q25/duckdb:vortex-file-compressed 19824910 / 19419968 / +2.1% 54588669 / 54403251 / +0.3% 0.36 / 0.36 / +1.7%
clickbench_q26/duckdb:vortex-file-compressed 11126427 / 11388071 / -2.3% 36993977 / 39205981 / -5.6% 0.30 / 0.29 / +3.5%
clickbench_q27/duckdb:vortex-file-compressed 53230628 / 55108350 / -3.4% 177561764 / 180380940 / -1.6% 0.30 / 0.31 / -1.9%
clickbench_q28/duckdb:vortex-file-compressed 513834144 / 516077988 / -0.4% 567013887 / 559514013 / +1.3% 0.91 / 0.92 / -1.8%
clickbench_q29/duckdb:vortex-file-compressed 17108331 / 16801554 / +1.8% 44254920 / 43120020 / +2.6% 0.39 / 0.39 / -0.8%
clickbench_q30/duckdb:vortex-file-compressed 61314790 / 60694336 / +1.0% 112450372 / 112438538 / +0.0% 0.55 / 0.54 / +1.0%
clickbench_q31/duckdb:vortex-file-compressed 110486322 / 110928932 / -0.4% 197409802 / 200481515 / -1.5% 0.56 / 0.55 / +1.2%
clickbench_q32/duckdb:vortex-file-compressed 374454064 / 376905062 / -0.7% 414482655 / 411978991 / +0.6% 0.90 / 0.91 / -1.3%
clickbench_q33/duckdb:vortex-file-compressed 342943030 / 346800168 / -1.1% 400897137 / 400039829 / +0.2% 0.86 / 0.87 / -1.3%
clickbench_q34/duckdb:vortex-file-compressed 352208386 / 358757820 / -1.8% 416126925 / 415394371 / +0.2% 0.85 / 0.86 / -2.0%
clickbench_q35/duckdb:vortex-file-compressed 57201344 / 57165394 / +0.1% 90831555 / 89565873 / +1.4% 0.63 / 0.64 / -1.3%
clickbench_q36/duckdb:vortex-file-compressed 11341092 / 11736720 / -3.4% 34165858 / 31701737 / +7.8% 0.33 / 0.37 / -10.3%
clickbench_q37/duckdb:vortex-file-compressed 8210205 / 8307028 / -1.2% 29297905 / 28390029 / +3.2% 0.28 / 0.29 / -4.2%
clickbench_q38/duckdb:vortex-file-compressed 8836534 / 9089105 / -2.8% 29102056 / 28411635 / +2.4% 0.30 / 0.32 / -5.1%
clickbench_q39/duckdb:vortex-file-compressed 18769528 / 18985566 / -1.1% 38731213 / 41519995 / -6.7% 0.48 / 0.46 / +6.0%
clickbench_q40/duckdb:vortex-file-compressed 7381042 / 7541189 / -2.1% 27725162 / 26930257 / +3.0% 0.27 / 0.28 / -4.9%
clickbench_q41/duckdb:vortex-file-compressed 8396040 / 8447401 / -0.6% 29225951 / 30600085 / -4.5% 0.29 / 0.28 / +4.1%
clickbench_q42/duckdb:vortex-file-compressed 7320396 / 7460622 / -1.9% 27111999 / 28688927 / -5.5% 0.27 / 0.26 / +3.8%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9499143 / 9718106 / -2.3% 14210203 / 14404944 / -1.4% 0.67 / 0.67 / -0.9%
clickbench_q01/duckdb:parquet 15158463 / 15834801 / -4.3% 21297998 / 20779530 / +2.5% 0.71 / 0.76 / -6.6%
clickbench_q02/duckdb:parquet 22886995 / 22998262 / -0.5% 31381376 / 30933941 / +1.4% 0.73 / 0.74 / -1.9%
clickbench_q03/duckdb:parquet 23009388 / 22952789 / +0.2% 34815547 / 36373798 / -4.3% 0.66 / 0.63 / +4.7%
clickbench_q04/duckdb:parquet 60723334 / 61553110 / -1.3% 73115916 / 78571229 / -6.9% 0.83 / 0.78 / +6.0%
clickbench_q05/duckdb:parquet 83000040 / 82357820 / +0.8% 95469473 / 96778532 / -1.4% 0.87 / 0.85 / +2.2%
clickbench_q06/duckdb:parquet 20379780 / 20631596 / -1.2% 28861136 / 27932745 / +3.3% 0.71 / 0.74 / -4.4%
clickbench_q07/duckdb:parquet 17056760 / 17411882 / -2.0% 24823217 / 23086324 / +7.5% 0.69 / 0.75 / -8.9%
clickbench_q08/duckdb:parquet 74082809 / 74193970 / -0.1% 88918626 / 88499093 / +0.5% 0.83 / 0.84 / -0.6%
clickbench_q09/duckdb:parquet 102525714 / 102344946 / +0.2% 116423397 / 118287242 / -1.6% 0.88 / 0.87 / +1.8%
clickbench_q10/duckdb:parquet 41798989 / 41585957 / +0.5% 55149448 / 53914290 / +2.3% 0.76 / 0.77 / -1.7%
clickbench_q11/duckdb:parquet 46254366 / 46376690 / -0.3% 62127619 / 62469950 / -0.5% 0.74 / 0.74 / +0.3%
clickbench_q12/duckdb:parquet 92754314 / 93246466 / -0.5% 106889286 / 106709132 / +0.2% 0.87 / 0.87 / -0.7%
clickbench_q13/duckdb:parquet 148542796 / 151353115 / -1.9% 172122206 / 168774480 / +2.0% 0.86 / 0.90 / -3.8%
clickbench_q14/duckdb:parquet 100220454 / 101132109 / -0.9% 116910210 / 121484338 / -3.8% 0.86 / 0.83 / +3.0%
clickbench_q15/duckdb:parquet 87440742 / 87152113 / +0.3% 98309477 / 99157583 / -0.9% 0.89 / 0.88 / +1.2%
clickbench_q16/duckdb:parquet 164581721 / 161518198 / +1.9% 175766567 / 177677559 / -1.1% 0.94 / 0.91 / +3.0%
clickbench_q17/duckdb:parquet 165912160 / 163501751 / +1.5% 178614935 / 179044078 / -0.2% 0.93 / 0.91 / +1.7%
clickbench_q18/duckdb:parquet 298927212 / 297760434 / +0.4% 316571065 / 317638716 / -0.3% 0.94 / 0.94 / +0.7%
clickbench_q19/duckdb:parquet 19960250 / 20044906 / -0.4% 26832230 / 26219883 / +2.3% 0.74 / 0.76 / -2.7%
clickbench_q20/duckdb:parquet 182294710 / 190656931 / -4.4% 225420817 / 223372775 / +0.9% 0.81 / 0.85 / -5.3%
clickbench_q21/duckdb:parquet 219449409 / 221775748 / -1.0% 265026831 / 270636772 / -2.1% 0.83 / 0.82 / +1.0%
clickbench_q22/duckdb:parquet 302910738 / 316494844 / -4.3% 351301179 / 356496439 / -1.5% 0.86 / 0.89 / -2.9%
clickbench_q23/duckdb:parquet 175250458 / 172903391 / +1.4% 241115177 / 233746562 / +3.2% 0.73 / 0.74 / -1.7%
clickbench_q24/duckdb:parquet 30457408 / 30525626 / -0.2% 44737136 / 44919682 / -0.4% 0.68 / 0.68 / +0.2%
clickbench_q25/duckdb:parquet 42379039 / 43279324 / -2.1% 60629598 / 55176174 / +9.9% 0.70 / 0.78 / -10.9%
clickbench_q26/duckdb:parquet 30435946 / 29909380 / +1.8% 44228505 / 47593911 / -7.1% 0.69 / 0.63 / +9.5%
clickbench_q27/duckdb:parquet 188344247 / 190317469 / -1.0% 230206178 / 230460935 / -0.1% 0.82 / 0.83 / -0.9%
clickbench_q28/duckdb:parquet 968893174 / 966912630 / +0.2% 945597034 / 939906810 / +0.6% 1.02 / 1.03 / -0.4%
clickbench_q29/duckdb:parquet 23614986 / 23708308 / -0.4% 31322837 / 31487776 / -0.5% 0.75 / 0.75 / +0.1%
clickbench_q30/duckdb:parquet 105356144 / 107434616 / -1.9% 125946686 / 126651318 / -0.6% 0.84 / 0.85 / -1.4%
clickbench_q31/duckdb:parquet 157488796 / 146264200 / +7.7% 174230830 / 172955499 / +0.7% 0.90 / 0.85 / +6.9%
clickbench_q32/duckdb:parquet 387034148 / 392919146 / -1.5% 413115478 / 417034375 / -0.9% 0.94 / 0.94 / -0.6%
clickbench_q33/duckdb:parquet 486121984 / 489452036 / -0.7% 452385086 / 442277693 / +2.3% 1.07 / 1.11 / -2.9%
clickbench_q34/duckdb:parquet 476941992 / 466236417 / +2.3% 457907086 / 469010681 / -2.4% 1.04 / 0.99 / +4.8%
clickbench_q35/duckdb:parquet 61512258 / 61471326 / +0.1% 72661242 / 75534239 / -3.8% 0.85 / 0.81 / +4.0%
clickbench_q36/duckdb:parquet 30136622 / 30715884 / -1.9% 35654446 / 36664389 / -2.8% 0.85 / 0.84 / +0.9%
clickbench_q37/duckdb:parquet 22654022 / 23465799 / -3.5% 29770718 / 29463089 / +1.0% 0.76 / 0.80 / -4.5%
clickbench_q38/duckdb:parquet 23890288 / 23803284 / +0.4% 29768441 / 30067802 / -1.0% 0.80 / 0.79 / +1.4%
clickbench_q39/duckdb:parquet 53555562 / 53454965 / +0.2% 60641058 / 60267957 / +0.6% 0.88 / 0.89 / -0.4%
clickbench_q40/duckdb:parquet 14600231 / 14620130 / -0.1% 19751804 / 20417625 / -3.3% 0.74 / 0.72 / +3.2%
clickbench_q41/duckdb:parquet 16103506 / 15522580 / +3.7% 20459729 / 20561068 / -0.5% 0.79 / 0.75 / +4.3%
clickbench_q42/duckdb:parquet 14223422 / 14508395 / -2.0% 20478255 / 21329381 / -4.0% 0.69 / 0.68 / +2.1%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark FineWeb NVMe (pr) failed! Check the workflow run for details.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant