Skip to content

Push DataFusion dynamic filters into V2 scans - #11073

Closed
joseph-isaacs wants to merge 5 commits into
developfrom
ji/clickbench-q23
Closed

joseph-isaacs wants to merge 5 commits into
developfrom
ji/clickbench-q23

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Oct 31, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Five independent commits:

  1. Give each inline V2 scan root its own IO session. Inline roots shared one session, which was cleared when the first root finished, stalling the rest.
  2. Push DataFusion dynamic filters into persistent V2 scans. Gated on scan_v2, so V1 keeps develop's plans.
  3. Keep the conjuncts of a dynamic filter that convert. An unconvertible hash_lookup used to turn the whole filter into true.
  4. Merge the key bounds of a dynamic filter into a between. key >= min AND key <= max decoded the key column once per comparison; the scan's between rewrite only ran on static filters. TPC-DS SF10, 10 join queries against commit 3: geomean 0.972, Q69 and Q10 0.93.
  5. Skip dynamic zone pruning before scans of one filtered chunk. A profile of TPC-DS SF1 Q69 showed the SF1 cost below comes from the zone pruning pass that a dynamic filter adds before each scan's first chunk: with the filter forced to true, Q69 was still 5.4ms slower than develop. Skipping that pass everywhere made Q82 and Q37 at SF10 3.4–3.7× slower, so it is skipped only for scans of at most one filtered chunk (128K rows). All 99 TPC-DS queries against commit 4: SF1 geomean 0.97; SF10 0.99 on best runs and 1.01 on medians, and the SF10 outliers were flat when rerun with 54 runs each.

Each commit was checked alone with fmt, clippy and vortex-datafusion and vortex-layout tests. Other candidates were measured and dropped: skipping dynamic zone pruning for every scan (Q82 and Q37 3.4–3.7× slower), reusing zone results that another partition of the file already proved (no change), and, with no benefit, a per-generation conversion cache, dropping IN lists (it slowed TPC-DS SF10 by 1.058×) and skipping advisory filters that keep at least 90% of rows.

Local results

These tables cover commits 1–3; commits 4 and 5 were measured against the commit before each, as listed above.

Develop vs this branch, DataFusion, --scan-v2 true, -C target-cpu=native. Each query ran in A-B-B-A order (fastest of the runs), with warm using 4 iterations and dropping the first.

Suite Warm geomean Warm total Cold geomean Cold total
TPC-H SF10 0.993 3.1s → 3.1s 1.040 71.9s → 72.3s
TPC-H SF20 1.024 10.0s → 9.2s 1.027 149.7s → 150.4s
TPC-DS SF10 0.785 33.2s → 16.3s 0.671 (10 queries) 9.9s → 7.8s
TPC-DS SF20 0.740 42.7s → 29.8s 0.965 (10 queries) 16.3s → 16.2s

Best warm results: TPC-DS Q72 at SF10 18.9s → 5.3s, Q25 at SF20 364ms → 98ms, Q7 at SF20 621ms → 178ms.

The host was shared with another benchmark job, so per-query numbers are noisy. TPC-H SF20 Q16, Q9 and Q12 show about 2× in this run, but develop and this branch both have fast and slow rounds at that scale, and interleaved repeats of Q16 and Q9 were flat.

Known regression at SF1

CI runs TPC-H, TPC-DS, ClickBench and FineWeb on V2 through bench-orchestrator. On commit 58a4d05 it reports DataFusion on Vortex as:

Suite Impact against Parquet control
TPC-DS SF1 +10.1%
TPC-H SF1 +4.7%
TPC-H SF10 +0.1%
ClickBench -3.7%
FineWeb +3.0%

On commit bb6955d, with commits 4 and 5, it reports TPC-DS SF1 +9.6%, TPC-H SF1 +5.4%, TPC-H SF10 +2.0%, ClickBench -4.0% and FineWeb +0.8%, so the local SF1 recovery from commits 4 and 5 does not show in CI.

CI's verdict for each is "No clear signal". The TPC-DS SF1 slowdown reproduces locally (Q10 and Q69 about 1.3×, most others about 1.1×, 1–8ms each). TPC-DS Q72 and Q18 still improve in CI. It comes from the pushdown commit. Most of it is the zone pruning pass a dynamic filter adds before each scan: Q69 runs about 114 scans, each waiting around 0.5ms for that pass before its first chunk. Commits 4 and 5 recover part of it: locally, SF1 Q69 went from 30.4ms to about 28.9ms, against 23.4ms on develop. V1 is flat against develop on 8 TPC-DS SF10 queries.

The trade-off is a remaining cost on very small TPC-DS scans for a gain of 20–25% at SF10 and SF20.

Checks

  • Each commit alone: pinned-nightly fmt, clippy with -D warnings, and cargo nextest run -p vortex-datafusion -p vortex-layout (commit 4: vortex-datafusion only). The new tests in commits 4 and 5 were checked to fail without their change.
  • Commit 3: 1677 tests passed, 14 skipped, adding -p vortex-sqllogictest. Commit 5: 1529 tests passed in vortex-layout and vortex-datafusion; SQL logic tests were not rerun locally. The skipped ones run in CI, which is green.
  • Not run locally: vortex-array tests, doctests. No check compares query results between binaries locally; the bench runs here only checked exit status.

🤖 Generated with Claude Code

https://claude.ai/code/session_01MZ3d6HFyGGeUGy8brEr6BM

@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 31, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 31, 2026
@joseph-isaacs joseph-isaacs added the changelog/performance A performance improvement label Oct 31, 2026
@github-actions

github-actions Bot commented Oct 31, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done bb6955d clickbench-nvme 1 Explore Profiling Data
🟢 Done bb6955d fineweb 1 Explore Profiling Data
🟢 Done bb6955d polarsignals 1 Explore Profiling Data
🟢 Done bb6955d tpch-nvme-10 1 Explore Profiling Data
🟢 Done bb6955d tpch-s3 1 Explore Profiling Data
🟢 Done bb6955d tpch-nvme 1 Explore Profiling Data
🟢 Done bb6955d tpcds-nvme 1 Explore Profiling Data
Previous Runs (21)
Status Commit Job Attempt Link
🟢 Done 58a4d05 fineweb 1 Explore Profiling Data
🟢 Done 58a4d05 clickbench-nvme 1 Explore Profiling Data
🟢 Done 58a4d05 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 58a4d05 polarsignals 1 Explore Profiling Data
🟢 Done 58a4d05 tpch-s3 1 Explore Profiling Data
🟢 Done 58a4d05 tpch-nvme 1 Explore Profiling Data
🟢 Done 58a4d05 tpcds-nvme 1 Explore Profiling Data
🟢 Done 7a59376 fineweb 1 Explore Profiling Data
🟢 Done 7a59376 clickbench-nvme 1 Explore Profiling Data
🟢 Done 7a59376 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 7a59376 polarsignals 1 Explore Profiling Data
🟢 Done 7a59376 tpch-s3 1 Explore Profiling Data
🟢 Done 7a59376 tpch-nvme 1 Explore Profiling Data
🟢 Done 7a59376 tpcds-nvme 1 Explore Profiling Data
🟢 Done 0851478 fineweb 1 Explore Profiling Data
🟢 Done 0851478 clickbench-nvme 1 Explore Profiling Data
🟢 Done 0851478 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 0851478 polarsignals 1 Explore Profiling Data
🟢 Done 0851478 tpch-s3 1 Explore Profiling Data
🟢 Done 0851478 tpch-nvme 1 Explore Profiling Data
🟢 Done 0851478 tpcds-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Oct 31, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR bb6955d4 vs base 96fc43df
Vortex (geomean): hot 1.006x ➖ · cold 1.037x ➖


datafusion / vortex-file-compressed / ns (1.006x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44157844 / 44001052 / +0.4% 86736316 / 85111513 / +1.9% 0.51 / 0.52 / -1.5%
polarsignals_q01/datafusion:vortex-file-compressed 53579307 / 53591562 / -0.0% 110851721 / 109381684 / +1.3% 0.48 / 0.49 / -1.3%
polarsignals_q02/datafusion:vortex-file-compressed 14106750 / 11921462 / +18.3% 🔴 49272866 / 44885355 / +9.8% 0.29 / 0.27 / +7.8%
polarsignals_q03/datafusion:vortex-file-compressed 54920603 / 55548056 / -1.1% 141868389 / 112636309 / +26.0% 🔴 0.39 / 0.49 / -21.5%
polarsignals_q04/datafusion:vortex-file-compressed 9195575 / 9164778 / +0.3% 40371352 / 40385467 / -0.0% 0.23 / 0.23 / +0.4%
polarsignals_q05/datafusion:vortex-file-compressed 11641342 / 11657393 / -0.1% 43973042 / 44232651 / -0.6% 0.26 / 0.26 / +0.5%
polarsignals_q06/datafusion:vortex-file-compressed 22842028 / 23562966 / -3.1% 54680813 / 54557204 / +0.2% 0.42 / 0.43 / -3.3%
polarsignals_q07/datafusion:vortex-file-compressed 11165428 / 11099516 / +0.6% 42671773 / 44048540 / -3.1% 0.26 / 0.25 / +3.8%
polarsignals_q08/datafusion:vortex-file-compressed 97886771 / 110671472 / -11.6% 🟢 167772461 / 157038077 / +6.8% 0.58 / 0.70 / -17.2%
polarsignals_q09/datafusion:vortex-file-compressed 10348230 / 9898654 / +4.5% 39881765 / 40859550 / -2.4% 0.26 / 0.24 / +7.1%

@github-actions

github-actions Bot commented Oct 31, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR bb6955d4 vs base 96fc43df
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.1%
Engines: DataFusion No clear signal (+0.8%, low confidence) · DuckDB No clear signal (+1.4%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 0.971x ➖
Parquet (geomean): hot 0.989x ➖ · cold 0.973x ➖
Shifts: Parquet (control) -1.1% · Median polish -0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6059374 / 5919958 / +2.4% 19892423 / 20536319 / -3.1% 0.30 / 0.29 / +5.7%
fineweb_q01/datafusion:vortex-file-compressed 9288172 / 9187944 / +1.1% 39962491 / 38488595 / +3.8% 0.23 / 0.24 / -2.6%
fineweb_q02/datafusion:vortex-file-compressed 11539682 / 11409537 / +1.1% 39637362 / 41296434 / -4.0% 0.29 / 0.28 / +5.4%
fineweb_q03/datafusion:vortex-file-compressed 17768342 / 17724301 / +0.2% 100489752 / 101373273 / -0.9% 0.18 / 0.17 / +1.1%
fineweb_q04/datafusion:vortex-file-compressed 64596919 / 64084496 / +0.8% 144078418 / 144713465 / -0.4% 0.45 / 0.44 / +1.2%
fineweb_q05/datafusion:vortex-file-compressed 62487193 / 63386804 / -1.4% 132337132 / 133594505 / -0.9% 0.47 / 0.47 / -0.5%
fineweb_q06/datafusion:vortex-file-compressed 17364418 / 17645638 / -1.6% 98538958 / 103031092 / -4.4% 0.18 / 0.17 / +2.9%
fineweb_q07/datafusion:vortex-file-compressed 17912013 / 19048062 / -6.0% 98846448 / 100378773 / -1.5% 0.18 / 0.19 / -4.5%
fineweb_q08/datafusion:vortex-file-compressed 8444990 / 8346410 / +1.2% 26425778 / 28737100 / -8.0% 0.32 / 0.29 / +10.0%
datafusion / parquet / ns (0.989x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9453070 / 9437054 / +0.2% 32455555 / 34257812 / -5.3% 0.29 / 0.28 / +5.7%
fineweb_q01/datafusion:parquet 73918122 / 76584880 / -3.5% 139263493 / 149349662 / -6.8% 0.53 / 0.51 / +3.5%
fineweb_q02/datafusion:parquet 73327520 / 75314207 / -2.6% 149612528 / 145012334 / +3.2% 0.49 / 0.52 / -5.6%
fineweb_q03/datafusion:parquet 73351664 / 74882054 / -2.0% 141575813 / 142590674 / -0.7% 0.52 / 0.53 / -1.3%
fineweb_q04/datafusion:parquet 83363762 / 82449304 / +1.1% 142530422 / 146572528 / -2.8% 0.58 / 0.56 / +4.0%
fineweb_q05/datafusion:parquet 80619785 / 81513662 / -1.1% 143590458 / 144520610 / -0.6% 0.56 / 0.56 / -0.5%
fineweb_q06/datafusion:parquet 74700546 / 75773256 / -1.4% 145473871 / 148765603 / -2.2% 0.51 / 0.51 / +0.8%
fineweb_q07/datafusion:parquet 73215727 / 73181420 / +0.0% 145035754 / 148022485 / -2.0% 0.50 / 0.49 / +2.1%
fineweb_q08/datafusion:parquet 72471010 / 72628087 / -0.2% 141857218 / 152778303 / -7.1% 0.51 / 0.48 / +7.5%
duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2078283 / 2067744 / +0.5% 7008834 / 8418561 / -16.7% 🟢 0.30 / 0.25 / +20.7%
fineweb_q01/duckdb:vortex-file-compressed 7921863 / 7475359 / +6.0% 25478335 / 27384748 / -7.0% 0.31 / 0.27 / +13.9%
fineweb_q02/duckdb:vortex-file-compressed 8977720 / 9324524 / -3.7% 28000712 / 27766743 / +0.8% 0.32 / 0.34 / -4.5%
fineweb_q03/duckdb:vortex-file-compressed 19341432 / 19342686 / -0.0% 87871983 / 88351078 / -0.5% 0.22 / 0.22 / +0.5%
fineweb_q04/duckdb:vortex-file-compressed 66214806 / 65153558 / +1.6% 102300237 / 103851681 / -1.5% 0.65 / 0.63 / +3.2%
fineweb_q05/duckdb:vortex-file-compressed 65071464 / 64939604 / +0.2% 101422357 / 101649204 / -0.2% 0.64 / 0.64 / +0.4%
fineweb_q06/duckdb:vortex-file-compressed 18458378 / 18342781 / +0.6% 87325261 / 88532376 / -1.4% 0.21 / 0.21 / +2.0%
fineweb_q07/duckdb:vortex-file-compressed 17522144 / 18117274 / -3.3% 88317173 / 88096489 / +0.3% 0.20 / 0.21 / -3.5%
fineweb_q08/duckdb:vortex-file-compressed 4681508 / 4648239 / +0.7% 12849215 / 13506896 / -4.9% 0.36 / 0.34 / +5.9%
duckdb / parquet / ns (0.989x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23724769 / 23007775 / +3.1% 28616951 / 27273023 / +4.9% 0.83 / 0.84 / -1.7%
fineweb_q01/duckdb:parquet 54975882 / 55750825 / -1.4% 72919149 / 75727478 / -3.7% 0.75 / 0.74 / +2.4%
fineweb_q02/duckdb:parquet 59084488 / 59532475 / -0.8% 75297474 / 79236525 / -5.0% 0.78 / 0.75 / +4.4%
fineweb_q03/duckdb:parquet 118222831 / 120522414 / -1.9% 172520165 / 179617173 / -4.0% 0.69 / 0.67 / +2.1%
fineweb_q04/duckdb:parquet 162148130 / 164655213 / -1.5% 201419583 / 208280364 / -3.3% 0.81 / 0.79 / +1.8%
fineweb_q05/duckdb:parquet 157790752 / 161266610 / -2.2% 204338387 / 197645838 / +3.4% 0.77 / 0.82 / -5.4%
fineweb_q06/duckdb:parquet 85850589 / 89050760 / -3.6% 142386233 / 149049872 / -4.5% 0.60 / 0.60 / +0.9%
fineweb_q07/duckdb:parquet 90701190 / 92412954 / -1.9% 138858417 / 145598242 / -4.6% 0.65 / 0.63 / +2.9%
fineweb_q08/duckdb:parquet 28885038 / 28812554 / +0.3% 30604432 / 32542100 / -6.0% 0.94 / 0.89 / +6.6%

@github-actions

github-actions Bot commented Oct 31, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR bb6955d4 vs base 96fc43df
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.9%
Engines: DataFusion No clear signal (+5.4%, low confidence) · DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): hot 1.015x ➖ · cold 0.959x ➖
Parquet (geomean): hot 0.986x ➖ · cold 0.969x ➖
Shifts: Parquet (control) -1.4% · Median polish -0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.034x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16050269 / 15391271 / +4.3% 42362659 / 45411151 / -6.7% 0.38 / 0.34 / +11.8%
tpch_q02/datafusion:vortex-file-compressed 18272486 / 16622323 / +9.9% 39025135 / 38118770 / +2.4% 0.47 / 0.44 / +7.4%
tpch_q03/datafusion:vortex-file-compressed 20141017 / 19696000 / +2.3% 46312219 / 49408224 / -6.3% 0.43 / 0.40 / +9.1%
tpch_q04/datafusion:vortex-file-compressed 11344459 / 10705503 / +6.0% 35040092 / 36395589 / -3.7% 0.32 / 0.29 / +10.1%
tpch_q05/datafusion:vortex-file-compressed 38237604 / 36860675 / +3.7% 67305498 / 68807075 / -2.2% 0.57 / 0.54 / +6.0%
tpch_q06/datafusion:vortex-file-compressed 5986562 / 6090546 / -1.7% 26455914 / 34379441 / -23.0% 🟢 0.23 / 0.18 / +27.7%
tpch_q07/datafusion:vortex-file-compressed 53593204 / 50999474 / +5.1% 77082359 / 74131457 / +4.0% 0.70 / 0.69 / +1.1%
tpch_q08/datafusion:vortex-file-compressed 51770904 / 51736153 / +0.1% 83408491 / 84488369 / -1.3% 0.62 / 0.61 / +1.4%
tpch_q09/datafusion:vortex-file-compressed 48821508 / 47364729 / +3.1% 75311963 / 78061742 / -3.5% 0.65 / 0.61 / +6.8%
tpch_q10/datafusion:vortex-file-compressed 18895286 / 17088231 / +10.6% 🔴 48538007 / 55764969 / -13.0% 🟢 0.39 / 0.31 / +27.0%
tpch_q11/datafusion:vortex-file-compressed 14850670 / 14348602 / +3.5% 35497987 / 35837085 / -0.9% 0.42 / 0.40 / +4.5%
tpch_q12/datafusion:vortex-file-compressed 19146607 / 18200620 / +5.2% 44229970 / 47080830 / -6.1% 0.43 / 0.39 / +12.0%
tpch_q13/datafusion:vortex-file-compressed 19506331 / 18925906 / +3.1% 42261841 / 44601170 / -5.2% 0.46 / 0.42 / +8.8%
tpch_q14/datafusion:vortex-file-compressed 14835357 / 14619348 / +1.5% 38210772 / 41063755 / -6.9% 0.39 / 0.36 / +9.1%
tpch_q15/datafusion:vortex-file-compressed 19178253 / 18370336 / +4.4% 43703780 / 45697920 / -4.4% 0.44 / 0.40 / +9.2%
tpch_q16/datafusion:vortex-file-compressed 18409101 / 18447649 / -0.2% 39580206 / 42437868 / -6.7% 0.47 / 0.43 / +7.0%
tpch_q17/datafusion:vortex-file-compressed 29130554 / 27990724 / +4.1% 58362302 / 61272930 / -4.8% 0.50 / 0.46 / +9.3%
tpch_q18/datafusion:vortex-file-compressed 36553285 / 35746756 / +2.3% 61239010 / 61535176 / -0.5% 0.60 / 0.58 / +2.8%
tpch_q19/datafusion:vortex-file-compressed 12913743 / 12037508 / +7.3% 38398026 / 38890160 / -1.3% 0.34 / 0.31 / +8.7%
tpch_q20/datafusion:vortex-file-compressed 21036611 / 20007138 / +5.1% 48558188 / 46296863 / +4.9% 0.43 / 0.43 / +0.2%
tpch_q21/datafusion:vortex-file-compressed 36956856 / 38853754 / -4.9% 64822407 / 71736033 / -9.6% 0.57 / 0.54 / +5.3%
tpch_q22/datafusion:vortex-file-compressed 10896367 / 10716247 / +1.7% 31032309 / 34223151 / -9.3% 0.35 / 0.31 / +12.1%
datafusion / parquet / ns (0.981x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71558100 / 72009631 / -0.6% 87551993 / 93849234 / -6.7% 0.82 / 0.77 / +6.5%
tpch_q02/datafusion:parquet 75687199 / 76149116 / -0.6% 92499531 / 93010482 / -0.5% 0.82 / 0.82 / -0.1%
tpch_q03/datafusion:parquet 81771605 / 83369089 / -1.9% 103166964 / 103646765 / -0.5% 0.79 / 0.80 / -1.5%
tpch_q04/datafusion:parquet 39282887 / 40908795 / -4.0% 59025470 / 63524541 / -7.1% 0.67 / 0.64 / +3.3%
tpch_q05/datafusion:parquet 110258264 / 112741527 / -2.2% 134980462 / 141061624 / -4.3% 0.82 / 0.80 / +2.2%
tpch_q06/datafusion:parquet 31364636 / 32295757 / -2.9% 49742193 / 52055337 / -4.4% 0.63 / 0.62 / +1.6%
tpch_q07/datafusion:parquet 112721661 / 115191379 / -2.1% 139322052 / 144074398 / -3.3% 0.81 / 0.80 / +1.2%
tpch_q08/datafusion:parquet 116756590 / 120470183 / -3.1% 142229765 / 149668734 / -5.0% 0.82 / 0.80 / +2.0%
tpch_q09/datafusion:parquet 136526337 / 140326006 / -2.7% 165960906 / 171357263 / -3.1% 0.82 / 0.82 / +0.5%
tpch_q10/datafusion:parquet 104251595 / 107064653 / -2.6% 125705793 / 134854529 / -6.8% 0.83 / 0.79 / +4.5%
tpch_q11/datafusion:parquet 61704791 / 61546181 / +0.3% 80787626 / 83311287 / -3.0% 0.76 / 0.74 / +3.4%
tpch_q12/datafusion:parquet 63664605 / 65355248 / -2.6% 84706720 / 89993363 / -5.9% 0.75 / 0.73 / +3.5%
tpch_q13/datafusion:parquet 143433701 / 147796539 / -3.0% 162208056 / 168525121 / -3.7% 0.88 / 0.88 / +0.8%
tpch_q14/datafusion:parquet 47766797 / 47978585 / -0.4% 71194140 / 72134612 / -1.3% 0.67 / 0.67 / +0.9%
tpch_q15/datafusion:parquet 73503981 / 75428675 / -2.6% 91163495 / 100108019 / -8.9% 0.81 / 0.75 / +7.0%
tpch_q16/datafusion:parquet 43733892 / 44081655 / -0.8% 60426361 / 62424229 / -3.2% 0.72 / 0.71 / +2.5%
tpch_q17/datafusion:parquet 124700680 / 123975355 / +0.6% 145384098 / 148029739 / -1.8% 0.86 / 0.84 / +2.4%
tpch_q18/datafusion:parquet 121149399 / 124051669 / -2.3% 139454417 / 147903921 / -5.7% 0.87 / 0.84 / +3.6%
tpch_q19/datafusion:parquet 56822420 / 58071165 / -2.2% 81068153 / 84997172 / -4.6% 0.70 / 0.68 / +2.6%
tpch_q20/datafusion:parquet 78398465 / 78956069 / -0.7% 98985989 / 107049676 / -7.5% 0.79 / 0.74 / +7.4%
tpch_q21/datafusion:parquet 112742214 / 117135931 / -3.8% 138462786 / 141956982 / -2.5% 0.81 / 0.83 / -1.3%
tpch_q22/datafusion:parquet 52094426 / 52721073 / -1.2% 69590984 / 73905067 / -5.8% 0.75 / 0.71 / +4.9%
duckdb / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 8711279 / 9498360 / -8.3% 19005678 / 22371444 / -15.0% 🟢 0.46 / 0.42 / +8.0%
tpch_q02/duckdb:vortex-file-compressed 15183900 / 15095876 / +0.6% 25483956 / 25214806 / +1.1% 0.60 / 0.60 / -0.5%
tpch_q03/duckdb:vortex-file-compressed 18718811 / 19148839 / -2.2% 34324198 / 34931920 / -1.7% 0.55 / 0.55 / -0.5%
tpch_q04/duckdb:vortex-file-compressed 12529954 / 12382786 / +1.2% 25162910 / 27549345 / -8.7% 0.50 / 0.45 / +10.8%
tpch_q05/duckdb:vortex-file-compressed 20048678 / 20586790 / -2.6% 36865344 / 35500498 / +3.8% 0.54 / 0.58 / -6.2%
tpch_q06/duckdb:vortex-file-compressed 4769553 / 4863507 / -1.9% 13699617 / 14446244 / -5.2% 0.35 / 0.34 / +3.4%
tpch_q07/duckdb:vortex-file-compressed 24190406 / 24419103 / -0.9% 40030502 / 40770673 / -1.8% 0.60 / 0.60 / +0.9%
tpch_q08/duckdb:vortex-file-compressed 21517281 / 20809615 / +3.4% 36933139 / 38906067 / -5.1% 0.58 / 0.53 / +8.9%
tpch_q09/duckdb:vortex-file-compressed 23070927 / 22179697 / +4.0% 38014627 / 38932912 / -2.4% 0.61 / 0.57 / +6.5%
tpch_q10/duckdb:vortex-file-compressed 22706787 / 22833889 / -0.6% 38436430 / 38911162 / -1.2% 0.59 / 0.59 / +0.7%
tpch_q11/duckdb:vortex-file-compressed 8160645 / 8197576 / -0.5% 17072595 / 17520456 / -2.6% 0.48 / 0.47 / +2.2%
tpch_q12/duckdb:vortex-file-compressed 14610706 / 14514062 / +0.7% 25916099 / 26958906 / -3.9% 0.56 / 0.54 / +4.7%
tpch_q13/duckdb:vortex-file-compressed 20078248 / 19747908 / +1.7% 32754612 / 32150548 / +1.9% 0.61 / 0.61 / -0.2%
tpch_q14/duckdb:vortex-file-compressed 11466801 / 11687862 / -1.9% 24033274 / 24307229 / -1.1% 0.48 / 0.48 / -0.8%
tpch_q15/duckdb:vortex-file-compressed 8666841 / 8693955 / -0.3% 20723066 / 21048594 / -1.5% 0.42 / 0.41 / +1.3%
tpch_q16/duckdb:vortex-file-compressed 16655046 / 16845694 / -1.1% 23137632 / 23554665 / -1.8% 0.72 / 0.72 / +0.7%
tpch_q17/duckdb:vortex-file-compressed 12638794 / 12663578 / -0.2% 26532897 / 27602357 / -3.9% 0.48 / 0.46 / +3.8%
tpch_q18/duckdb:vortex-file-compressed 24372093 / 23907920 / +1.9% 34011093 / 35194070 / -3.4% 0.72 / 0.68 / +5.5%
tpch_q19/duckdb:vortex-file-compressed 11922983 / 12162312 / -2.0% 24895478 / 25696312 / -3.1% 0.48 / 0.47 / +1.2%
tpch_q20/duckdb:vortex-file-compressed 14424262 / 14158297 / +1.9% 30117220 / 31857474 / -5.5% 0.48 / 0.44 / +7.8%
tpch_q21/duckdb:vortex-file-compressed 37483659 / 37492223 / -0.0% 56041044 / 57587772 / -2.7% 0.67 / 0.65 / +2.7%
tpch_q22/duckdb:vortex-file-compressed 16791880 / 17134347 / -2.0% 26468005 / 27759731 / -4.7% 0.63 / 0.62 / +2.8%
duckdb / parquet / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47669267 / 48437051 / -1.6% 54149093 / 55277223 / -2.0% 0.88 / 0.88 / +0.5%
tpch_q02/duckdb:parquet 48360232 / 48857833 / -1.0% 55478211 / 56120984 / -1.1% 0.87 / 0.87 / +0.1%
tpch_q03/duckdb:parquet 60663974 / 60946920 / -0.5% 68077414 / 69398054 / -1.9% 0.89 / 0.88 / +1.5%
tpch_q04/duckdb:parquet 34821044 / 35404146 / -1.6% 42502700 / 43492895 / -2.3% 0.82 / 0.81 / +0.6%
tpch_q05/duckdb:parquet 67128752 / 67916987 / -1.2% 76864327 / 78411929 / -2.0% 0.87 / 0.87 / +0.8%
tpch_q06/duckdb:parquet 21762489 / 22099336 / -1.5% 27043930 / 27689859 / -2.3% 0.80 / 0.80 / +0.8%
tpch_q07/duckdb:parquet 63986898 / 64717406 / -1.1% 72889868 / 74446646 / -2.1% 0.88 / 0.87 / +1.0%
tpch_q08/duckdb:parquet 75794429 / 76574363 / -1.0% 86356794 / 87680697 / -1.5% 0.88 / 0.87 / +0.5%
tpch_q09/duckdb:parquet 108136191 / 108933883 / -0.7% 119079738 / 121414200 / -1.9% 0.91 / 0.90 / +1.2%
tpch_q10/duckdb:parquet 106198199 / 107159819 / -0.9% 116603625 / 120298529 / -3.1% 0.91 / 0.89 / +2.2%
tpch_q11/duckdb:parquet 29423618 / 29761277 / -1.1% 34612150 / 35365549 / -2.1% 0.85 / 0.84 / +1.0%
tpch_q12/duckdb:parquet 37113703 / 38153378 / -2.7% 43631667 / 45615128 / -4.3% 0.85 / 0.84 / +1.7%
tpch_q13/duckdb:parquet 175060619 / 175182638 / -0.1% 182244158 / 183509414 / -0.7% 0.96 / 0.95 / +0.6%
tpch_q14/duckdb:parquet 42407019 / 43016217 / -1.4% 50867303 / 51356693 / -1.0% 0.83 / 0.84 / -0.5%
tpch_q15/duckdb:parquet 32540494 / 32822165 / -0.9% 41246980 / 41575470 / -0.8% 0.79 / 0.79 / -0.1%
tpch_q16/duckdb:parquet 47527384 / 48077132 / -1.1% 53638983 / 53435736 / +0.4% 0.89 / 0.90 / -1.5%
tpch_q17/duckdb:parquet 47983536 / 48329420 / -0.7% 57512834 / 57966955 / -0.8% 0.83 / 0.83 / +0.1%
tpch_q18/duckdb:parquet 74402352 / 74859344 / -0.6% 80228757 / 81681857 / -1.8% 0.93 / 0.92 / +1.2%
tpch_q19/duckdb:parquet 49063665 / 48356983 / +1.5% 54714650 / 56018866 / -2.3% 0.90 / 0.86 / +3.9%
tpch_q20/duckdb:parquet 63732083 / 63977380 / -0.4% 73460313 / 74583287 / -1.5% 0.87 / 0.86 / +1.1%
tpch_q21/duckdb:parquet 106943130 / 107572659 / -0.6% 114867576 / 117429944 / -2.2% 0.93 / 0.92 / +1.6%
tpch_q22/duckdb:parquet 50531329 / 51327832 / -1.6% 58271843 / 60045612 / -3.0% 0.87 / 0.85 / +1.4%

@github-actions

github-actions Bot commented Oct 31, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR bb6955d4 vs base 96fc43df
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.4%
Engines: DataFusion No clear signal (+2.0%, low confidence) · DuckDB No clear signal (+0.9%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.014x ➖
Parquet (geomean): hot 0.986x ➖ · cold 0.998x ➖
Shifts: Parquet (control) -1.4% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 93271835 / 90058063 / +3.6% 155588531 / 158570950 / -1.9% 0.60 / 0.57 / +5.6%
tpch_q02/datafusion:vortex-file-compressed 64456273 / 65003859 / -0.8% 97549955 / 94866905 / +2.8% 0.66 / 0.69 / -3.6%
tpch_q03/datafusion:vortex-file-compressed 63699426 / 63468921 / +0.4% 121798521 / 114999255 / +5.9% 0.52 / 0.55 / -5.2%
tpch_q04/datafusion:vortex-file-compressed 34963371 / 34125108 / +2.5% 72133931 / 71497135 / +0.9% 0.48 / 0.48 / +1.6%
tpch_q05/datafusion:vortex-file-compressed 119976626 / 117952358 / +1.7% 192447996 / 177643591 / +8.3% 0.62 / 0.66 / -6.1%
tpch_q06/datafusion:vortex-file-compressed 10242628 / 10447536 / -2.0% 62327135 / 57553656 / +8.3% 0.16 / 0.18 / -9.5%
tpch_q07/datafusion:vortex-file-compressed 99595444 / 134223632 / -25.8% 🟢 168631012 / 204147978 / -17.4% 🟢 0.59 / 0.66 / -10.2%
tpch_q08/datafusion:vortex-file-compressed 143902895 / 143516428 / +0.3% 231871954 / 203561257 / +13.9% 🔴 0.62 / 0.71 / -12.0%
tpch_q09/datafusion:vortex-file-compressed 184747820 / 184050686 / +0.4% 270469380 / 262570706 / +3.0% 0.68 / 0.70 / -2.6%
tpch_q10/datafusion:vortex-file-compressed 72282303 / 70249640 / +2.9% 138512451 / 136992208 / +1.1% 0.52 / 0.51 / +1.8%
tpch_q11/datafusion:vortex-file-compressed 45630640 / 43473503 / +5.0% 74393301 / 68063122 / +9.3% 0.61 / 0.64 / -4.0%
tpch_q12/datafusion:vortex-file-compressed 35863463 / 35135774 / +2.1% 85263447 / 81318780 / +4.9% 0.42 / 0.43 / -2.7%
tpch_q13/datafusion:vortex-file-compressed 48671076 / 47481713 / +2.5% 85577112 / 81365990 / +5.2% 0.57 / 0.58 / -2.5%
tpch_q14/datafusion:vortex-file-compressed 21521373 / 21279265 / +1.1% 86431052 / 89066560 / -3.0% 0.25 / 0.24 / +4.2%
tpch_q15/datafusion:vortex-file-compressed 34662643 / 33844583 / +2.4% 95079247 / 89974858 / +5.7% 0.36 / 0.38 / -3.1%
tpch_q16/datafusion:vortex-file-compressed 37309589 / 37255046 / +0.1% 66227301 / 64809843 / +2.2% 0.56 / 0.57 / -2.0%
tpch_q17/datafusion:vortex-file-compressed 175846633 / 174588840 / +0.7% 230733220 / 241241988 / -4.4% 0.76 / 0.72 / +5.3%
tpch_q18/datafusion:vortex-file-compressed 206923513 / 210790712 / -1.8% 270980795 / 267907942 / +1.1% 0.76 / 0.79 / -2.9%
tpch_q19/datafusion:vortex-file-compressed 30999210 / 30353592 / +2.1% 89856832 / 92497368 / -2.9% 0.34 / 0.33 / +5.1%
tpch_q20/datafusion:vortex-file-compressed 61750215 / 60747427 / +1.7% 124968206 / 117865082 / +6.0% 0.49 / 0.52 / -4.1%
tpch_q21/datafusion:vortex-file-compressed 179961065 / 177559817 / +1.4% 234770623 / 244593081 / -4.0% 0.77 / 0.73 / +5.6%
tpch_q22/datafusion:vortex-file-compressed 25851517 / 25051888 / +3.2% 55562185 / 52901387 / +5.0% 0.47 / 0.47 / -1.7%
datafusion / parquet / ns (0.980x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 88156404 / 88000425 / +0.2% 130713079 / 128501384 / +1.7% 0.67 / 0.68 / -1.5%
tpch_q02/datafusion:parquet 173079930 / 175422404 / -1.3% 198997275 / 202167438 / -1.6% 0.87 / 0.87 / +0.2%
tpch_q03/datafusion:parquet 134472170 / 138212284 / -2.7% 185495660 / 181236968 / +2.3% 0.72 / 0.76 / -4.9%
tpch_q04/datafusion:parquet 56642862 / 58669278 / -3.5% 95155375 / 92142677 / +3.3% 0.60 / 0.64 / -6.5%
tpch_q05/datafusion:parquet 166369752 / 170506768 / -2.4% 225320515 / 220440650 / +2.2% 0.74 / 0.77 / -4.5%
tpch_q06/datafusion:parquet 36289032 / 37365644 / -2.9% 80381155 / 76819863 / +4.6% 0.45 / 0.49 / -7.2%
tpch_q07/datafusion:parquet 214684786 / 219994711 / -2.4% 279281256 / 276821910 / +0.9% 0.77 / 0.79 / -3.3%
tpch_q08/datafusion:parquet 216665980 / 222015106 / -2.4% 290284942 / 290909863 / -0.2% 0.75 / 0.76 / -2.2%
tpch_q09/datafusion:parquet 308733405 / 315198293 / -2.1% 380807174 / 379272412 / +0.4% 0.81 / 0.83 / -2.4%
tpch_q10/datafusion:parquet 311229183 / 322258981 / -3.4% 378110201 / 377823700 / +0.1% 0.82 / 0.85 / -3.5%
tpch_q11/datafusion:parquet 128037690 / 126626026 / +1.1% 152505542 / 151182290 / +0.9% 0.84 / 0.84 / +0.2%
tpch_q12/datafusion:parquet 82128512 / 84291398 / -2.6% 123282014 / 119437060 / +3.2% 0.67 / 0.71 / -5.6%
tpch_q13/datafusion:parquet 210447327 / 216920205 / -3.0% 243754517 / 247701987 / -1.6% 0.86 / 0.88 / -1.4%
tpch_q14/datafusion:parquet 84793897 / 89605008 / -5.4% 193063351 / 180969437 / +6.7% 0.44 / 0.50 / -11.3%
tpch_q15/datafusion:parquet 105100884 / 106279564 / -1.1% 157460317 / 155653968 / +1.2% 0.67 / 0.68 / -2.2%
tpch_q16/datafusion:parquet 95579009 / 97820340 / -2.3% 119678515 / 119676941 / +0.0% 0.80 / 0.82 / -2.3%
tpch_q17/datafusion:parquet 214927951 / 213338729 / +0.7% 260419603 / 265308979 / -1.8% 0.83 / 0.80 / +2.6%
tpch_q18/datafusion:parquet 271607323 / 270921313 / +0.3% 315738857 / 314386873 / +0.4% 0.86 / 0.86 / -0.2%
tpch_q19/datafusion:parquet 108187609 / 109633394 / -1.3% 164119821 / 165632582 / -0.9% 0.66 / 0.66 / -0.4%
tpch_q20/datafusion:parquet 185690562 / 189974030 / -2.3% 246804477 / 249182620 / -1.0% 0.75 / 0.76 / -1.3%
tpch_q21/datafusion:parquet 242142972 / 247251384 / -2.1% 314833313 / 316675375 / -0.6% 0.77 / 0.78 / -1.5%
tpch_q22/datafusion:parquet 149368562 / 153899196 / -2.9% 174889262 / 178168290 / -1.8% 0.85 / 0.86 / -1.1%
duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 34170550 / 34542785 / -1.1% 69705353 / 66794889 / +4.4% 0.49 / 0.52 / -5.2%
tpch_q02/duckdb:vortex-file-compressed 28654514 / 28271022 / +1.4% 44518767 / 43325755 / +2.8% 0.64 / 0.65 / -1.4%
tpch_q03/duckdb:vortex-file-compressed 53043860 / 52617245 / +0.8% 104316532 / 104974817 / -0.6% 0.51 / 0.50 / +1.4%
tpch_q04/duckdb:vortex-file-compressed 51839228 / 52428107 / -1.1% 90746055 / 91484085 / -0.8% 0.57 / 0.57 / -0.3%
tpch_q05/duckdb:vortex-file-compressed 67821938 / 68662450 / -1.2% 113198764 / 113989579 / -0.7% 0.60 / 0.60 / -0.5%
tpch_q06/duckdb:vortex-file-compressed 15967016 / 15830224 / +0.9% 54021270 / 52643110 / +2.6% 0.30 / 0.30 / -1.7%
tpch_q07/duckdb:vortex-file-compressed 56326020 / 56115129 / +0.4% 112778916 / 112036771 / +0.7% 0.50 / 0.50 / -0.3%
tpch_q08/duckdb:vortex-file-compressed 89061216 / 87535228 / +1.7% 138672589 / 133362617 / +4.0% 0.64 / 0.66 / -2.2%
tpch_q09/duckdb:vortex-file-compressed 104267783 / 102561459 / +1.7% 157331568 / 156775239 / +0.4% 0.66 / 0.65 / +1.3%
tpch_q10/duckdb:vortex-file-compressed 96949152 / 95227577 / +1.8% 144825475 / 149586057 / -3.2% 0.67 / 0.64 / +5.2%
tpch_q11/duckdb:vortex-file-compressed 13203236 / 13262909 / -0.4% 29030896 / 28914075 / +0.4% 0.45 / 0.46 / -0.9%
tpch_q12/duckdb:vortex-file-compressed 44853548 / 45261510 / -0.9% 82870907 / 83770021 / -1.1% 0.54 / 0.54 / +0.2%
tpch_q13/duckdb:vortex-file-compressed 71221557 / 72321390 / -1.5% 101766881 / 102227866 / -0.5% 0.70 / 0.71 / -1.1%
tpch_q14/duckdb:vortex-file-compressed 28580005 / 28590252 / -0.0% 73372424 / 75510080 / -2.8% 0.39 / 0.38 / +2.9%
tpch_q15/duckdb:vortex-file-compressed 24717538 / 25129652 / -1.6% 65581115 / 62990828 / +4.1% 0.38 / 0.40 / -5.5%
tpch_q16/duckdb:vortex-file-compressed 49035634 / 49622639 / -1.2% 59138810 / 58371840 / +1.3% 0.83 / 0.85 / -2.5%
tpch_q17/duckdb:vortex-file-compressed 35027759 / 34588606 / +1.3% 69794639 / 66488567 / +5.0% 0.50 / 0.52 / -3.5%
tpch_q18/duckdb:vortex-file-compressed 109414704 / 109326237 / +0.1% 123024152 / 126141263 / -2.5% 0.89 / 0.87 / +2.6%
tpch_q19/duckdb:vortex-file-compressed 27775484 / 27348372 / +1.6% 74945915 / 72294359 / +3.7% 0.37 / 0.38 / -2.0%
tpch_q20/duckdb:vortex-file-compressed 42185721 / 42305551 / -0.3% 96863866 / 93948884 / +3.1% 0.44 / 0.45 / -3.3%
tpch_q21/duckdb:vortex-file-compressed 94620115 / 93261910 / +1.5% 148567562 / 151716829 / -2.1% 0.64 / 0.61 / +3.6%
tpch_q22/duckdb:vortex-file-compressed 32602227 / 33137211 / -1.6% 49515347 / 50101362 / -1.2% 0.66 / 0.66 / -0.5%
duckdb / parquet / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 68004619 / 68788836 / -1.1% 88051928 / 91319616 / -3.6% 0.77 / 0.75 / +2.5%
tpch_q02/duckdb:parquet 86612805 / 87942960 / -1.5% 98201479 / 98771201 / -0.6% 0.88 / 0.89 / -0.9%
tpch_q03/duckdb:parquet 110548060 / 111972229 / -1.3% 144389895 / 144555024 / -0.1% 0.77 / 0.77 / -1.2%
tpch_q04/duckdb:parquet 76213334 / 75952005 / +0.3% 98926423 / 99216232 / -0.3% 0.77 / 0.77 / +0.6%
tpch_q05/duckdb:parquet 122185781 / 122850447 / -0.5% 158544855 / 156961938 / +1.0% 0.77 / 0.78 / -1.5%
tpch_q06/duckdb:parquet 35308243 / 35932776 / -1.7% 59704941 / 61508003 / -2.9% 0.59 / 0.58 / +1.2%
tpch_q07/duckdb:parquet 118604464 / 119681160 / -0.9% 155828644 / 154456488 / +0.9% 0.76 / 0.77 / -1.8%
tpch_q08/duckdb:parquet 147451078 / 148521648 / -0.7% 189718588 / 195547902 / -3.0% 0.78 / 0.76 / +2.3%
tpch_q09/duckdb:parquet 237218902 / 237867541 / -0.3% 280102534 / 274926219 / +1.9% 0.85 / 0.87 / -2.1%
tpch_q10/duckdb:parquet 313994391 / 316253225 / -0.7% 341308982 / 342645169 / -0.4% 0.92 / 0.92 / -0.3%
tpch_q11/duckdb:parquet 43520713 / 43930154 / -0.9% 50271990 / 52028116 / -3.4% 0.87 / 0.84 / +2.5%
tpch_q12/duckdb:parquet 70148846 / 71482508 / -1.9% 90317997 / 93422601 / -3.3% 0.78 / 0.77 / +1.5%
tpch_q13/duckdb:parquet 291995486 / 293836762 / -0.6% 309724518 / 307793761 / +0.6% 0.94 / 0.95 / -1.2%
tpch_q14/duckdb:parquet 100613035 / 102035542 / -1.4% 137325687 / 138553703 / -0.9% 0.73 / 0.74 / -0.5%
tpch_q15/duckdb:parquet 58272602 / 57666192 / +1.1% 84409121 / 85662630 / -1.5% 0.69 / 0.67 / +2.6%
tpch_q16/duckdb:parquet 100043358 / 101507478 / -1.4% 106926926 / 108989008 / -1.9% 0.94 / 0.93 / +0.5%
tpch_q17/duckdb:parquet 82489142 / 81741707 / +0.9% 113226737 / 112407698 / +0.7% 0.73 / 0.73 / +0.2%
tpch_q18/duckdb:parquet 156188529 / 154239537 / +1.3% 173188906 / 178601462 / -3.0% 0.90 / 0.86 / +4.4%
tpch_q19/duckdb:parquet 96840773 / 100272470 / -3.4% 129307359 / 134114465 / -3.6% 0.75 / 0.75 / +0.2%
tpch_q20/duckdb:parquet 146825263 / 148459652 / -1.1% 182486747 / 183880312 / -0.8% 0.80 / 0.81 / -0.3%
tpch_q21/duckdb:parquet 254339238 / 254507596 / -0.1% 271818824 / 276105119 / -1.6% 0.94 / 0.92 / +1.5%
tpch_q22/duckdb:parquet 168506158 / 169814742 / -0.8% 181202684 / 184905996 / -2.0% 0.93 / 0.92 / +1.3%

@github-actions

github-actions Bot commented Oct 31, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR bb6955d4 vs base 96fc43df
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +4.7%
Engines: DataFusion No clear signal (+9.6%, medium confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 1.026x ➖ · cold 1.002x ➖
Parquet (geomean): hot 0.980x ➖ · cold 0.975x ➖
Shifts: Parquet (control) -2.0% · Median polish -2.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.081x ➖, 2↑ 38↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21689914 / 20683143 / +4.9% 41628939 / 39013383 / +6.7% 0.52 / 0.53 / -1.7%
tpcds_q02/datafusion:vortex-file-compressed 42869476 / 45085062 / -4.9% 64424493 / 67293106 / -4.3% 0.67 / 0.67 / -0.7%
tpcds_q03/datafusion:vortex-file-compressed 13110077 / 10941792 / +19.8% 🔴 29214880 / 28678269 / +1.9% 0.45 / 0.38 / +17.6%
tpcds_q04/datafusion:vortex-file-compressed 85026396 / 88052580 / -3.4% 111627956 / 117492407 / -5.0% 0.76 / 0.75 / +1.6%
tpcds_q05/datafusion:vortex-file-compressed 56659824 / 56382126 / +0.5% 77473798 / 78172797 / -0.9% 0.73 / 0.72 / +1.4%
tpcds_q06/datafusion:vortex-file-compressed 23541060 / 22092148 / +6.6% 41112377 / 42110112 / -2.4% 0.57 / 0.52 / +9.1%
tpcds_q07/datafusion:vortex-file-compressed 26428486 / 29060118 / -9.1% 48306248 / 52223527 / -7.5% 0.55 / 0.56 / -1.7%
tpcds_q08/datafusion:vortex-file-compressed 26851923 / 24454874 / +9.8% 47686881 / 43755588 / +9.0% 0.56 / 0.56 / +0.7%
tpcds_q09/datafusion:vortex-file-compressed 21752378 / 22230231 / -2.1% 38860063 / 37091790 / +4.8% 0.56 / 0.60 / -6.6%
tpcds_q10/datafusion:vortex-file-compressed 35428848 / 26622822 / +33.1% 🔴 58752296 / 50741991 / +15.8% 🔴 0.60 / 0.52 / +14.9%
tpcds_q11/datafusion:vortex-file-compressed 51365604 / 53595088 / -4.2% 75237379 / 82908112 / -9.3% 0.68 / 0.65 / +5.6%
tpcds_q12/datafusion:vortex-file-compressed 15585550 / 14888829 / +4.7% 34176051 / 33195665 / +3.0% 0.46 / 0.45 / +1.7%
tpcds_q13/datafusion:vortex-file-compressed 31043426 / 31259483 / -0.7% 58245231 / 59540711 / -2.2% 0.53 / 0.53 / +1.5%
tpcds_q14/datafusion:vortex-file-compressed 492499058 / 488688423 / +0.8% 547473836 / 553480587 / -1.1% 0.90 / 0.88 / +1.9%
tpcds_q15/datafusion:vortex-file-compressed 13029878 / 12503345 / +4.2% 31501560 / 33562126 / -6.1% 0.41 / 0.37 / +11.0%
tpcds_q16/datafusion:vortex-file-compressed 22737752 / 18471232 / +23.1% 🔴 41155214 / 39947921 / +3.0% 0.55 / 0.46 / +19.5%
tpcds_q17/datafusion:vortex-file-compressed 55668841 / 51407858 / +8.3% 74174782 / 68844263 / +7.7% 0.75 / 0.75 / +0.5%
tpcds_q18/datafusion:vortex-file-compressed 46794386 / 63408052 / -26.2% 🟢 71043820 / 88738272 / -19.9% 🟢 0.66 / 0.71 / -7.8%
tpcds_q19/datafusion:vortex-file-compressed 17562411 / 16690370 / +5.2% 44583210 / 39876349 / +11.8% 🔴 0.39 / 0.42 / -5.9%
tpcds_q20/datafusion:vortex-file-compressed 17889286 / 16188218 / +10.5% 🔴 34247730 / 35818488 / -4.4% 0.52 / 0.45 / +15.6%
tpcds_q21/datafusion:vortex-file-compressed 15875935 / 15773125 / +0.7% 36728377 / 40703588 / -9.8% 0.43 / 0.39 / +11.5%
tpcds_q22/datafusion:vortex-file-compressed 49206712 / 49563656 / -0.7% 70046200 / 72796048 / -3.8% 0.70 / 0.68 / +3.2%
tpcds_q23/datafusion:vortex-file-compressed 75601488 / 70115017 / +7.8% 104332797 / 97811635 / +6.7% 0.72 / 0.72 / +1.1%
tpcds_q24/datafusion:vortex-file-compressed 63809972 / 64644736 / -1.3% 86783683 / 88296519 / -1.7% 0.74 / 0.73 / +0.4%
tpcds_q25/datafusion:vortex-file-compressed 45881787 / 44439144 / +3.2% 71940590 / 77747591 / -7.5% 0.64 / 0.57 / +11.6%
tpcds_q26/datafusion:vortex-file-compressed 25898430 / 25965249 / -0.3% 45776976 / 46585107 / -1.7% 0.57 / 0.56 / +1.5%
tpcds_q27/datafusion:vortex-file-compressed 54399550 / 59744084 / -8.9% 73961168 / 83339499 / -11.3% 🟢 0.74 / 0.72 / +2.6%
tpcds_q28/datafusion:vortex-file-compressed 26242701 / 25939030 / +1.2% 43374528 / 41455883 / +4.6% 0.61 / 0.63 / -3.3%
tpcds_q29/datafusion:vortex-file-compressed 52980862 / 51806250 / +2.3% 73877014 / 76806172 / -3.8% 0.72 / 0.67 / +6.3%
tpcds_q30/datafusion:vortex-file-compressed 28006283 / 26302482 / +6.5% 46963067 / 44630787 / +5.2% 0.60 / 0.59 / +1.2%
tpcds_q31/datafusion:vortex-file-compressed 67215345 / 58810070 / +14.3% 🔴 91380794 / 84443994 / +8.2% 0.74 / 0.70 / +5.6%
tpcds_q32/datafusion:vortex-file-compressed 16579079 / 12255136 / +35.3% 🔴 32276252 / 31291968 / +3.1% 0.51 / 0.39 / +31.2%
tpcds_q33/datafusion:vortex-file-compressed 31043428 / 26849830 / +15.6% 🔴 49135025 / 50538618 / -2.8% 0.63 / 0.53 / +18.9%
tpcds_q34/datafusion:vortex-file-compressed 22606570 / 17358376 / +30.2% 🔴 40054535 / 36638006 / +9.3% 0.56 / 0.47 / +19.1%
tpcds_q35/datafusion:vortex-file-compressed 34449466 / 30497086 / +13.0% 🔴 61413795 / 54395612 / +12.9% 🔴 0.56 / 0.56 / +0.1%
tpcds_q36/datafusion:vortex-file-compressed 51225894 / 46815174 / +9.4% 71584641 / 66908457 / +7.0% 0.72 / 0.70 / +2.3%
tpcds_q37/datafusion:vortex-file-compressed 12335750 / 11484544 / +7.4% 35482799 / 34379697 / +3.2% 0.35 / 0.33 / +4.1%
tpcds_q38/datafusion:vortex-file-compressed 32090986 / 25282844 / +26.9% 🔴 52598241 / 47738970 / +10.2% 🔴 0.61 / 0.53 / +15.2%
tpcds_q39/datafusion:vortex-file-compressed 64134302 / 64811760 / -1.0% 84904224 / 89581708 / -5.2% 0.76 / 0.72 / +4.4%
tpcds_q40/datafusion:vortex-file-compressed 25873162 / 22800750 / +13.5% 🔴 44164127 / 42677947 / +3.5% 0.59 / 0.53 / +9.7%
tpcds_q41/datafusion:vortex-file-compressed 20771910 / 20391012 / +1.9% 32869977 / 33347328 / -1.4% 0.63 / 0.61 / +3.3%
tpcds_q42/datafusion:vortex-file-compressed 11886442 / 10883158 / +9.2% 29722415 / 25885805 / +14.8% 🔴 0.40 / 0.42 / -4.9%
tpcds_q43/datafusion:vortex-file-compressed 14301021 / 12419194 / +15.2% 🔴 33164566 / 31670501 / +4.7% 0.43 / 0.39 / +10.0%
tpcds_q44/datafusion:vortex-file-compressed 28842607 / 28994756 / -0.5% 51620348 / 54968256 / -6.1% 0.56 / 0.53 / +5.9%
tpcds_q45/datafusion:vortex-file-compressed 17831304 / 16129006 / +10.6% 🔴 36460436 / 35560425 / +2.5% 0.49 / 0.45 / +7.8%
tpcds_q46/datafusion:vortex-file-compressed 29445465 / 23072054 / +27.6% 🔴 50265579 / 48528953 / +3.6% 0.59 / 0.48 / +23.2%
tpcds_q47/datafusion:vortex-file-compressed 84145970 / 75464950 / +11.5% 🔴 113762602 / 103989093 / +9.4% 0.74 / 0.73 / +1.9%
tpcds_q48/datafusion:vortex-file-compressed 30119954 / 28800920 / +4.6% 53613628 / 52275812 / +2.6% 0.56 / 0.55 / +2.0%
tpcds_q49/datafusion:vortex-file-compressed 58239776 / 57677470 / +1.0% 90275089 / 79042604 / +14.2% 🔴 0.65 / 0.73 / -11.6%
tpcds_q50/datafusion:vortex-file-compressed 31410896 / 30796085 / +2.0% 52983629 / 50848324 / +4.2% 0.59 / 0.61 / -2.1%
tpcds_q51/datafusion:vortex-file-compressed 67588384 / 65558473 / +3.1% 90012893 / 88148807 / +2.1% 0.75 / 0.74 / +1.0%
tpcds_q52/datafusion:vortex-file-compressed 13295433 / 11355178 / +17.1% 🔴 28768768 / 27868441 / +3.2% 0.46 / 0.41 / +13.4%
tpcds_q53/datafusion:vortex-file-compressed 21233925 / 17558272 / +20.9% 🔴 40667183 / 38554832 / +5.5% 0.52 / 0.46 / +14.7%
tpcds_q54/datafusion:vortex-file-compressed 32956339 / 30970064 / +6.4% 55911608 / 54860624 / +1.9% 0.59 / 0.56 / +4.4%
tpcds_q55/datafusion:vortex-file-compressed 12272530 / 10751928 / +14.1% 🔴 30308935 / 26930982 / +12.5% 🔴 0.40 / 0.40 / +1.4%
tpcds_q56/datafusion:vortex-file-compressed 29292028 / 26262624 / +11.5% 🔴 48546316 / 47254270 / +2.7% 0.60 / 0.56 / +8.6%
tpcds_q57/datafusion:vortex-file-compressed 71061912 / 62033222 / +14.6% 🔴 98655523 / 88079825 / +12.0% 🔴 0.72 / 0.70 / +2.3%
tpcds_q58/datafusion:vortex-file-compressed 46943869 / 37834217 / +24.1% 🔴 73438328 / 63677399 / +15.3% 🔴 0.64 / 0.59 / +7.6%
tpcds_q59/datafusion:vortex-file-compressed 31802380 / 29838904 / +6.6% 56668433 / 54045484 / +4.9% 0.56 / 0.55 / +1.6%
tpcds_q60/datafusion:vortex-file-compressed 29469340 / 26051934 / +13.1% 🔴 51957261 / 46243981 / +12.4% 🔴 0.57 / 0.56 / +0.7%
tpcds_q61/datafusion:vortex-file-compressed 23226148 / 21256988 / +9.3% 46886110 / 45068425 / +4.0% 0.50 / 0.47 / +5.0%
tpcds_q62/datafusion:vortex-file-compressed 17054722 / 16346836 / +4.3% 40776890 / 34686255 / +17.6% 🔴 0.42 / 0.47 / -11.3%
tpcds_q63/datafusion:vortex-file-compressed 21277946 / 17696554 / +20.2% 🔴 41971936 / 39310609 / +6.8% 0.51 / 0.45 / +12.6%
tpcds_q64/datafusion:vortex-file-compressed 191013728 / 211706594 / -9.8% 221685637 / 246370551 / -10.0% 🟢 0.86 / 0.86 / +0.3%
tpcds_q65/datafusion:vortex-file-compressed 77552154 / 73200044 / +5.9% 98141473 / 93758080 / +4.7% 0.79 / 0.78 / +1.2%
tpcds_q66/datafusion:vortex-file-compressed 53027595 / 51608626 / +2.7% 72219432 / 74112189 / -2.6% 0.73 / 0.70 / +5.4%
tpcds_q67/datafusion:vortex-file-compressed 54621205 / 50274349 / +8.6% 83692344 / 82453346 / +1.5% 0.65 / 0.61 / +7.0%
tpcds_q68/datafusion:vortex-file-compressed 28966172 / 22749140 / +27.3% 🔴 51761514 / 47336957 / +9.3% 0.56 / 0.48 / +16.4%
tpcds_q69/datafusion:vortex-file-compressed 35639725 / 25719106 / +38.6% 🔴 54627404 / 48786200 / +12.0% 🔴 0.65 / 0.53 / +23.8%
tpcds_q70/datafusion:vortex-file-compressed 75455324 / 71162932 / +6.0% 96262897 / 95326079 / +1.0% 0.78 / 0.75 / +5.0%
tpcds_q71/datafusion:vortex-file-compressed 19665185 / 18624804 / +5.6% 42220614 / 40870443 / +3.3% 0.47 / 0.46 / +2.2%
tpcds_q72/datafusion:vortex-file-compressed 250737560 / 353238400 / -29.0% 🟢 271347696 / 375190732 / -27.7% 🟢 0.92 / 0.94 / -1.9%
tpcds_q73/datafusion:vortex-file-compressed 21612440 / 16060020 / +34.6% 🔴 38994240 / 34837476 / +11.9% 🔴 0.55 / 0.46 / +20.2%
tpcds_q74/datafusion:vortex-file-compressed 42062316 / 40050235 / +5.0% 70780389 / 68450455 / +3.4% 0.59 / 0.59 / +1.6%
tpcds_q75/datafusion:vortex-file-compressed 136287517 / 139366501 / -2.2% 156941858 / 157373149 / -0.3% 0.87 / 0.89 / -1.9%
tpcds_q76/datafusion:vortex-file-compressed 31599312 / 30231762 / +4.5% 50793259 / 49918416 / +1.8% 0.62 / 0.61 / +2.7%
tpcds_q77/datafusion:vortex-file-compressed 45180069 / 44855762 / +0.7% 69388071 / 67140826 / +3.3% 0.65 / 0.67 / -2.5%
tpcds_q78/datafusion:vortex-file-compressed 64620879 / 64347862 / +0.4% 89403331 / 93507838 / -4.4% 0.72 / 0.69 / +5.0%
tpcds_q79/datafusion:vortex-file-compressed 24547678 / 19703220 / +24.6% 🔴 46343417 / 42253109 / +9.7% 0.53 / 0.47 / +13.6%
tpcds_q80/datafusion:vortex-file-compressed 71216992 / 73943947 / -3.7% 100478060 / 100556706 / -0.1% 0.71 / 0.74 / -3.6%
tpcds_q81/datafusion:vortex-file-compressed 27813776 / 26544144 / +4.8% 46848338 / 44952314 / +4.2% 0.59 / 0.59 / +0.5%
tpcds_q82/datafusion:vortex-file-compressed 12219620 / 11839695 / +3.2% 35285689 / 35123818 / +0.5% 0.35 / 0.34 / +2.7%
tpcds_q83/datafusion:vortex-file-compressed 35844076 / 32369272 / +10.7% 🔴 54969275 / 52695284 / +4.3% 0.65 / 0.61 / +6.2%
tpcds_q84/datafusion:vortex-file-compressed 10646816 / 9863110 / +7.9% 28788527 / 25532833 / +12.8% 🔴 0.37 / 0.39 / -4.3%
tpcds_q85/datafusion:vortex-file-compressed 52927314 / 53198513 / -0.5% 80257080 / 80073395 / +0.2% 0.66 / 0.66 / -0.7%
tpcds_q86/datafusion:vortex-file-compressed 18500563 / 16006864 / +15.6% 🔴 35223691 / 35771733 / -1.5% 0.53 / 0.45 / +17.4%
tpcds_q87/datafusion:vortex-file-compressed 29762456 / 25436314 / +17.0% 🔴 53567436 / 48819537 / +9.7% 0.56 / 0.52 / +6.6%
tpcds_q88/datafusion:vortex-file-compressed 37192565 / 31422746 / +18.4% 🔴 57754613 / 51071901 / +13.1% 🔴 0.64 / 0.62 / +4.7%
tpcds_q89/datafusion:vortex-file-compressed 24526164 / 20995894 / +16.8% 🔴 44539250 / 43649061 / +2.0% 0.55 / 0.48 / +14.5%
tpcds_q90/datafusion:vortex-file-compressed 14630437 / 10160852 / +44.0% 🔴 26377709 / 25466095 / +3.6% 0.55 / 0.40 / +39.0%
tpcds_q91/datafusion:vortex-file-compressed 16630182 / 16642238 / -0.1% 37830743 / 36926100 / +2.4% 0.44 / 0.45 / -2.5%
tpcds_q92/datafusion:vortex-file-compressed 15953112 / 13074024 / +22.0% 🔴 33901376 / 29476267 / +15.0% 🔴 0.47 / 0.44 / +6.1%
tpcds_q93/datafusion:vortex-file-compressed 20451374 / 20636186 / -0.9% 40057908 / 41290888 / -3.0% 0.51 / 0.50 / +2.2%
tpcds_q94/datafusion:vortex-file-compressed 21358776 / 18148145 / +17.7% 🔴 43067127 / 38064901 / +13.1% 🔴 0.50 / 0.48 / +4.0%
tpcds_q95/datafusion:vortex-file-compressed 44471105 / 43107525 / +3.2% 66697644 / 61861541 / +7.8% 0.67 / 0.70 / -4.3%
tpcds_q96/datafusion:vortex-file-compressed 9823518 / 7583800 / +29.5% 🔴 25556852 / 25611375 / -0.2% 0.38 / 0.30 / +29.8%
tpcds_q97/datafusion:vortex-file-compressed 19368165 / 17028708 / +13.7% 🔴 41140893 / 36899417 / +11.5% 🔴 0.47 / 0.46 / +2.0%
tpcds_q98/datafusion:vortex-file-compressed 16947800 / 16250404 / +4.3% 35871373 / 36908093 / -2.8% 0.47 / 0.44 / +7.3%
tpcds_q99/datafusion:vortex-file-compressed 18268216 / 15737118 / +16.1% 🔴 39120181 / 35713990 / +9.5% 0.47 / 0.44 / +6.0%
datafusion / parquet / ns (0.986x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 42751370 / 44334025 / -3.6% 61566508 / 64275254 / -4.2% 0.69 / 0.69 / +0.7%
tpcds_q02/datafusion:parquet 54531314 / 55678080 / -2.1% 70388999 / 72366294 / -2.7% 0.77 / 0.77 / +0.7%
tpcds_q03/datafusion:parquet 18975406 / 19304782 / -1.7% 30077263 / 31899576 / -5.7% 0.63 / 0.61 / +4.2%
tpcds_q04/datafusion:parquet 178798130 / 179538868 / -0.4% 202966319 / 209497966 / -3.1% 0.88 / 0.86 / +2.8%
tpcds_q05/datafusion:parquet 67830003 / 68823638 / -1.4% 87309125 / 91667728 / -4.8% 0.78 / 0.75 / +3.5%
tpcds_q06/datafusion:parquet 33118200 / 33991272 / -2.6% 48019405 / 49359060 / -2.7% 0.69 / 0.69 / +0.1%
tpcds_q07/datafusion:parquet 46541636 / 47187722 / -1.4% 64050576 / 69351576 / -7.6% 0.73 / 0.68 / +6.8%
tpcds_q08/datafusion:parquet 31054538 / 31663453 / -1.9% 44306286 / 47496785 / -6.7% 0.70 / 0.67 / +5.1%
tpcds_q09/datafusion:parquet 32218391 / 34979950 / -7.9% 41294243 / 47296668 / -12.7% 🟢 0.78 / 0.74 / +5.5%
tpcds_q10/datafusion:parquet 44871018 / 44152129 / +1.6% 55727765 / 59266046 / -6.0% 0.81 / 0.74 / +8.1%
tpcds_q11/datafusion:parquet 96045932 / 98576584 / -2.6% 120115371 / 124169461 / -3.3% 0.80 / 0.79 / +0.7%
tpcds_q12/datafusion:parquet 23357478 / 24162857 / -3.3% 37363409 / 36714603 / +1.8% 0.63 / 0.66 / -5.0%
tpcds_q13/datafusion:parquet 45993366 / 47437340 / -3.0% 66644558 / 69548498 / -4.2% 0.69 / 0.68 / +1.2%
tpcds_q14/datafusion:parquet 532335670 / 540424371 / -1.5% 580220718 / 585729312 / -0.9% 0.92 / 0.92 / -0.6%
tpcds_q15/datafusion:parquet 23252010 / 23644274 / -1.7% 38365976 / 39665347 / -3.3% 0.61 / 0.60 / +1.7%
tpcds_q16/datafusion:parquet 37078592 / 37202126 / -0.3% 52363494 / 52386892 / -0.0% 0.71 / 0.71 / -0.3%
tpcds_q17/datafusion:parquet 73011676 / 74099997 / -1.5% 96656088 / 98598001 / -2.0% 0.76 / 0.75 / +0.5%
tpcds_q18/datafusion:parquet 67106182 / 69003548 / -2.7% 88307530 / 91369714 / -3.4% 0.76 / 0.76 / +0.6%
tpcds_q19/datafusion:parquet 29174290 / 29897579 / -2.4% 43369450 / 45640948 / -5.0% 0.67 / 0.66 / +2.7%
tpcds_q20/datafusion:parquet 24886269 / 25775988 / -3.5% 37350107 / 38280239 / -2.4% 0.67 / 0.67 / -1.0%
tpcds_q21/datafusion:parquet 20160367 / 20498946 / -1.7% 31754933 / 33809551 / -6.1% 0.63 / 0.61 / +4.7%
tpcds_q22/datafusion:parquet 77145458 / 77668714 / -0.7% 89078680 / 90957300 / -2.1% 0.87 / 0.85 / +1.4%
tpcds_q23/datafusion:parquet 91241188 / 93845642 / -2.8% 113032629 / 115500343 / -2.1% 0.81 / 0.81 / -0.7%
tpcds_q24/datafusion:parquet 90220604 / 92059396 / -2.0% 113077051 / 116570425 / -3.0% 0.80 / 0.79 / +1.0%
tpcds_q25/datafusion:parquet 76784081 / 81129931 / -5.4% 102979216 / 105685315 / -2.6% 0.75 / 0.77 / -2.9%
tpcds_q26/datafusion:parquet 43191033 / 43826136 / -1.4% 58960418 / 62854298 / -6.2% 0.73 / 0.70 / +5.1%
tpcds_q27/datafusion:parquet 75777818 / 77090210 / -1.7% 99360798 / 100119945 / -0.8% 0.76 / 0.77 / -1.0%
tpcds_q28/datafusion:parquet 28363738 / 28660301 / -1.0% 42556204 / 45752406 / -7.0% 0.67 / 0.63 / +6.4%
tpcds_q29/datafusion:parquet 74925335 / 75520018 / -0.8% 99632056 / 97374371 / +2.3% 0.75 / 0.78 / -3.0%
tpcds_q30/datafusion:parquet 45809782 / 46963520 / -2.5% 55509621 / 61316838 / -9.5% 0.83 / 0.77 / +7.7%
tpcds_q31/datafusion:parquet 80690280 / 81915358 / -1.5% 101673781 / 103153736 / -1.4% 0.79 / 0.79 / -0.1%
tpcds_q32/datafusion:parquet 26099858 / 26397830 / -1.1% 40566551 / 41621600 / -2.5% 0.64 / 0.63 / +1.4%
tpcds_q33/datafusion:parquet 37765496 / 36453784 / +3.6% 53472883 / 56319279 / -5.1% 0.71 / 0.65 / +9.1%
tpcds_q34/datafusion:parquet 24258332 / 24742001 / -2.0% 36565572 / 36739931 / -0.5% 0.66 / 0.67 / -1.5%
tpcds_q35/datafusion:parquet 50605503 / 52395569 / -3.4% 63986424 / 65032743 / -1.6% 0.79 / 0.81 / -1.8%
tpcds_q36/datafusion:parquet 52307616 / 53931258 / -3.0% 73042732 / 77286073 / -5.5% 0.72 / 0.70 / +2.6%
tpcds_q37/datafusion:parquet 21244420 / 21267286 / -0.1% 34133038 / 36175039 / -5.6% 0.62 / 0.59 / +5.9%
tpcds_q38/datafusion:parquet 45167635 / 45853710 / -1.5% 63696921 / 63232651 / +0.7% 0.71 / 0.73 / -2.2%
tpcds_q39/datafusion:parquet 68327234 / 68657063 / -0.5% 86044815 / 85690796 / +0.4% 0.79 / 0.80 / -0.9%
tpcds_q40/datafusion:parquet 30680224 / 30363851 / +1.0% 48998761 / 52873951 / -7.3% 0.63 / 0.57 / +9.0%
tpcds_q41/datafusion:parquet 20283308 / 20129714 / +0.8% 32817739 / 33662318 / -2.5% 0.62 / 0.60 / +3.4%
tpcds_q42/datafusion:parquet 18032479 / 18404164 / -2.0% 30079156 / 31491755 / -4.5% 0.60 / 0.58 / +2.6%
tpcds_q43/datafusion:parquet 19451124 / 19648118 / -1.0% 32163766 / 33269592 / -3.3% 0.60 / 0.59 / +2.4%
tpcds_q44/datafusion:parquet 35945224 / 37153860 / -3.3% 51108973 / 51792027 / -1.3% 0.70 / 0.72 / -2.0%
tpcds_q45/datafusion:parquet 28196016 / 26761509 / +5.4% 47427445 / 42027235 / +12.8% 🔴 0.59 / 0.64 / -6.6%
tpcds_q46/datafusion:parquet 29141000 / 29747417 / -2.0% 45460981 / 46529646 / -2.3% 0.64 / 0.64 / +0.3%
tpcds_q47/datafusion:parquet 96890251 / 99094416 / -2.2% 121412660 / 122934045 / -1.2% 0.80 / 0.81 / -1.0%
tpcds_q48/datafusion:parquet 41759619 / 41586211 / +0.4% 61063564 / 62465799 / -2.2% 0.68 / 0.67 / +2.7%
tpcds_q49/datafusion:parquet 73203030 / 70803622 / +3.4% 95691454 / 95072308 / +0.7% 0.76 / 0.74 / +2.7%
tpcds_q50/datafusion:parquet 46943590 / 47832247 / -1.9% 66878219 / 67140732 / -0.4% 0.70 / 0.71 / -1.5%
tpcds_q51/datafusion:parquet 75174430 / 75861576 / -0.9% 95872618 / 95689740 / +0.2% 0.78 / 0.79 / -1.1%
tpcds_q52/datafusion:parquet 18549536 / 18646106 / -0.5% 30030926 / 29805783 / +0.8% 0.62 / 0.63 / -1.3%
tpcds_q53/datafusion:parquet 22341445 / 22697570 / -1.6% 38562220 / 39741474 / -3.0% 0.58 / 0.57 / +1.4%
tpcds_q54/datafusion:parquet 53996590 / 52428950 / +3.0% 69402511 / 68927325 / +0.7% 0.78 / 0.76 / +2.3%
tpcds_q55/datafusion:parquet 18006494 / 18644690 / -3.4% 31962232 / 29497764 / +8.4% 0.56 / 0.63 / -10.9%
tpcds_q56/datafusion:parquet 40236120 / 42466732 / -5.3% 58686952 / 55341242 / +6.0% 0.69 / 0.77 / -10.7%
tpcds_q57/datafusion:parquet 99988972 / 101941552 / -1.9% 117113921 / 119578132 / -2.1% 0.85 / 0.85 / +0.1%
tpcds_q58/datafusion:parquet 64725796 / 66306606 / -2.4% 81791051 / 83139330 / -1.6% 0.79 / 0.80 / -0.8%
tpcds_q59/datafusion:parquet 48123999 / 48217472 / -0.2% 65319802 / 66250390 / -1.4% 0.74 / 0.73 / +1.2%
tpcds_q60/datafusion:parquet 39391359 / 40061296 / -1.7% 53154771 / 54126970 / -1.8% 0.74 / 0.74 / +0.1%
tpcds_q61/datafusion:parquet 35441046 / 37328378 / -5.1% 52460923 / 52323570 / +0.3% 0.68 / 0.71 / -5.3%
tpcds_q62/datafusion:parquet 24886619 / 25420484 / -2.1% 37450502 / 38871978 / -3.7% 0.66 / 0.65 / +1.6%
tpcds_q63/datafusion:parquet 22406755 / 22590660 / -0.8% 39127556 / 40386417 / -3.1% 0.57 / 0.56 / +2.4%
tpcds_q64/datafusion:parquet 283383854 / 290198870 / -2.3% 322004616 / 332714946 / -3.2% 0.88 / 0.87 / +0.9%
tpcds_q65/datafusion:parquet 124490713 / 122023496 / +2.0% 139201953 / 142598631 / -2.4% 0.89 / 0.86 / +4.5%
tpcds_q66/datafusion:parquet 60033936 / 61016212 / -1.6% 77236991 / 75636909 / +2.1% 0.78 / 0.81 / -3.6%
tpcds_q67/datafusion:parquet 68457291 / 69417621 / -1.4% 92399097 / 93921131 / -1.6% 0.74 / 0.74 / +0.2%
tpcds_q68/datafusion:parquet 28890394 / 29798262 / -3.0% 48368208 / 48821934 / -0.9% 0.60 / 0.61 / -2.1%
tpcds_q69/datafusion:parquet 43347796 / 45744213 / -5.2% 55380651 / 60667080 / -8.7% 0.78 / 0.75 / +3.8%
tpcds_q70/datafusion:parquet 80415505 / 81181290 / -0.9% 97223124 / 100215502 / -3.0% 0.83 / 0.81 / +2.1%
tpcds_q71/datafusion:parquet 25101890 / 26292854 / -4.5% 40551359 / 39395747 / +2.9% 0.62 / 0.67 / -7.3%
tpcds_q72/datafusion:parquet 520975474 / 521623806 / -0.1% 547625874 / 544115305 / +0.6% 0.95 / 0.96 / -0.8%
tpcds_q73/datafusion:parquet 23651506 / 24110405 / -1.9% 36065718 / 37360451 / -3.5% 0.66 / 0.65 / +1.6%
tpcds_q74/datafusion:parquet 69448914 / 70820218 / -1.9% 89705598 / 92130201 / -2.6% 0.77 / 0.77 / +0.7%
tpcds_q75/datafusion:parquet 152350168 / 154029092 / -1.1% 177299617 / 179389367 / -1.2% 0.86 / 0.86 / +0.1%
tpcds_q76/datafusion:parquet 33423210 / 33877150 / -1.3% 49051738 / 48814822 / +0.5% 0.68 / 0.69 / -1.8%
tpcds_q77/datafusion:parquet 57366705 / 56778638 / +1.0% 72892916 / 75486253 / -3.4% 0.79 / 0.75 / +4.6%
tpcds_q78/datafusion:parquet 85750145 / 85821672 / -0.1% 118487836 / 117634482 / +0.7% 0.72 / 0.73 / -0.8%
tpcds_q79/datafusion:parquet 26795726 / 27767202 / -3.5% 43051761 / 43093734 / -0.1% 0.62 / 0.64 / -3.4%
tpcds_q80/datafusion:parquet 79935534 / 80762894 / -1.0% 112685815 / 109822552 / +2.6% 0.71 / 0.74 / -3.5%
tpcds_q81/datafusion:parquet 39776274 / 39638232 / +0.3% 51082228 / 53678868 / -4.8% 0.78 / 0.74 / +5.4%
tpcds_q82/datafusion:parquet 22528544 / 22382656 / +0.7% 37468336 / 36060942 / +3.9% 0.60 / 0.62 / -3.1%
tpcds_q83/datafusion:parquet 58293638 / 59535984 / -2.1% 76170322 / 72819450 / +4.6% 0.77 / 0.82 / -6.4%
tpcds_q84/datafusion:parquet 26100326 / 26967512 / -3.2% 38852552 / 40678339 / -4.5% 0.67 / 0.66 / +1.3%
tpcds_q85/datafusion:parquet 80175385 / 80659317 / -0.6% 104107198 / 103298910 / +0.8% 0.77 / 0.78 / -1.4%
tpcds_q86/datafusion:parquet 20982078 / 21120376 / -0.7% 33257021 / 33478175 / -0.7% 0.63 / 0.63 / +0.0%
tpcds_q87/datafusion:parquet 45345318 / 45287108 / +0.1% 59423027 / 62763173 / -5.3% 0.76 / 0.72 / +5.8%
tpcds_q88/datafusion:parquet 37870040 / 36985024 / +2.4% 54124332 / 51620005 / +4.9% 0.70 / 0.72 / -2.3%
tpcds_q89/datafusion:parquet 25227164 / 26179004 / -3.6% 43041786 / 43614579 / -1.3% 0.59 / 0.60 / -2.4%
tpcds_q90/datafusion:parquet 15270068 / 14638738 / +4.3% 26678219 / 26923681 / -0.9% 0.57 / 0.54 / +5.3%
tpcds_q91/datafusion:parquet 32575760 / 32044188 / +1.7% 47453332 / 48814541 / -2.8% 0.69 / 0.66 / +4.6%
tpcds_q92/datafusion:parquet 26492404 / 27058888 / -2.1% 41157278 / 40117441 / +2.6% 0.64 / 0.67 / -4.6%
tpcds_q93/datafusion:parquet 26609374 / 28203716 / -5.7% 46401599 / 47795221 / -2.9% 0.57 / 0.59 / -2.8%
tpcds_q94/datafusion:parquet 35253074 / 35590050 / -0.9% 49059177 / 48784557 / +0.6% 0.72 / 0.73 / -1.5%
tpcds_q95/datafusion:parquet 64359084 / 63869346 / +0.8% 77628253 / 80887500 / -4.0% 0.83 / 0.79 / +5.0%
tpcds_q96/datafusion:parquet 13205738 / 12897176 / +2.4% 25194490 / 25550889 / -1.4% 0.52 / 0.50 / +3.8%
tpcds_q97/datafusion:parquet 35395312 / 35949748 / -1.5% 52263281 / 52177199 / +0.2% 0.68 / 0.69 / -1.7%
tpcds_q98/datafusion:parquet 24681214 / 24824426 / -0.6% 38363399 / 39408272 / -2.7% 0.64 / 0.63 / +2.1%
tpcds_q99/datafusion:parquet 29886799 / 30030320 / -0.5% 42959846 / 43603160 / -1.5% 0.70 / 0.69 / +1.0%
duckdb / vortex-file-compressed / ns (0.974x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15846249 / 16453736 / -3.7% 24606850 / 25182254 / -2.3% 0.64 / 0.65 / -1.4%
tpcds_q02/duckdb:vortex-file-compressed 18418374 / 18860088 / -2.3% 22321416 / 23546689 / -5.2% 0.83 / 0.80 / +3.0%
tpcds_q03/duckdb:vortex-file-compressed 7074559 / 7265462 / -2.6% 15916530 / 15576471 / +2.2% 0.44 / 0.47 / -4.7%
tpcds_q04/duckdb:vortex-file-compressed 46098412 / 46170104 / -0.2% 56661327 / 57310303 / -1.1% 0.81 / 0.81 / +1.0%
tpcds_q05/duckdb:vortex-file-compressed 22855034 / 23454080 / -2.6% 32578039 / 34761033 / -6.3% 0.70 / 0.67 / +4.0%
tpcds_q06/duckdb:vortex-file-compressed 24113022 / 24968826 / -3.4% 38226600 / 39434263 / -3.1% 0.63 / 0.63 / -0.4%
tpcds_q07/duckdb:vortex-file-compressed 13404368 / 13596312 / -1.4% 23946012 / 24379240 / -1.8% 0.56 / 0.56 / +0.4%
tpcds_q08/duckdb:vortex-file-compressed 17197896 / 17829198 / -3.5% 26465833 / 26391117 / +0.3% 0.65 / 0.68 / -3.8%
tpcds_q09/duckdb:vortex-file-compressed 18925046 / 19066790 / -0.7% 30005596 / 30744509 / -2.4% 0.63 / 0.62 / +1.7%
tpcds_q10/duckdb:vortex-file-compressed 28006041 / 28456392 / -1.6% 41314122 / 41054327 / +0.6% 0.68 / 0.69 / -2.2%
tpcds_q11/duckdb:vortex-file-compressed 36962220 / 37144638 / -0.5% 45654573 / 45892665 / -0.5% 0.81 / 0.81 / +0.0%
tpcds_q12/duckdb:vortex-file-compressed 10102387 / 10591056 / -4.6% 17871450 / 17460402 / +2.4% 0.57 / 0.61 / -6.8%
tpcds_q13/duckdb:vortex-file-compressed 20861492 / 21268401 / -1.9% 34354039 / 34468166 / -0.3% 0.61 / 0.62 / -1.6%
tpcds_q14/duckdb:vortex-file-compressed 57416926 / 58092215 / -1.2% 65793416 / 70644783 / -6.9% 0.87 / 0.82 / +6.1%
tpcds_q15/duckdb:vortex-file-compressed 11192794 / 11429564 / -2.1% 18564285 / 18949098 / -2.0% 0.60 / 0.60 / -0.0%
tpcds_q16/duckdb:vortex-file-compressed 24152812 / 24481802 / -1.3% 35644625 / 36350487 / -1.9% 0.68 / 0.67 / +0.6%
tpcds_q17/duckdb:vortex-file-compressed 24419937 / 24748257 / -1.3% 38530306 / 36985559 / +4.2% 0.63 / 0.67 / -5.3%
tpcds_q18/duckdb:vortex-file-compressed 31762933 / 32101585 / -1.1% 41440060 / 43429461 / -4.6% 0.77 / 0.74 / +3.7%
tpcds_q19/duckdb:vortex-file-compressed 77371136 / 79017672 / -2.1% 87711508 / 90534537 / -3.1% 0.88 / 0.87 / +1.1%
tpcds_q20/duckdb:vortex-file-compressed 10984114 / 11401666 / -3.7% 18068148 / 18877361 / -4.3% 0.61 / 0.60 / +0.7%
tpcds_q21/duckdb:vortex-file-compressed 9833756 / 9588812 / +2.6% 21593775 / 20889319 / +3.4% 0.46 / 0.46 / -0.8%
tpcds_q22/duckdb:vortex-file-compressed 17328903 / 17721778 / -2.2% 28802926 / 27747282 / +3.8% 0.60 / 0.64 / -5.8%
tpcds_q23/duckdb:vortex-file-compressed 37581306 / 39595060 / -5.1% 49740706 / 50121259 / -0.8% 0.76 / 0.79 / -4.4%
tpcds_q24/duckdb:vortex-file-compressed 26395331 / 26924502 / -2.0% 37429384 / 38674062 / -3.2% 0.71 / 0.70 / +1.3%
tpcds_q25/duckdb:vortex-file-compressed 23146941 / 23968370 / -3.4% 34863286 / 35229103 / -1.0% 0.66 / 0.68 / -2.4%
tpcds_q26/duckdb:vortex-file-compressed 12760664 / 13533260 / -5.7% 21536366 / 20904156 / +3.0% 0.59 / 0.65 / -8.5%
tpcds_q27/duckdb:vortex-file-compressed 15837289 / 16091593 / -1.6% 26243885 / 27171468 / -3.4% 0.60 / 0.59 / +1.9%
tpcds_q28/duckdb:vortex-file-compressed 15262386 / 15596678 / -2.1% 25932498 / 25881923 / +0.2% 0.59 / 0.60 / -2.3%
tpcds_q29/duckdb:vortex-file-compressed 22584548 / 23060686 / -2.1% 34087076 / 34956828 / -2.5% 0.66 / 0.66 / +0.4%
tpcds_q30/duckdb:vortex-file-compressed 16049626 / 16983834 / -5.5% 26066487 / 25159883 / +3.6% 0.62 / 0.68 / -8.8%
tpcds_q31/duckdb:vortex-file-compressed 17918416 / 18287496 / -2.0% 26528314 / 26891154 / -1.3% 0.68 / 0.68 / -0.7%
tpcds_q32/duckdb:vortex-file-compressed 11758590 / 12021118 / -2.2% 21632177 / 21977042 / -1.6% 0.54 / 0.55 / -0.6%
tpcds_q33/duckdb:vortex-file-compressed 18785374 / 19587840 / -4.1% 28460907 / 29168558 / -2.4% 0.66 / 0.67 / -1.7%
tpcds_q34/duckdb:vortex-file-compressed 13249726 / 13107422 / +1.1% 23012009 / 22783175 / +1.0% 0.58 / 0.58 / +0.1%
tpcds_q35/duckdb:vortex-file-compressed 28392539 / 29150680 / -2.6% 39363515 / 41483658 / -5.1% 0.72 / 0.70 / +2.6%
tpcds_q36/duckdb:vortex-file-compressed 14502950 / 14840668 / -2.3% 24139379 / 25423252 / -5.0% 0.60 / 0.58 / +2.9%
tpcds_q37/duckdb:vortex-file-compressed 9659966 / 9794446 / -1.4% 24216041 / 24167321 / +0.2% 0.40 / 0.41 / -1.6%
tpcds_q38/duckdb:vortex-file-compressed 24392238 / 24877838 / -2.0% 33287922 / 33446006 / -0.5% 0.73 / 0.74 / -1.5%
tpcds_q39/duckdb:vortex-file-compressed 18816424 / 19394902 / -3.0% 31024510 / 29308172 / +5.9% 0.61 / 0.66 / -8.3%
tpcds_q40/duckdb:vortex-file-compressed 14080889 / 14350183 / -1.9% 20947510 / 22151905 / -5.4% 0.67 / 0.65 / +3.8%
tpcds_q41/duckdb:vortex-file-compressed 18631153 / 19111940 / -2.5% 25635587 / 26570275 / -3.5% 0.73 / 0.72 / +1.0%
tpcds_q42/duckdb:vortex-file-compressed 7101998 / 7250049 / -2.0% 16008002 / 17123414 / -6.5% 0.44 / 0.42 / +4.8%
tpcds_q43/duckdb:vortex-file-compressed 9727336 / 10165194 / -4.3% 19431115 / 19692243 / -1.3% 0.50 / 0.52 / -3.0%
tpcds_q44/duckdb:vortex-file-compressed 12576557 / 12841860 / -2.1% 23859982 / 25114363 / -5.0% 0.53 / 0.51 / +3.1%
tpcds_q45/duckdb:vortex-file-compressed 23416884 / 24139812 / -3.0% 30933267 / 32482654 / -4.8% 0.76 / 0.74 / +1.9%
tpcds_q46/duckdb:vortex-file-compressed 19026107 / 20125626 / -5.5% 28001755 / 28639141 / -2.2% 0.68 / 0.70 / -3.3%
tpcds_q47/duckdb:vortex-file-compressed 34914656 / 35263352 / -1.0% 45067500 / 45463901 / -0.9% 0.77 / 0.78 / -0.1%
tpcds_q48/duckdb:vortex-file-compressed 23493484 / 23791372 / -1.3% 35583223 / 37062264 / -4.0% 0.66 / 0.64 / +2.9%
tpcds_q49/duckdb:vortex-file-compressed 18800163 / 19240911 / -2.3% 30170942 / 32499019 / -7.2% 0.62 / 0.59 / +5.2%
tpcds_q50/duckdb:vortex-file-compressed 16864004 / 17625758 / -4.3% 26670355 / 28721084 / -7.1% 0.63 / 0.61 / +3.0%
tpcds_q51/duckdb:vortex-file-compressed 48833418 / 50166608 / -2.7% 75166347 / 79427923 / -5.4% 0.65 / 0.63 / +2.9%
tpcds_q52/duckdb:vortex-file-compressed 7268489 / 8924029 / -18.6% 🟢 16389867 / 16145875 / +1.5% 0.44 / 0.55 / -19.8%
tpcds_q53/duckdb:vortex-file-compressed 11358273 / 11628770 / -2.3% 21118947 / 21326754 / -1.0% 0.54 / 0.55 / -1.4%
tpcds_q54/duckdb:vortex-file-compressed 20416560 / 20770516 / -1.7% 30424155 / 30625034 / -0.7% 0.67 / 0.68 / -1.1%
tpcds_q55/duckdb:vortex-file-compressed 6835998 / 7057773 / -3.1% 16235978 / 16019303 / +1.4% 0.42 / 0.44 / -4.4%
tpcds_q56/duckdb:vortex-file-compressed 17835884 / 18562602 / -3.9% 28602717 / 28752424 / -0.5% 0.62 / 0.65 / -3.4%
tpcds_q57/duckdb:vortex-file-compressed 26074028 / 26253356 / -0.7% 34059148 / 34160101 / -0.3% 0.77 / 0.77 / -0.4%
tpcds_q58/duckdb:vortex-file-compressed 20578654 / 20373665 / +1.0% 30222816 / 30066811 / +0.5% 0.68 / 0.68 / +0.5%
tpcds_q59/duckdb:vortex-file-compressed 19460898 / 20130401 / -3.3% 26336803 / 28098142 / -6.3% 0.74 / 0.72 / +3.1%
tpcds_q60/duckdb:vortex-file-compressed 19179408 / 18783338 / +2.1% 29104498 / 29506497 / -1.4% 0.66 / 0.64 / +3.5%
tpcds_q61/duckdb:vortex-file-compressed 25231305 / 25560962 / -1.3% 35699302 / 35064587 / +1.8% 0.71 / 0.73 / -3.0%
tpcds_q62/duckdb:vortex-file-compressed 11561470 / 11998730 / -3.6% 18684426 / 19393162 / -3.7% 0.62 / 0.62 / +0.0%
tpcds_q63/duckdb:vortex-file-compressed 10983496 / 11140505 / -1.4% 20094011 / 20577720 / -2.4% 0.55 / 0.54 / +1.0%
tpcds_q64/duckdb:vortex-file-compressed 49615362 / 50491563 / -1.7% 64325400 / 67435859 / -4.6% 0.77 / 0.75 / +3.0%
tpcds_q65/duckdb:vortex-file-compressed 12999338 / 13582407 / -4.3% 23640790 / 23725507 / -0.4% 0.55 / 0.57 / -3.9%
tpcds_q66/duckdb:vortex-file-compressed 29005214 / 31081522 / -6.7% 34944151 / 39841962 / -12.3% 🟢 0.83 / 0.78 / +6.4%
tpcds_q67/duckdb:vortex-file-compressed 58190386 / 59575538 / -2.3% 67341707 / 69119056 / -2.6% 0.86 / 0.86 / +0.3%
tpcds_q68/duckdb:vortex-file-compressed 19207334 / 19900330 / -3.5% 27620721 / 28453605 / -2.9% 0.70 / 0.70 / -0.6%
tpcds_q69/duckdb:vortex-file-compressed 22953441 / 23354631 / -1.7% 36638264 / 39167558 / -6.5% 0.63 / 0.60 / +5.1%
tpcds_q70/duckdb:vortex-file-compressed 15525333 / 16562196 / -6.3% 27521828 / 28092504 / -2.0% 0.56 / 0.59 / -4.3%
tpcds_q71/duckdb:vortex-file-compressed 13240372 / 12980249 / +2.0% 24168797 / 24049711 / +0.5% 0.55 / 0.54 / +1.5%
tpcds_q72/duckdb:vortex-file-compressed 52748646 / 54025100 / -2.4% 64079396 / 68251279 / -6.1% 0.82 / 0.79 / +4.0%
tpcds_q73/duckdb:vortex-file-compressed 12203314 / 12176817 / +0.2% 20576142 / 21316017 / -3.5% 0.59 / 0.57 / +3.8%
tpcds_q74/duckdb:vortex-file-compressed 26008448 / 26262599 / -1.0% 34184246 / 35104125 / -2.6% 0.76 / 0.75 / +1.7%
tpcds_q75/duckdb:vortex-file-compressed 27735144 / 28603314 / -3.0% 38641200 / 39432608 / -2.0% 0.72 / 0.73 / -1.0%
tpcds_q76/duckdb:vortex-file-compressed 12588466 / 13151064 / -4.3% 23125147 / 24771144 / -6.6% 0.54 / 0.53 / +2.5%
tpcds_q77/duckdb:vortex-file-compressed 20797349 / 21125310 / -1.6% 32482858 / 34009686 / -4.5% 0.64 / 0.62 / +3.1%
tpcds_q78/duckdb:vortex-file-compressed 43132274 / 43906116 / -1.8% 54637063 / 56576812 / -3.4% 0.79 / 0.78 / +1.7%
tpcds_q79/duckdb:vortex-file-compressed 13020695 / 13590748 / -4.2% 22141548 / 23260407 / -4.8% 0.59 / 0.58 / +0.6%
tpcds_q80/duckdb:vortex-file-compressed 36521392 / 37890949 / -3.6% 50521242 / 51126559 / -1.2% 0.72 / 0.74 / -2.5%
tpcds_q81/duckdb:vortex-file-compressed 21429288 / 22118665 / -3.1% 29467214 / 29846196 / -1.3% 0.73 / 0.74 / -1.9%
tpcds_q82/duckdb:vortex-file-compressed 9637704 / 9873419 / -2.4% 25519862 / 26226166 / -2.7% 0.38 / 0.38 / +0.3%
tpcds_q83/duckdb:vortex-file-compressed 17404128 / 17958338 / -3.1% 24756005 / 25773253 / -3.9% 0.70 / 0.70 / +0.9%
tpcds_q84/duckdb:vortex-file-compressed 15413712 / 15976270 / -3.5% 23192059 / 23358377 / -0.7% 0.66 / 0.68 / -2.8%
tpcds_q85/duckdb:vortex-file-compressed 24479780 / 24865083 / -1.5% 35919553 / 38766325 / -7.3% 0.68 / 0.64 / +6.3%
tpcds_q86/duckdb:vortex-file-compressed 9667602 / 10112272 / -4.4% 16863349 / 17888732 / -5.7% 0.57 / 0.57 / +1.4%
tpcds_q87/duckdb:vortex-file-compressed 25991550 / 26608656 / -2.3% 34818383 / 34001290 / +2.4% 0.75 / 0.78 / -4.6%
tpcds_q88/duckdb:vortex-file-compressed 30322359 / 31582431 / -4.0% 38527681 / 40689137 / -5.3% 0.79 / 0.78 / +1.4%
tpcds_q89/duckdb:vortex-file-compressed 12260388 / 12457902 / -1.6% 21358778 / 22416519 / -4.7% 0.57 / 0.56 / +3.3%
tpcds_q90/duckdb:vortex-file-compressed 8178080 / 8469530 / -3.4% 14392588 / 16172449 / -11.0% 🟢 0.57 / 0.52 / +8.5%
tpcds_q91/duckdb:vortex-file-compressed 14530012 / 14794144 / -1.8% 22941107 / 23428835 / -2.1% 0.63 / 0.63 / +0.3%
tpcds_q92/duckdb:vortex-file-compressed 12071460 / 12520790 / -3.6% 20688164 / 21617138 / -4.3% 0.58 / 0.58 / +0.7%
tpcds_q93/duckdb:vortex-file-compressed 10510696 / 10451821 / +0.6% 24018561 / 23260413 / +3.3% 0.44 / 0.45 / -2.6%
tpcds_q94/duckdb:vortex-file-compressed 22027729 / 22538946 / -2.3% 32438520 / 33105383 / -2.0% 0.68 / 0.68 / -0.3%
tpcds_q95/duckdb:vortex-file-compressed 62262830 / 62632970 / -0.6% 73039380 / 72045274 / +1.4% 0.85 / 0.87 / -1.9%
tpcds_q96/duckdb:vortex-file-compressed 6763054 / 6917306 / -2.2% 15921410 / 15875964 / +0.3% 0.42 / 0.44 / -2.5%
tpcds_q97/duckdb:vortex-file-compressed 23173714 / 23958728 / -3.3% 33145873 / 33239205 / -0.3% 0.70 / 0.72 / -3.0%
tpcds_q98/duckdb:vortex-file-compressed 11416294 / 11581361 / -1.4% 20583684 / 20232799 / +1.7% 0.55 / 0.57 / -3.1%
tpcds_q99/duckdb:vortex-file-compressed 14534416 / 15155699 / -4.1% 22740522 / 23865417 / -4.7% 0.64 / 0.64 / +0.6%
duckdb / parquet / ns (0.973x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23941388 / 24660274 / -2.9% 30552051 / 31966715 / -4.4% 0.78 / 0.77 / +1.6%
tpcds_q02/duckdb:parquet 17782002 / 18373818 / -3.2% 23553768 / 24802561 / -5.0% 0.75 / 0.74 / +1.9%
tpcds_q03/duckdb:parquet 9669773 / 9884300 / -2.2% 16003230 / 16142168 / -0.9% 0.60 / 0.61 / -1.3%
tpcds_q04/duckdb:parquet 117155298 / 119844550 / -2.2% 126316321 / 126932637 / -0.5% 0.93 / 0.94 / -1.8%
tpcds_q05/duckdb:parquet 28071222 / 28918682 / -2.9% 33614312 / 34421218 / -2.3% 0.84 / 0.84 / -0.6%
tpcds_q06/duckdb:parquet 26274178 / 27058562 / -2.9% 35783849 / 36483958 / -1.9% 0.73 / 0.74 / -1.0%
tpcds_q07/duckdb:parquet 33198800 / 31160908 / +6.5% 39187771 / 41157900 / -4.8% 0.85 / 0.76 / +11.9%
tpcds_q08/duckdb:parquet 19546362 / 20209789 / -3.3% 24740232 / 26729975 / -7.4% 0.79 / 0.76 / +4.5%
tpcds_q09/duckdb:parquet 26445305 / 27274368 / -3.0% 29408760 / 30832749 / -4.6% 0.90 / 0.88 / +1.7%
tpcds_q10/duckdb:parquet 32860044 / 33511088 / -1.9% 40521310 / 41429585 / -2.2% 0.81 / 0.81 / +0.3%
tpcds_q11/duckdb:parquet 68569926 / 69199989 / -0.9% 76169468 / 76894645 / -0.9% 0.90 / 0.90 / +0.0%
tpcds_q12/duckdb:parquet 13866142 / 14360554 / -3.4% 18894161 / 19642733 / -3.8% 0.73 / 0.73 / +0.4%
tpcds_q13/duckdb:parquet 32075732 / 31238468 / +2.7% 38850088 / 40970336 / -5.2% 0.83 / 0.76 / +8.3%
tpcds_q14/duckdb:parquet 64623780 / 66621330 / -3.0% 67953660 / 71313128 / -4.7% 0.95 / 0.93 / +1.8%
tpcds_q15/duckdb:parquet 16270332 / 17067954 / -4.7% 22885899 / 22742196 / +0.6% 0.71 / 0.75 / -5.3%
tpcds_q16/duckdb:parquet 29967338 / 30884466 / -3.0% 36690466 / 38424949 / -4.5% 0.82 / 0.80 / +1.6%
tpcds_q17/duckdb:parquet 34215936 / 35139434 / -2.6% 40099264 / 40981543 / -2.2% 0.85 / 0.86 / -0.5%
tpcds_q18/duckdb:parquet 46759576 / 48778814 / -4.1% 54949373 / 56921594 / -3.5% 0.85 / 0.86 / -0.7%
tpcds_q19/duckdb:parquet 18661331 / 19437300 / -4.0% 25524223 / 26117266 / -2.3% 0.73 / 0.74 / -1.8%
tpcds_q20/duckdb:parquet 14927322 / 15222664 / -1.9% 19612359 / 20168489 / -2.8% 0.76 / 0.75 / +0.8%
tpcds_q21/duckdb:parquet 10489682 / 10988424 / -4.5% 16803347 / 17495403 / -4.0% 0.62 / 0.63 / -0.6%
tpcds_q22/duckdb:parquet 20493554 / 21142442 / -3.1% 26784202 / 27325920 / -2.0% 0.77 / 0.77 / -1.1%
tpcds_q23/duckdb:parquet 44072098 / 45897934 / -4.0% 53369285 / 49125333 / +8.6% 0.83 / 0.93 / -11.6%
tpcds_q24/duckdb:parquet 30108736 / 31157618 / -3.4% 36692309 / 37158194 / -1.3% 0.82 / 0.84 / -2.1%
tpcds_q25/duckdb:parquet 30067062 / 31160996 / -3.5% 36821380 / 37902326 / -2.9% 0.82 / 0.82 / -0.7%
tpcds_q26/duckdb:parquet 28761308 / 29568424 / -2.7% 34938965 / 35865143 / -2.6% 0.82 / 0.82 / -0.2%
tpcds_q27/duckdb:parquet 32977094 / 34700406 / -5.0% 40937073 / 43703221 / -6.3% 0.81 / 0.79 / +1.5%
tpcds_q28/duckdb:parquet 26525208 / 26910188 / -1.4% 36280810 / 33200224 / +9.3% 0.73 / 0.81 / -9.8%
tpcds_q29/duckdb:parquet 31751702 / 32643060 / -2.7% 39040950 / 40194614 / -2.9% 0.81 / 0.81 / +0.1%
tpcds_q30/duckdb:parquet 35179770 / 36598060 / -3.9% 43587704 / 45789570 / -4.8% 0.81 / 0.80 / +1.0%
tpcds_q31/duckdb:parquet 35463948 / 36255251 / -2.2% 42996057 / 43383074 / -0.9% 0.82 / 0.84 / -1.3%
tpcds_q32/duckdb:parquet 14077798 / 14673404 / -4.1% 20491951 / 21456595 / -4.5% 0.69 / 0.68 / +0.5%
tpcds_q33/duckdb:parquet 24277808 / 24910938 / -2.5% 28915347 / 29400560 / -1.7% 0.84 / 0.85 / -0.9%
tpcds_q34/duckdb:parquet 18350022 / 17401012 / +5.5% 24168291 / 24629020 / -1.9% 0.76 / 0.71 / +7.5%
tpcds_q35/duckdb:parquet 35645158 / 36077611 / -1.2% 44163845 / 44420305 / -0.6% 0.81 / 0.81 / -0.6%
tpcds_q36/duckdb:parquet 41668439 / 40381710 / +3.2% 47636413 / 49018656 / -2.8% 0.87 / 0.82 / +6.2%
tpcds_q37/duckdb:parquet 12657052 / 12919965 / -2.0% 19204498 / 20189005 / -4.9% 0.66 / 0.64 / +3.0%
tpcds_q38/duckdb:parquet 29542338 / 30264585 / -2.4% 34098266 / 34598912 / -1.4% 0.87 / 0.87 / -1.0%
tpcds_q39/duckdb:parquet 23345607 / 23995670 / -2.7% 29437226 / 30616847 / -3.9% 0.79 / 0.78 / +1.2%
tpcds_q40/duckdb:parquet 15744800 / 16617387 / -5.3% 20893959 / 21967849 / -4.9% 0.75 / 0.76 / -0.4%
tpcds_q41/duckdb:parquet 11940371 / 12376158 / -3.5% 17995630 / 19015859 / -5.4% 0.66 / 0.65 / +1.9%
tpcds_q42/duckdb:parquet 9442268 / 9771660 / -3.4% 15205876 / 15689650 / -3.1% 0.62 / 0.62 / -0.3%
tpcds_q43/duckdb:parquet 11955378 / 12479225 / -4.2% 17745086 / 18720084 / -5.2% 0.67 / 0.67 / +1.1%
tpcds_q44/duckdb:parquet 21268799 / 20490532 / +3.8% 27006041 / 28276601 / -4.5% 0.79 / 0.72 / +8.7%
tpcds_q45/duckdb:parquet 20634014 / 21544776 / -4.2% 27643254 / 28653202 / -3.5% 0.75 / 0.75 / -0.7%
tpcds_q46/duckdb:parquet 37939870 / 36369892 / +4.3% 43475067 / 44956263 / -3.3% 0.87 / 0.81 / +7.9%
tpcds_q47/duckdb:parquet 34241160 / 35134824 / -2.5% 41452618 / 41818915 / -0.9% 0.83 / 0.84 / -1.7%
tpcds_q48/duckdb:parquet 28761466 / 30755928 / -6.5% 37071605 / 37759554 / -1.8% 0.78 / 0.81 / -4.7%
tpcds_q49/duckdb:parquet 28722742 / 29736927 / -3.4% 36568416 / 36543741 / +0.1% 0.79 / 0.81 / -3.5%
tpcds_q50/duckdb:parquet 19331640 / 20236515 / -4.5% 25556403 / 26239083 / -2.6% 0.76 / 0.77 / -1.9%
tpcds_q51/duckdb:parquet 51783294 / 53345530 / -2.9% 76630990 / 78840357 / -2.8% 0.68 / 0.68 / -0.1%
tpcds_q52/duckdb:parquet 9573677 / 9755520 / -1.9% 15398390 / 15885122 / -3.1% 0.62 / 0.61 / +1.2%
tpcds_q53/duckdb:parquet 13939130 / 14289998 / -2.5% 20977868 / 21661436 / -3.2% 0.66 / 0.66 / +0.7%
tpcds_q54/duckdb:parquet 24698150 / 25631958 / -3.6% 31814194 / 33381479 / -4.7% 0.78 / 0.77 / +1.1%
tpcds_q55/duckdb:parquet 10046982 / 9674790 / +3.8% 14909524 / 15503157 / -3.8% 0.67 / 0.62 / +8.0%
tpcds_q56/duckdb:parquet 25038389 / 25266875 / -0.9% 30871437 / 31467956 / -1.9% 0.81 / 0.80 / +1.0%
tpcds_q57/duckdb:parquet 30246853 / 31190806 / -3.0% 35693581 / 36227240 / -1.5% 0.85 / 0.86 / -1.6%
tpcds_q58/duckdb:parquet 23777906 / 24915488 / -4.6% 29378702 / 30522759 / -3.7% 0.81 / 0.82 / -0.8%
tpcds_q59/duckdb:parquet 22600645 / 23513538 / -3.9% 28597605 / 29799153 / -4.0% 0.79 / 0.79 / +0.2%
tpcds_q60/duckdb:parquet 26721090 / 27280896 / -2.1% 32423019 / 32966840 / -1.6% 0.82 / 0.83 / -0.4%
tpcds_q61/duckdb:parquet 24168714 / 26497732 / -8.8% 28800673 / 30734627 / -6.3% 0.84 / 0.86 / -2.7%
tpcds_q62/duckdb:parquet 12573499 / 13329021 / -5.7% 17632523 / 18592190 / -5.2% 0.71 / 0.72 / -0.5%
tpcds_q63/duckdb:parquet 13536488 / 13746406 / -1.5% 19726206 / 20315837 / -2.9% 0.69 / 0.68 / +1.4%
tpcds_q64/duckdb:parquet 70127786 / 72677016 / -3.5% 79836203 / 82688162 / -3.4% 0.88 / 0.88 / -0.1%
tpcds_q65/duckdb:parquet 20700766 / 20404546 / +1.5% 25668447 / 26887876 / -4.5% 0.81 / 0.76 / +6.3%
tpcds_q66/duckdb:parquet 32928580 / 35589734 / -7.5% 37786958 / 42130374 / -10.3% 🟢 0.87 / 0.84 / +3.2%
tpcds_q67/duckdb:parquet 60723222 / 61915272 / -1.9% 67468943 / 68944188 / -2.1% 0.90 / 0.90 / +0.2%
tpcds_q68/duckdb:parquet 29302190 / 30831541 / -5.0% 35935955 / 37539064 / -4.3% 0.82 / 0.82 / -0.7%
tpcds_q69/duckdb:parquet 26434370 / 26388532 / +0.2% 34402461 / 35263912 / -2.4% 0.77 / 0.75 / +2.7%
tpcds_q70/duckdb:parquet 19138750 / 19849858 / -3.6% 27010999 / 28078946 / -3.8% 0.71 / 0.71 / +0.2%
tpcds_q71/duckdb:parquet 16799634 / 17459148 / -3.8% 23920829 / 24604475 / -2.8% 0.70 / 0.71 / -1.0%
tpcds_q72/duckdb:parquet 52334998 / 55059640 / -4.9% 59419000 / 62959217 / -5.6% 0.88 / 0.87 / +0.7%
tpcds_q73/duckdb:parquet 15052600 / 14995676 / +0.4% 21355726 / 22366899 / -4.5% 0.70 / 0.67 / +5.1%
tpcds_q74/duckdb:parquet 84071645 / 86456226 / -2.8% 89817794 / 92207825 / -2.6% 0.94 / 0.94 / -0.2%
tpcds_q75/duckdb:parquet 43517766 / 45866003 / -5.1% 49695055 / 51589864 / -3.7% 0.88 / 0.89 / -1.5%
tpcds_q76/duckdb:parquet 16792252 / 18529753 / -9.4% 23173264 / 23872709 / -2.9% 0.72 / 0.78 / -6.6%
tpcds_q77/duckdb:parquet 25023703 / 24932148 / +0.4% 31340873 / 33452499 / -6.3% 0.80 / 0.75 / +7.1%
tpcds_q78/duckdb:parquet 77892178 / 80054736 / -2.7% 85080385 / 88073250 / -3.4% 0.92 / 0.91 / +0.7%
tpcds_q79/duckdb:parquet 24050152 / 23273636 / +3.3% 28634220 / 29810950 / -3.9% 0.84 / 0.78 / +7.6%
tpcds_q80/duckdb:parquet 37418280 / 38203205 / -2.1% 43681298 / 45696850 / -4.4% 0.86 / 0.84 / +2.5%
tpcds_q81/duckdb:parquet 35979366 / 37553418 / -4.2% 43913234 / 45785245 / -4.1% 0.82 / 0.82 / -0.1%
tpcds_q82/duckdb:parquet 13140826 / 13848010 / -5.1% 20451418 / 21022276 / -2.7% 0.64 / 0.66 / -2.5%
tpcds_q83/duckdb:parquet 19926726 / 20549126 / -3.0% 24650272 / 25716048 / -4.1% 0.81 / 0.80 / +1.2%
tpcds_q84/duckdb:parquet 22965854 / 23381883 / -1.8% 28163048 / 29037787 / -3.0% 0.82 / 0.81 / +1.3%
tpcds_q85/duckdb:parquet 32422210 / 33489666 / -3.2% 39010288 / 40911825 / -4.6% 0.83 / 0.82 / +1.5%
tpcds_q86/duckdb:parquet 11748148 / 12114914 / -3.0% 17085399 / 17470985 / -2.2% 0.69 / 0.69 / -0.8%
tpcds_q87/duckdb:parquet 31133182 / 31895954 / -2.4% 35413022 / 36541341 / -3.1% 0.88 / 0.87 / +0.7%
tpcds_q88/duckdb:parquet 38000504 / 39200788 / -3.1% 43359070 / 43758194 / -0.9% 0.88 / 0.90 / -2.2%
tpcds_q89/duckdb:parquet 14146960 / 14849616 / -4.7% 21215983 / 22041636 / -3.7% 0.67 / 0.67 / -1.0%
tpcds_q90/duckdb:parquet 9922358 / 10395608 / -4.6% 14673102 / 15363690 / -4.5% 0.68 / 0.68 / -0.1%
tpcds_q91/duckdb:parquet 20848804 / 21630478 / -3.6% 27903824 / 29383925 / -5.0% 0.75 / 0.74 / +1.5%
tpcds_q92/duckdb:parquet 15474737 / 16062452 / -3.7% 21891572 / 22996474 / -4.8% 0.71 / 0.70 / +1.2%
tpcds_q93/duckdb:parquet 14030522 / 14441680 / -2.8% 20187940 / 20917594 / -3.5% 0.69 / 0.69 / +0.7%
tpcds_q94/duckdb:parquet 25202244 / 25788592 / -2.3% 32551638 / 33879638 / -3.9% 0.77 / 0.76 / +1.7%
tpcds_q95/duckdb:parquet 43846740 / 44478964 / -1.4% 48898482 / 50088501 / -2.4% 0.90 / 0.89 / +1.0%
tpcds_q96/duckdb:parquet 8097220 / 8459550 / -4.3% 13866174 / 14172358 / -2.2% 0.58 / 0.60 / -2.2%
tpcds_q97/duckdb:parquet 27464108 / 27896401 / -1.5% 33968532 / 34731345 / -2.2% 0.81 / 0.80 / +0.7%
tpcds_q98/duckdb:parquet 16448698 / 16815828 / -2.2% 22907706 / 23652588 / -3.1% 0.72 / 0.71 / +1.0%
tpcds_q99/duckdb:parquet 18581406 / 19354114 / -4.0% 24560167 / 25565649 / -3.9% 0.76 / 0.76 / -0.1%

@github-actions

github-actions Bot commented Oct 31, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR bb6955d4 vs base 96fc43df
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.2%
Engines: DataFusion No clear signal (-4.0%, low confidence) · DuckDB No clear signal (+8.8%, environment too noisy confidence)
Vortex (geomean): hot 0.981x ➖ · cold 1.009x ➖
Parquet (geomean): hot 0.960x ➖ · cold 0.949x ➖
Shifts: Parquet (control) -4.0% · Median polish -1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.954x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1201968 / 1240594 / -3.1% 23715614 / 23026163 / +3.0% 0.05 / 0.05 / -5.9%
clickbench_q01/datafusion:vortex-file-compressed 5878592 / 6097742 / -3.6% 31808659 / 31029507 / +2.5% 0.18 / 0.20 / -6.0%
clickbench_q02/datafusion:vortex-file-compressed 10719704 / 11326140 / -5.4% 46707704 / 46847907 / -0.3% 0.23 / 0.24 / -5.1%
clickbench_q03/datafusion:vortex-file-compressed 12469921 / 13092892 / -4.8% 59412620 / 56590141 / +5.0% 0.21 / 0.23 / -9.3%
clickbench_q04/datafusion:vortex-file-compressed 57243371 / 58360628 / -1.9% 100696514 / 102335044 / -1.6% 0.57 / 0.57 / -0.3%
clickbench_q05/datafusion:vortex-file-compressed 77181794 / 77174454 / +0.0% 127181805 / 132423692 / -4.0% 0.61 / 0.58 / +4.1%
clickbench_q06/datafusion:vortex-file-compressed 1214414 / 1218676 / -0.3% 23455603 / 23573668 / -0.5% 0.05 / 0.05 / +0.2%
clickbench_q07/datafusion:vortex-file-compressed 9673157 / 9484954 / +2.0% 40070580 / 38642932 / +3.7% 0.24 / 0.25 / -1.6%
clickbench_q08/datafusion:vortex-file-compressed 79535740 / 80828849 / -1.6% 126573927 / 122700291 / +3.2% 0.63 / 0.66 / -4.6%
clickbench_q09/datafusion:vortex-file-compressed 171115210 / 170530707 / +0.3% 218935079 / 218498982 / +0.2% 0.78 / 0.78 / +0.1%
clickbench_q10/datafusion:vortex-file-compressed 23124004 / 23615122 / -2.1% 70358469 / 70309608 / +0.1% 0.33 / 0.34 / -2.1%
clickbench_q11/datafusion:vortex-file-compressed 25694454 / 25028832 / +2.7% 71708139 / 72685243 / -1.3% 0.36 / 0.34 / +4.1%
clickbench_q12/datafusion:vortex-file-compressed 74374242 / 74725259 / -0.5% 122903553 / 122367144 / +0.4% 0.61 / 0.61 / -0.9%
clickbench_q13/datafusion:vortex-file-compressed 116620938 / 120522647 / -3.2% 184372254 / 188010808 / -1.9% 0.63 / 0.64 / -1.3%
clickbench_q14/datafusion:vortex-file-compressed 73679056 / 74580792 / -1.2% 129405956 / 127652239 / +1.4% 0.57 / 0.58 / -2.5%
clickbench_q15/datafusion:vortex-file-compressed 63222054 / 62832699 / +0.6% 101373882 / 102501650 / -1.1% 0.62 / 0.61 / +1.7%
clickbench_q16/datafusion:vortex-file-compressed 155090840 / 153269564 / +1.2% 218913809 / 220267770 / -0.6% 0.71 / 0.70 / +1.8%
clickbench_q17/datafusion:vortex-file-compressed 155436298 / 152055418 / +2.2% 224289070 / 216966041 / +3.4% 0.69 / 0.70 / -1.1%
clickbench_q18/datafusion:vortex-file-compressed 300235773 / 297987828 / +0.8% 388210531 / 377283363 / +2.9% 0.77 / 0.79 / -2.1%
clickbench_q19/datafusion:vortex-file-compressed 7817382 / 7921700 / -1.3% 47285192 / 50270265 / -5.9% 0.17 / 0.16 / +4.9%
clickbench_q20/datafusion:vortex-file-compressed 65630269 / 68791664 / -4.6% 255620235 / 248718161 / +2.8% 0.26 / 0.28 / -7.2%
clickbench_q21/datafusion:vortex-file-compressed 76989680 / 82602354 / -6.8% 286458035 / 292727883 / -2.1% 0.27 / 0.28 / -4.8%
clickbench_q22/datafusion:vortex-file-compressed 93946326 / 91020558 / +3.2% 397337734 / 384311072 / +3.4% 0.24 / 0.24 / -0.2%
clickbench_q23/datafusion:vortex-file-compressed 69710540 / 193036844 / -63.9% 🟢 396715309 / 552132764 / -28.1% 🟢 0.18 / 0.35 / -49.7%
clickbench_q24/datafusion:vortex-file-compressed 9398170 / 16444434 / -42.8% 🟢 59440862 / 73213855 / -18.8% 🟢 0.16 / 0.22 / -29.6%
clickbench_q25/datafusion:vortex-file-compressed 19000786 / 18793636 / +1.1% 65496328 / 64149068 / +2.1% 0.29 / 0.29 / -1.0%
clickbench_q26/datafusion:vortex-file-compressed 14520575 / 15952872 / -9.0% 63283978 / 78794169 / -19.7% 🟢 0.23 / 0.20 / +13.3%
clickbench_q27/datafusion:vortex-file-compressed 100735966 / 102588642 / -1.8% 254131895 / 260397544 / -2.4% 0.40 / 0.39 / +0.6%
clickbench_q28/datafusion:vortex-file-compressed 556005524 / 559686111 / -0.7% 637640953 / 636842188 / +0.1% 0.87 / 0.88 / -0.8%
clickbench_q29/datafusion:vortex-file-compressed 24353971 / 24184104 / +0.7% 59258546 / 53850775 / +10.0% 🔴 0.41 / 0.45 / -8.5%
clickbench_q30/datafusion:vortex-file-compressed 56969326 / 58382028 / -2.4% 114735296 / 111939309 / +2.5% 0.50 / 0.52 / -4.8%
clickbench_q31/datafusion:vortex-file-compressed 65414646 / 65663370 / -0.4% 156165056 / 158006895 / -1.2% 0.42 / 0.42 / +0.8%
clickbench_q32/datafusion:vortex-file-compressed 297090842 / 289788788 / +2.5% 387057990 / 389147632 / -0.5% 0.77 / 0.74 / +3.1%
clickbench_q33/datafusion:vortex-file-compressed 325166826 / 323308124 / +0.6% 437603132 / 434306413 / +0.8% 0.74 / 0.74 / -0.2%
clickbench_q34/datafusion:vortex-file-compressed 322833229 / 322393446 / +0.1% 429354855 / 447481598 / -4.1% 0.75 / 0.72 / +4.4%
clickbench_q35/datafusion:vortex-file-compressed 56136497 / 56594592 / -0.8% 90755852 / 94884880 / -4.4% 0.62 / 0.60 / +3.7%
clickbench_q36/datafusion:vortex-file-compressed 38032946 / 37613911 / +1.1% 69471594 / 69123473 / +0.5% 0.55 / 0.54 / +0.6%
clickbench_q37/datafusion:vortex-file-compressed 21449534 / 21228667 / +1.0% 49030600 / 48763746 / +0.5% 0.44 / 0.44 / +0.5%
clickbench_q38/datafusion:vortex-file-compressed 13408960 / 13356924 / +0.4% 43410712 / 42842005 / +1.3% 0.31 / 0.31 / -0.9%
clickbench_q39/datafusion:vortex-file-compressed 78605096 / 78921008 / -0.4% 113419187 / 113531648 / -0.1% 0.69 / 0.70 / -0.3%
clickbench_q40/datafusion:vortex-file-compressed 10433308 / 10524539 / -0.9% 36729629 / 37491788 / -2.0% 0.28 / 0.28 / +1.2%
clickbench_q41/datafusion:vortex-file-compressed 10061124 / 10245232 / -1.8% 37110390 / 36775996 / +0.9% 0.27 / 0.28 / -2.7%
clickbench_q42/datafusion:vortex-file-compressed 9919380 / 10505766 / -5.6% 36532568 / 37067207 / -1.4% 0.27 / 0.28 / -4.2%
datafusion / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1232618 / 1237829 / -0.4% 49725317 / 50271157 / -1.1% 0.02 / 0.02 / +0.7%
clickbench_q01/datafusion:parquet 15703106 / 16085242 / -2.4% 67527062 / 67227447 / +0.4% 0.23 / 0.24 / -2.8%
clickbench_q02/datafusion:parquet 18627010 / 18343998 / +1.5% 80744461 / 80587943 / +0.2% 0.23 / 0.23 / +1.3%
clickbench_q03/datafusion:parquet 17170492 / 17262152 / -0.5% 79927301 / 83027188 / -3.7% 0.21 / 0.21 / +3.3%
clickbench_q04/datafusion:parquet 62863091 / 64635628 / -2.7% 126031273 / 127296396 / -1.0% 0.50 / 0.51 / -1.8%
clickbench_q05/datafusion:parquet 89156329 / 88825294 / +0.4% 156313488 / 157840365 / -1.0% 0.57 / 0.56 / +1.4%
clickbench_q06/datafusion:parquet 1245961 / 1270898 / -2.0% 50671606 / 50602949 / +0.1% 0.02 / 0.03 / -2.1%
clickbench_q07/datafusion:parquet 16969535 / 16611424 / +2.2% 68312186 / 69140121 / -1.2% 0.25 / 0.24 / +3.4%
clickbench_q08/datafusion:parquet 84305770 / 85271248 / -1.1% 158391953 / 166966252 / -5.1% 0.53 / 0.51 / +4.2%
clickbench_q09/datafusion:parquet 185193634 / 188588294 / -1.8% 263526609 / 265832522 / -0.9% 0.70 / 0.71 / -0.9%
clickbench_q10/datafusion:parquet 35871636 / 36089412 / -0.6% 100147607 / 102112825 / -1.9% 0.36 / 0.35 / +1.3%
clickbench_q11/datafusion:parquet 42286706 / 42398658 / -0.3% 108713279 / 113312919 / -4.1% 0.39 / 0.37 / +4.0%
clickbench_q12/datafusion:parquet 95100280 / 95892088 / -0.8% 160792649 / 164359643 / -2.2% 0.59 / 0.58 / +1.4%
clickbench_q13/datafusion:parquet 149873350 / 148096002 / +1.2% 228536354 / 227681865 / +0.4% 0.66 / 0.65 / +0.8%
clickbench_q14/datafusion:parquet 102452618 / 102293280 / +0.2% 175938142 / 179722174 / -2.1% 0.58 / 0.57 / +2.3%
clickbench_q15/datafusion:parquet 70839244 / 72675604 / -2.5% 129215314 / 132627170 / -2.6% 0.55 / 0.55 / +0.0%
clickbench_q16/datafusion:parquet 155981807 / 157384409 / -0.9% 236045132 / 231742166 / +1.9% 0.66 / 0.68 / -2.7%
clickbench_q17/datafusion:parquet 156221654 / 155910030 / +0.2% 235815050 / 239076268 / -1.4% 0.66 / 0.65 / +1.6%
clickbench_q18/datafusion:parquet 309773705 / 310685788 / -0.3% 420493486 / 422088842 / -0.4% 0.74 / 0.74 / +0.1%
clickbench_q19/datafusion:parquet 18932460 / 19444980 / -2.6% 78475728 / 79346675 / -1.1% 0.24 / 0.25 / -1.6%
clickbench_q20/datafusion:parquet 179497632 / 179083106 / +0.2% 283399873 / 294053086 / -3.6% 0.63 / 0.61 / +4.0%
clickbench_q21/datafusion:parquet 174197066 / 174397413 / -0.1% 295731608 / 316232509 / -6.5% 0.59 / 0.55 / +6.8%
clickbench_q22/datafusion:parquet 259727746 / 258542752 / +0.5% 427841032 / 453889316 / -5.7% 0.61 / 0.57 / +6.6%
clickbench_q23/datafusion:parquet 1009409551 / 1010660866 / -0.1% 1181652291 / 1210523021 / -2.4% 0.85 / 0.83 / +2.3%
clickbench_q24/datafusion:parquet 29637567 / 30117357 / -1.6% 90223270 / 90996539 / -0.8% 0.33 / 0.33 / -0.7%
clickbench_q25/datafusion:parquet 36170637 / 37445144 / -3.4% 103387382 / 104951557 / -1.5% 0.35 / 0.36 / -1.9%
clickbench_q26/datafusion:parquet 30244522 / 30748732 / -1.6% 91356339 / 92820210 / -1.6% 0.33 / 0.33 / -0.1%
clickbench_q27/datafusion:parquet 193150857 / 192618664 / +0.3% 296992520 / 305433330 / -2.8% 0.65 / 0.63 / +3.1%
clickbench_q28/datafusion:parquet 621877419 / 617206218 / +0.8% 702655440 / 721271188 / -2.6% 0.89 / 0.86 / +3.4%
clickbench_q29/datafusion:parquet 28239269 / 29677143 / -4.8% 89941462 / 92541890 / -2.8% 0.31 / 0.32 / -2.1%
clickbench_q30/datafusion:parquet 90245032 / 91040894 / -0.9% 174032797 / 179800517 / -3.2% 0.52 / 0.51 / +2.4%
clickbench_q31/datafusion:parquet 102206855 / 104328162 / -2.0% 204625814 / 200418649 / +2.1% 0.50 / 0.52 / -4.0%
clickbench_q32/datafusion:parquet 308705031 / 308270706 / +0.1% 429411031 / 433065119 / -0.8% 0.72 / 0.71 / +1.0%
clickbench_q33/datafusion:parquet 376584344 / 376737517 / -0.0% 473919588 / 477869441 / -0.8% 0.79 / 0.79 / +0.8%
clickbench_q34/datafusion:parquet 376659000 / 376107398 / +0.1% 470244467 / 479939143 / -2.0% 0.80 / 0.78 / +2.2%
clickbench_q35/datafusion:parquet 66409957 / 64831531 / +2.4% 127611439 / 127987566 / -0.3% 0.52 / 0.51 / +2.7%
clickbench_q36/datafusion:parquet 73827294 / 73635458 / +0.3% 138785714 / 136984329 / +1.3% 0.53 / 0.54 / -1.0%
clickbench_q37/datafusion:parquet 35473410 / 35549354 / -0.2% 92554978 / 91606986 / +1.0% 0.38 / 0.39 / -1.2%
clickbench_q38/datafusion:parquet 47637592 / 47758276 / -0.3% 108447845 / 110165313 / -1.6% 0.44 / 0.43 / +1.3%
clickbench_q39/datafusion:parquet 143833212 / 143444644 / +0.3% 212316299 / 212768173 / -0.2% 0.68 / 0.67 / +0.5%
clickbench_q40/datafusion:parquet 19799750 / 20104480 / -1.5% 79299558 / 77509500 / +2.3% 0.25 / 0.26 / -3.7%
clickbench_q41/datafusion:parquet 18593558 / 18710036 / -0.6% 76316134 / 76067790 / +0.3% 0.24 / 0.25 / -0.9%
clickbench_q42/datafusion:parquet 19160755 / 19457461 / -1.5% 76769510 / 76195183 / +0.8% 0.25 / 0.26 / -2.3%
duckdb / vortex-file-compressed / ns (1.010x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2203766 / 2171073 / +1.5% 25671139 / 23696344 / +8.3% 0.09 / 0.09 / -6.3%
clickbench_q01/duckdb:vortex-file-compressed 7607330 / 7957447 / -4.4% 30453782 / 29182473 / +4.4% 0.25 / 0.27 / -8.4%
clickbench_q02/duckdb:vortex-file-compressed 8876293 / 9228498 / -3.8% 35491885 / 37673659 / -5.8% 0.25 / 0.24 / +2.1%
clickbench_q03/duckdb:vortex-file-compressed 13802357 / 13957790 / -1.1% 49552762 / 49676256 / -0.2% 0.28 / 0.28 / -0.9%
clickbench_q04/duckdb:vortex-file-compressed 55955985 / 56746600 / -1.4% 88178818 / 90377402 / -2.4% 0.63 / 0.63 / +1.1%
clickbench_q05/duckdb:vortex-file-compressed 63494506 / 66771248 / -4.9% 94251007 / 95836017 / -1.7% 0.67 / 0.70 / -3.3%
clickbench_q06/duckdb:vortex-file-compressed 2728469 / 2735842 / -0.3% 30981779 / 31272654 / -0.9% 0.09 / 0.09 / +0.7%
clickbench_q07/duckdb:vortex-file-compressed 9711232 / 9213605 / +5.4% 30559261 / 30450728 / +0.4% 0.32 / 0.30 / +5.0%
clickbench_q08/duckdb:vortex-file-compressed 69072212 / 71431843 / -3.3% 105940075 / 105435921 / +0.5% 0.65 / 0.68 / -3.8%
clickbench_q09/duckdb:vortex-file-compressed 95611944 / 93364656 / +2.4% 132870115 / 129047363 / +3.0% 0.72 / 0.72 / -0.5%
clickbench_q10/duckdb:vortex-file-compressed 27393715 / 27481242 / -0.3% 70706414 / 71533272 / -1.2% 0.39 / 0.38 / +0.8%
clickbench_q11/duckdb:vortex-file-compressed 30687882 / 30686633 / +0.0% 76682876 / 74811661 / +2.5% 0.40 / 0.41 / -2.4%
clickbench_q12/duckdb:vortex-file-compressed 70404712 / 71663726 / -1.8% 101279522 / 102841494 / -1.5% 0.70 / 0.70 / -0.2%
clickbench_q13/duckdb:vortex-file-compressed 125763454 / 130431508 / -3.6% 168223023 / 169526593 / -0.8% 0.75 / 0.77 / -2.8%
clickbench_q14/duckdb:vortex-file-compressed 73375942 / 76936326 / -4.6% 103867779 / 105064476 / -1.1% 0.71 / 0.73 / -3.5%
clickbench_q15/duckdb:vortex-file-compressed 75869918 / 76041046 / -0.2% 110630005 / 109062442 / +1.4% 0.69 / 0.70 / -1.6%
clickbench_q16/duckdb:vortex-file-compressed 133248729 / 137539590 / -3.1% 172644935 / 176595419 / -2.2% 0.77 / 0.78 / -0.9%
clickbench_q17/duckdb:vortex-file-compressed 138919510 / 138723498 / +0.1% 172093045 / 175463611 / -1.9% 0.81 / 0.79 / +2.1%
clickbench_q18/duckdb:vortex-file-compressed 253635962 / 261704246 / -3.1% 301401052 / 318986132 / -5.5% 0.84 / 0.82 / +2.6%
clickbench_q19/duckdb:vortex-file-compressed 9229590 / 9368541 / -1.5% 38539699 / 38909590 / -1.0% 0.24 / 0.24 / -0.5%
clickbench_q20/duckdb:vortex-file-compressed 67186645 / 68093437 / -1.3% 168906066 / 172004039 / -1.8% 0.40 / 0.40 / +0.5%
clickbench_q21/duckdb:vortex-file-compressed 84678862 / 85299982 / -0.7% 189685022 / 195292128 / -2.9% 0.45 / 0.44 / +2.2%
clickbench_q22/duckdb:vortex-file-compressed 175825080 / 174264450 / +0.9% 356607247 / 348785265 / +2.2% 0.49 / 0.50 / -1.3%
clickbench_q23/duckdb:vortex-file-compressed 61762997 / 40195239 / +53.7% 🔴 177554346 / 85014558 / +108.9% 🔴 0.35 / 0.47 / -26.4%
clickbench_q24/duckdb:vortex-file-compressed 20298541 / 14507925 / +39.9% 🔴 52722520 / 38911281 / +35.5% 🔴 0.39 / 0.37 / +3.3%
clickbench_q25/duckdb:vortex-file-compressed 19498253 / 19613672 / -0.6% 54985036 / 54692923 / +0.5% 0.35 / 0.36 / -1.1%
clickbench_q26/duckdb:vortex-file-compressed 18303296 / 11891376 / +53.9% 🔴 53694584 / 37189116 / +44.4% 🔴 0.34 / 0.32 / +6.6%
clickbench_q27/duckdb:vortex-file-compressed 52711862 / 53911151 / -2.2% 172194507 / 174591178 / -1.4% 0.31 / 0.31 / -0.9%
clickbench_q28/duckdb:vortex-file-compressed 512371398 / 518806367 / -1.2% 555653263 / 580006126 / -4.2% 0.92 / 0.89 / +3.1%
clickbench_q29/duckdb:vortex-file-compressed 16576718 / 18125971 / -8.5% 37575967 / 44410731 / -15.4% 🟢 0.44 / 0.41 / +8.1%
clickbench_q30/duckdb:vortex-file-compressed 60392524 / 62404142 / -3.2% 110856442 / 113059049 / -1.9% 0.54 / 0.55 / -1.3%
clickbench_q31/duckdb:vortex-file-compressed 109350928 / 113244602 / -3.4% 199965987 / 175554711 / +13.9% 🔴 0.55 / 0.65 / -15.2%
clickbench_q32/duckdb:vortex-file-compressed 367538424 / 375598697 / -2.1% 405099373 / 410935086 / -1.4% 0.91 / 0.91 / -0.7%
clickbench_q33/duckdb:vortex-file-compressed 345514982 / 346507088 / -0.3% 410294521 / 418012901 / -1.8% 0.84 / 0.83 / +1.6%
clickbench_q34/duckdb:vortex-file-compressed 351269716 / 357464903 / -1.7% 413342035 / 430726074 / -4.0% 0.85 / 0.83 / +2.4%
clickbench_q35/duckdb:vortex-file-compressed 58054020 / 57521572 / +0.9% 87524307 / 88902374 / -1.6% 0.66 / 0.65 / +2.5%
clickbench_q36/duckdb:vortex-file-compressed 11265904 / 12059752 / -6.6% 34487659 / 31542201 / +9.3% 0.33 / 0.38 / -14.6%
clickbench_q37/duckdb:vortex-file-compressed 8278136 / 8298524 / -0.2% 29121224 / 27430223 / +6.2% 0.28 / 0.30 / -6.0%
clickbench_q38/duckdb:vortex-file-compressed 8653994 / 9007861 / -3.9% 28851847 / 28191479 / +2.3% 0.30 / 0.32 / -6.1%
clickbench_q39/duckdb:vortex-file-compressed 18538232 / 19942892 / -7.0% 40052895 / 38912782 / +2.9% 0.46 / 0.51 / -9.7%
clickbench_q40/duckdb:vortex-file-compressed 7392476 / 7495714 / -1.4% 28462292 / 27601507 / +3.1% 0.26 / 0.27 / -4.4%
clickbench_q41/duckdb:vortex-file-compressed 8433500 / 8409594 / +0.3% 28694494 / 28529148 / +0.6% 0.29 / 0.29 / -0.3%
clickbench_q42/duckdb:vortex-file-compressed 7338813 / 7754420 / -5.4% 28796601 / 27333326 / +5.4% 0.25 / 0.28 / -10.2%
duckdb / parquet / ns (0.928x ➖, 10↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9195870 / 11981198 / -23.2% 🟢 14341999 / 18863621 / -24.0% 🟢 0.64 / 0.64 / +1.0%
clickbench_q01/duckdb:parquet 15395609 / 18383612 / -16.3% 🟢 20455564 / 24474375 / -16.4% 🟢 0.75 / 0.75 / +0.2%
clickbench_q02/duckdb:parquet 22009050 / 24881486 / -11.5% 🟢 33069112 / 35663831 / -7.3% 0.67 / 0.70 / -4.6%
clickbench_q03/duckdb:parquet 22875016 / 25381266 / -9.9% 35875348 / 39814065 / -9.9% 0.64 / 0.64 / +0.0%
clickbench_q04/duckdb:parquet 61770614 / 64853778 / -4.8% 73848119 / 79712662 / -7.4% 0.84 / 0.81 / +2.8%
clickbench_q05/duckdb:parquet 82455968 / 86488813 / -4.7% 95202228 / 104065658 / -8.5% 0.87 / 0.83 / +4.2%
clickbench_q06/duckdb:parquet 20679078 / 22665320 / -8.8% 31085712 / 32369443 / -4.0% 0.67 / 0.70 / -5.0%
clickbench_q07/duckdb:parquet 17077994 / 19487102 / -12.4% 🟢 22521952 / 26521391 / -15.1% 🟢 0.76 / 0.73 / +3.2%
clickbench_q08/duckdb:parquet 74024154 / 78214907 / -5.4% 88233301 / 95340946 / -7.5% 0.84 / 0.82 / +2.3%
clickbench_q09/duckdb:parquet 102911805 / 106485754 / -3.4% 120374423 / 121960891 / -1.3% 0.85 / 0.87 / -2.1%
clickbench_q10/duckdb:parquet 41233989 / 42750266 / -3.5% 53185524 / 60482648 / -12.1% 🟢 0.78 / 0.71 / +9.7%
clickbench_q11/duckdb:parquet 47326330 / 49169156 / -3.7% 62201052 / 66023986 / -5.8% 0.76 / 0.74 / +2.2%
clickbench_q12/duckdb:parquet 92567661 / 95467710 / -3.0% 103470474 / 114490293 / -9.6% 0.89 / 0.83 / +7.3%
clickbench_q13/duckdb:parquet 149634809 / 156818655 / -4.6% 165618734 / 180443395 / -8.2% 0.90 / 0.87 / +4.0%
clickbench_q14/duckdb:parquet 102595970 / 105744119 / -3.0% 113588859 / 125987217 / -9.8% 0.90 / 0.84 / +7.6%
clickbench_q15/duckdb:parquet 86494292 / 89320026 / -3.2% 99524778 / 104706783 / -4.9% 0.87 / 0.85 / +1.9%
clickbench_q16/duckdb:parquet 162868725 / 163765163 / -0.5% 180681109 / 186929309 / -3.3% 0.90 / 0.88 / +2.9%
clickbench_q17/duckdb:parquet 163580536 / 174416621 / -6.2% 182457034 / 191929771 / -4.9% 0.90 / 0.91 / -1.3%
clickbench_q18/duckdb:parquet 295609178 / 306314922 / -3.5% 319530481 / 336120698 / -4.9% 0.93 / 0.91 / +1.5%
clickbench_q19/duckdb:parquet 19772822 / 22804753 / -13.3% 🟢 27366211 / 33051667 / -17.2% 🟢 0.72 / 0.69 / +4.7%
clickbench_q20/duckdb:parquet 190836712 / 193984474 / -1.6% 239915830 / 228863597 / +4.8% 0.80 / 0.85 / -6.2%
clickbench_q21/duckdb:parquet 226050356 / 232727746 / -2.9% 275080182 / 267269221 / +2.9% 0.82 / 0.87 / -5.6%
clickbench_q22/duckdb:parquet 304457398 / 327830072 / -7.1% 357167776 / 365058160 / -2.2% 0.85 / 0.90 / -5.1%
clickbench_q23/duckdb:parquet 177644474 / 173484392 / +2.4% 245220032 / 253553249 / -3.3% 0.72 / 0.68 / +5.9%
clickbench_q24/duckdb:parquet 30740464 / 33359956 / -7.9% 42912695 / 46821678 / -8.3% 0.72 / 0.71 / +0.5%
clickbench_q25/duckdb:parquet 41649219 / 44717390 / -6.9% 60350262 / 65015094 / -7.2% 0.69 / 0.69 / +0.3%
clickbench_q26/duckdb:parquet 30310794 / 34838712 / -13.0% 🟢 45948871 / 47820073 / -3.9% 0.66 / 0.73 / -9.5%
clickbench_q27/duckdb:parquet 192391824 / 197932678 / -2.8% 224770159 / 227035389 / -1.0% 0.86 / 0.87 / -1.8%
clickbench_q28/duckdb:parquet 960282900 / 987384628 / -2.7% 946156182 / 980716872 / -3.5% 1.01 / 1.01 / +0.8%
clickbench_q29/duckdb:parquet 24676718 / 27217407 / -9.3% 30216500 / 35627211 / -15.2% 🟢 0.82 / 0.76 / +6.9%
clickbench_q30/duckdb:parquet 105355908 / 109824941 / -4.1% 126838420 / 137166477 / -7.5% 0.83 / 0.80 / +3.7%
clickbench_q31/duckdb:parquet 136691206 / 164482208 / -16.9% 🟢 173885016 / 186126404 / -6.6% 0.79 / 0.88 / -11.0%
clickbench_q32/duckdb:parquet 394549230 / 404382000 / -2.4% 420981530 / 422229834 / -0.3% 0.94 / 0.96 / -2.1%
clickbench_q33/duckdb:parquet 462036362 / 501597886 / -7.9% 460449959 / 473334360 / -2.7% 1.00 / 1.06 / -5.3%
clickbench_q34/duckdb:parquet 462512402 / 479851844 / -3.6% 464778079 / 476306335 / -2.4% 1.00 / 1.01 / -1.2%
clickbench_q35/duckdb:parquet 60843838 / 64446888 / -5.6% 72083587 / 80862216 / -10.9% 🟢 0.84 / 0.80 / +5.9%
clickbench_q36/duckdb:parquet 30127440 / 32935972 / -8.5% 35725290 / 41798834 / -14.5% 🟢 0.84 / 0.79 / +7.0%
clickbench_q37/duckdb:parquet 23257590 / 26633113 / -12.7% 🟢 29477476 / 34621196 / -14.9% 🟢 0.79 / 0.77 / +2.6%
clickbench_q38/duckdb:parquet 23618274 / 27213860 / -13.2% 🟢 29335825 / 35031235 / -16.3% 🟢 0.81 / 0.78 / +3.6%
clickbench_q39/duckdb:parquet 53339908 / 54967638 / -3.0% 60687263 / 65958979 / -8.0% 0.88 / 0.83 / +5.5%
clickbench_q40/duckdb:parquet 14447284 / 16831267 / -14.2% 🟢 20869625 / 25504925 / -18.2% 🟢 0.69 / 0.66 / +4.9%
clickbench_q41/duckdb:parquet 16285150 / 17266097 / -5.7% 20316357 / 24314544 / -16.4% 🟢 0.80 / 0.71 / +12.9%
clickbench_q42/duckdb:parquet 15178753 / 16820014 / -9.8% 20173692 / 26010287 / -22.4% 🟢 0.75 / 0.65 / +16.4%

@github-actions

github-actions Bot commented Oct 31, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR bb6955d4 vs base 96fc43df
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -9.0%
Engines: DataFusion No clear signal (-17.5%, environment too noisy confidence) · DuckDB No clear signal (+0.3%, environment too noisy confidence)
Vortex (geomean): hot 0.847x ➖ · cold 0.916x ➖
Parquet (geomean): hot 0.931x ➖ · cold 0.919x ➖
Shifts: Parquet (control) -6.9% · Median polish -5.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.772x ➖, 5↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 214768471 / 230414648 / -6.8% 739391479 / 1053507169 / -29.8% 0.29 / 0.22 / +32.8%
tpch_q02/datafusion:vortex-file-compressed 324595290 / 855691118 / -62.1% 🟢 650514783 / 1172453587 / -44.5% 🟢 0.50 / 0.73 / -31.6%
tpch_q03/datafusion:vortex-file-compressed 309745410 / 406575470 / -23.8% 1092770709 / 884316337 / +23.6% 0.28 / 0.46 / -38.3%
tpch_q04/datafusion:vortex-file-compressed 170982775 / 920504629 / -81.4% 🟢 452910505 / 580498369 / -22.0% 0.38 / 1.59 / -76.2%
tpch_q05/datafusion:vortex-file-compressed 366253668 / 392257455 / -6.6% 539946654 / 630299832 / -14.3% 0.68 / 0.62 / +9.0%
tpch_q06/datafusion:vortex-file-compressed 138515714 / 143208103 / -3.3% 462146083 / 314962103 / +46.7% 🔴 0.30 / 0.45 / -34.1%
tpch_q07/datafusion:vortex-file-compressed 437569762 / 537717592 / -18.6% 797624545 / 723566651 / +10.2% 0.55 / 0.74 / -26.2%
tpch_q08/datafusion:vortex-file-compressed 424321194 / 530098976 / -20.0% 660721259 / 888057419 / -25.6% 0.64 / 0.60 / +7.6%
tpch_q09/datafusion:vortex-file-compressed 308198078 / 338699212 / -9.0% 475374053 / 465160394 / +2.2% 0.65 / 0.73 / -11.0%
tpch_q10/datafusion:vortex-file-compressed 377049291 / 368189876 / +2.4% 591321043 / 565010064 / +4.7% 0.64 / 0.65 / -2.2%
tpch_q11/datafusion:vortex-file-compressed 291483357 / 281756323 / +3.5% 469960544 / 598520340 / -21.5% 0.62 / 0.47 / +31.8%
tpch_q12/datafusion:vortex-file-compressed 216949102 / 354044757 / -38.7% 🟢 370520133 / 524953702 / -29.4% 0.59 / 0.67 / -13.2%
tpch_q13/datafusion:vortex-file-compressed 112878994 / 170661699 / -33.9% 🟢 314503498 / 343334763 / -8.4% 0.36 / 0.50 / -27.8%
tpch_q14/datafusion:vortex-file-compressed 205286899 / 180025133 / +14.0% 396195768 / 318417148 / +24.4% 0.52 / 0.57 / -8.4%
tpch_q15/datafusion:vortex-file-compressed 296905846 / 318998273 / -6.9% 490992445 / 613185635 / -19.9% 0.60 / 0.52 / +16.2%
tpch_q16/datafusion:vortex-file-compressed 149003464 / 153322626 / -2.8% 298843960 / 278469062 / +7.3% 0.50 / 0.55 / -9.4%
tpch_q17/datafusion:vortex-file-compressed 260705770 / 320982693 / -18.8% 472191346 / 510105894 / -7.4% 0.55 / 0.63 / -12.3%
tpch_q18/datafusion:vortex-file-compressed 237014515 / 498354870 / -52.4% 🟢 430025699 / 1155655057 / -62.8% 🟢 0.55 / 0.43 / +27.8%
tpch_q19/datafusion:vortex-file-compressed 289838447 / 265426068 / +9.2% 450980620 / 426221456 / +5.8% 0.64 / 0.62 / +3.2%
tpch_q20/datafusion:vortex-file-compressed 260306097 / 302571361 / -14.0% 489016773 / 452743311 / +8.0% 0.53 / 0.67 / -20.4%
tpch_q21/datafusion:vortex-file-compressed 422947832 / 459046008 / -7.9% 709968686 / 818040485 / -13.2% 0.60 / 0.56 / +6.2%
tpch_q22/datafusion:vortex-file-compressed 160708822 / 188371226 / -14.7% 429698120 / 454726861 / -5.5% 0.37 / 0.41 / -9.7%
datafusion / parquet / ns (0.936x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 146116195 / 156764984 / -6.8% 578962915 / 633820468 / -8.7% 0.25 / 0.25 / +2.0%
tpch_q02/datafusion:parquet 274796649 / 285313789 / -3.7% 580492508 / 541828831 / +7.1% 0.47 / 0.53 / -10.1%
tpch_q03/datafusion:parquet 232360329 / 249096323 / -6.7% 707365291 / 785115083 / -9.9% 0.33 / 0.32 / +3.5%
tpch_q04/datafusion:parquet 148469048 / 221469527 / -33.0% 🟢 274830243 / 454449228 / -39.5% 🟢 0.54 / 0.49 / +10.9%
tpch_q05/datafusion:parquet 362938985 / 380340443 / -4.6% 576406502 / 519906971 / +10.9% 0.63 / 0.73 / -13.9%
tpch_q06/datafusion:parquet 106925639 / 145619895 / -26.6% 228074034 / 249681393 / -8.7% 0.47 / 0.58 / -19.6%
tpch_q07/datafusion:parquet 347121342 / 363740288 / -4.6% 506869500 / 455456362 / +11.3% 0.68 / 0.80 / -14.2%
tpch_q08/datafusion:parquet 445682153 / 466797613 / -4.5% 529184302 / 561443301 / -5.7% 0.84 / 0.83 / +1.3%
tpch_q09/datafusion:parquet 382605484 / 423649360 / -9.7% 515113304 / 600180795 / -14.2% 0.74 / 0.71 / +5.2%
tpch_q10/datafusion:parquet 320447219 / 382473187 / -16.2% 505570246 / 710994781 / -28.9% 0.63 / 0.54 / +17.8%
tpch_q11/datafusion:parquet 249416355 / 270798217 / -7.9% 341542378 / 405657828 / -15.8% 0.73 / 0.67 / +9.4%
tpch_q12/datafusion:parquet 167988625 / 175262407 / -4.2% 296574619 / 473301629 / -37.3% 🟢 0.57 / 0.37 / +53.0%
tpch_q13/datafusion:parquet 272153203 / 276713785 / -1.6% 515439180 / 459642020 / +12.1% 0.53 / 0.60 / -12.3%
tpch_q14/datafusion:parquet 157989665 / 175145323 / -9.8% 280780895 / 335490127 / -16.3% 0.56 / 0.52 / +7.8%
tpch_q15/datafusion:parquet 304066010 / 314944722 / -3.5% 457310075 / 462445871 / -1.1% 0.66 / 0.68 / -2.4%
tpch_q16/datafusion:parquet 100992904 / 101461398 / -0.5% 199098020 / 248544806 / -19.9% 0.51 / 0.41 / +24.3%
tpch_q17/datafusion:parquet 273352334 / 305960798 / -10.7% 426899517 / 517172645 / -17.5% 0.64 / 0.59 / +8.2%
tpch_q18/datafusion:parquet 457710328 / 334219228 / +36.9% 🔴 710232135 / 678490939 / +4.7% 0.64 / 0.49 / +30.8%
tpch_q19/datafusion:parquet 171480799 / 166164751 / +3.2% 284422176 / 294640691 / -3.5% 0.60 / 0.56 / +6.9%
tpch_q20/datafusion:parquet 238005561 / 246299540 / -3.4% 414372304 / 378991723 / +9.3% 0.57 / 0.65 / -11.6%
tpch_q21/datafusion:parquet 345990413 / 332012304 / +4.2% 437409122 / 515426178 / -15.1% 0.79 / 0.64 / +22.8%
tpch_q22/datafusion:parquet 154318523 / 173504109 / -11.1% 301969383 / 310419768 / -2.7% 0.51 / 0.56 / -8.6%
duckdb / vortex-file-compressed / ns (0.928x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 240847622 / 246646866 / -2.4% 285895630 / 245728427 / +16.3% 0.84 / 1.00 / -16.1%
tpch_q02/duckdb:vortex-file-compressed 418114005 / 411811548 / +1.5% 462381972 / 445973828 / +3.7% 0.90 / 0.92 / -2.1%
tpch_q03/duckdb:vortex-file-compressed 441853934 / 609270310 / -27.5% 555757847 / 711077994 / -21.8% 0.80 / 0.86 / -7.2%
tpch_q04/duckdb:vortex-file-compressed 267354877 / 314440665 / -15.0% 315558271 / 291247751 / +8.3% 0.85 / 1.08 / -21.5%
tpch_q05/duckdb:vortex-file-compressed 557922893 / 620628745 / -10.1% 610117193 / 661042267 / -7.7% 0.91 / 0.94 / -2.6%
tpch_q06/duckdb:vortex-file-compressed 185623289 / 170610386 / +8.8% 199712086 / 199673823 / +0.0% 0.93 / 0.85 / +8.8%
tpch_q07/duckdb:vortex-file-compressed 506577691 / 443002882 / +14.4% 514059255 / 559668903 / -8.1% 0.99 / 0.79 / +24.5%
tpch_q08/duckdb:vortex-file-compressed 580478476 / 665735574 / -12.8% 665174796 / 642961276 / +3.5% 0.87 / 1.04 / -15.7%
tpch_q09/duckdb:vortex-file-compressed 422212501 / 398913879 / +5.8% 495190741 / 462701981 / +7.0% 0.85 / 0.86 / -1.1%
tpch_q10/duckdb:vortex-file-compressed 529693188 / 560480213 / -5.5% 500457640 / 599566134 / -16.5% 1.06 / 0.93 / +13.2%
tpch_q11/duckdb:vortex-file-compressed 307391900 / 293594820 / +4.7% 327222954 / 303401991 / +7.9% 0.94 / 0.97 / -2.9%
tpch_q12/duckdb:vortex-file-compressed 242825909 / 234471345 / +3.6% 265270182 / 321701487 / -17.5% 0.92 / 0.73 / +25.6%
tpch_q13/duckdb:vortex-file-compressed 236633189 / 296966439 / -20.3% 240884111 / 312188923 / -22.8% 0.98 / 0.95 / +3.3%
tpch_q14/duckdb:vortex-file-compressed 235263265 / 297430508 / -20.9% 292576586 / 338281740 / -13.5% 0.80 / 0.88 / -8.5%
tpch_q15/duckdb:vortex-file-compressed 248842980 / 257709466 / -3.4% 306489597 / 284028283 / +7.9% 0.81 / 0.91 / -10.5%
tpch_q16/duckdb:vortex-file-compressed 200047123 / 224558671 / -10.9% 221510652 / 245016833 / -9.6% 0.90 / 0.92 / -1.5%
tpch_q17/duckdb:vortex-file-compressed 341942563 / 328652255 / +4.0% 325197114 / 373632177 / -13.0% 1.05 / 0.88 / +19.5%
tpch_q18/duckdb:vortex-file-compressed 353024320 / 531740031 / -33.6% 🟢 416380013 / 751913031 / -44.6% 🟢 0.85 / 0.71 / +19.9%
tpch_q19/duckdb:vortex-file-compressed 285755238 / 309370466 / -7.6% 527208796 / 326805129 / +61.3% 🔴 0.54 / 0.95 / -42.7%
tpch_q20/duckdb:vortex-file-compressed 378679462 / 369657309 / +2.4% 444329933 / 444958135 / -0.1% 0.85 / 0.83 / +2.6%
tpch_q21/duckdb:vortex-file-compressed 650780265 / 848051523 / -23.3% 710243597 / 694729562 / +2.2% 0.92 / 1.22 / -24.9%
tpch_q22/duckdb:vortex-file-compressed 254440189 / 229176511 / +11.0% 263309499 / 333503086 / -21.0% 0.97 / 0.69 / +40.6%
duckdb / parquet / ns (0.926x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 164901464 / 217015597 / -24.0% 271673680 / 296936031 / -8.5% 0.61 / 0.73 / -16.9%
tpch_q02/duckdb:parquet 416989518 / 481701942 / -13.4% 469219583 / 468476765 / +0.2% 0.89 / 1.03 / -13.6%
tpch_q03/duckdb:parquet 366654492 / 410524865 / -10.7% 486732854 / 544842712 / -10.7% 0.75 / 0.75 / -0.0%
tpch_q04/duckdb:parquet 299563086 / 275660525 / +8.7% 489183455 / 355695510 / +37.5% 🔴 0.61 / 0.77 / -21.0%
tpch_q05/duckdb:parquet 535680005 / 583197013 / -8.1% 554820252 / 864394454 / -35.8% 🟢 0.97 / 0.67 / +43.1%
tpch_q06/duckdb:parquet 152245705 / 175276279 / -13.1% 178532012 / 192794276 / -7.4% 0.85 / 0.91 / -6.2%
tpch_q07/duckdb:parquet 539427337 / 538377650 / +0.2% 601163923 / 559018492 / +7.5% 0.90 / 0.96 / -6.8%
tpch_q08/duckdb:parquet 561127846 / 629691944 / -10.9% 591416592 / 777294770 / -23.9% 0.95 / 0.81 / +17.1%
tpch_q09/duckdb:parquet 595491214 / 602839224 / -1.2% 562105972 / 623130839 / -9.8% 1.06 / 0.97 / +9.5%
tpch_q10/duckdb:parquet 567271853 / 539976248 / +5.1% 623387430 / 636352685 / -2.0% 0.91 / 0.85 / +7.2%
tpch_q11/duckdb:parquet 306096046 / 303940533 / +0.7% 350850612 / 294440801 / +19.2% 0.87 / 1.03 / -15.5%
tpch_q12/duckdb:parquet 223320671 / 250544781 / -10.9% 259529877 / 288200376 / -9.9% 0.86 / 0.87 / -1.0%
tpch_q13/duckdb:parquet 374975492 / 389135547 / -3.6% 455179728 / 517637307 / -12.1% 0.82 / 0.75 / +9.6%
tpch_q14/duckdb:parquet 230952478 / 258549092 / -10.7% 299242425 / 296898930 / +0.8% 0.77 / 0.87 / -11.4%
tpch_q15/duckdb:parquet 206745052 / 239628719 / -13.7% 242854249 / 255108125 / -4.8% 0.85 / 0.94 / -9.4%
tpch_q16/duckdb:parquet 273995153 / 284183742 / -3.6% 306797392 / 321572036 / -4.6% 0.89 / 0.88 / +1.1%
tpch_q17/duckdb:parquet 293560456 / 268039654 / +9.5% 378398451 / 334024100 / +13.3% 0.78 / 0.80 / -3.3%
tpch_q18/duckdb:parquet 312097878 / 395407565 / -21.1% 333862277 / 409732492 / -18.5% 0.93 / 0.97 / -3.1%
tpch_q19/duckdb:parquet 258120774 / 320443854 / -19.4% 323106905 / 353592167 / -8.6% 0.80 / 0.91 / -11.8%
tpch_q20/duckdb:parquet 466084515 / 534998062 / -12.9% 511840315 / 611000386 / -16.2% 0.91 / 0.88 / +4.0%
tpch_q21/duckdb:parquet 431349948 / 453736300 / -4.9% 479675839 / 522414668 / -8.2% 0.90 / 0.87 / +3.5%
tpch_q22/duckdb:parquet 337039188 / 319511956 / +5.5% 344648770 / 400728120 / -14.0% 0.98 / 0.80 / +22.6%

@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 31, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 31, 2026
@codspeed

codspeed Bot commented Oct 31, 2026 •

Copy link
Copy Markdown

Merging this PR will not alter performance

1 warning

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

✅ 2307 untouched benchmarks
⏩ 38 skipped benchmarks1


Comparing ji/clickbench-q23 (bb6955d) with develop (246a397)

Open in CodSpeed

Footnotes

  1. 38 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

joseph-isaacs and others added 3 commits October 31, 2026 13:30
Inline roots shared one session, and the run clears a root's session when the root retires. Once the first root finished, the remaining roots waited for reads that were never issued.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01MZ3d6HFyGGeUGy8brEr6BM
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Evaluate TopK and hash join dynamic filters in the V2 file scan, so zones and rows are dropped before the engine sees them. The producing operator keeps enforcing them. V1 scans keep them out.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01MZ3d6HFyGGeUGy8brEr6BM
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
A join's hash table lookup has no Vortex equivalent, so one unconvertible conjunct turned the whole filter into a constant true and its bounds were lost. Convert each conjunct alone and keep the ones that convert.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01MZ3d6HFyGGeUGy8brEr6BM
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 31, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 31, 2026
joseph-isaacs and others added 2 commits November 3, 2026 10:48
A join's dynamic filter bounds its probe keys with key >= min AND key <= max. Each
comparison decoded the key column again, and the scan's between rewrite only ran on
static filters, so the bounds now merge into one between when the filter is read.

TPC-DS SF10, 10 join queries against the previous commit: geomean 0.972, Q69 and Q10
0.93, none slower than 1.007.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01MZ3d6HFyGGeUGy8brEr6BM
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
A scan of at most one filtered chunk evaluates its conjuncts on that chunk next, so
pruning its zones first saves little and delays the chunk, and pruning a dynamic conjunct
proves its current predicate over the zones again. DataFusion splits small join probes into
many such scans. Larger scans keep pruning their dynamic conjuncts: skipping it for every
scan made TPC-DS SF10 Q82 and Q37 3.4-3.7x slower.

TPC-DS, all 99 queries against the previous commit: SF1 geomean 0.97, SF10 0.99 on best
runs and 1.01 on medians; the SF10 outliers were flat when rerun.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01MZ3d6HFyGGeUGy8brEr6BM
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 3, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 3, 2026
joseph-isaacs added a commit that referenced this pull request Nov 3, 2026
Ported from #10789 into the combined V2 scan perf branch. Kept the branch's ScanCache OnceCell API, chunk sizing (#10964) and filter planner (#11073/#11087); added the cores-per-reader concurrency and inline gate, per-root sessions in chunk tasks, batch-before-poll IO registration, MaskScan (wrapped inside the branch's ActiveConjunct and timed prune planner), one-scan windowed ProjectionMorsel for filtered chunks, the optimizer rules and V2_MIN_ROWS_PER_PARTITION; concurrency only shrinks filtered chunks (floor 64Ki), dropped projected_rows_per_chunk since unfiltered projections keep streaming stored batches in 1Mi chunks.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniBBQHsaCfMVb8tMFxK5
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
robert3005
robert3005 previously approved these changes Nov 3, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants