Skip to content

Stream unfiltered Scan V2 projections in larger chunks - #11142

Draft
joseph-isaacs wants to merge 1 commit into
developfrom
ji/scan-v2-stream-unfiltered
Draft

joseph-isaacs wants to merge 1 commit into
developfrom
ji/scan-v2-stream-unfiltered

Conversation

@joseph-isaacs

Copy link
Copy Markdown
Contributor

Summary

Split out of #10964 as an independently measurable piece.

Unfiltered projections planned 65,536-row work chunks and gathered each chunk's stored batches into one array. That repeated planning for every chunk and copied across stored boundaries during conversion.

Changes

  • Projection chunks are up to 1,048,576 rows. Each stored batch is emitted as it is produced, keeping its stored boundaries and encodings.
  • The byte budget still shrinks full-file projections of wide rows, now also when the scan is filtered.
  • Filtered projections still gather their pieces into one batch.
  • Tests cover stored batches streaming within one work chunk, and a large stored batch that is not subdivided.

Local validation

4 vCPU cloud VM, TPC-H SF10 Vortex files, Scan V2, 2 alternating (ABBA) rounds × 5 iterations against develop (246a397). Base-vs-base noise: +1.3% geomean, up to ±8% per query.

Engine Geomean of medians Geomean of mins
DuckDB -3.3% -0.5%

TPC-H has few unfiltered projections. DataFusion TPC-H and ClickBench runs are still in progress locally.

  • cargo nextest run -p vortex-layout: 737 passed.
  • Pinned-nightly rustfmt --check on changed files: clean.
  • cargo clippy: not yet run.

Generated by Claude Code

Unfiltered projections planned 65,536-row work chunks and gathered each chunk's stored batches
into one array, which repeated planning and setup for every chunk and copied across stored
boundaries during conversion. Plan up to 1,048,576 rows per projection chunk and emit each
stored batch as it is produced, so planning is amortized and batches keep their stored
boundaries and encodings. The byte budget still shrinks full-file projections of wide rows,
now also when the scan is filtered, and filtered projections still gather their pieces.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniB9gdaaoxAeUkYj48Q3
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added changelog/performance A performance improvement action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Nov 3, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 3, 2026
@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 325bbe4 fineweb 1 Explore Profiling Data
🟢 Done 325bbe4 polarsignals 1 Explore Profiling Data
🟢 Done 325bbe4 tpcds-nvme 1 Explore Profiling Data
🟢 Done 325bbe4 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 325bbe4 tpch-nvme 1 Explore Profiling Data
🟢 Done 325bbe4 tpch-s3 1 Explore Profiling Data
🟢 Done 325bbe4 clickbench-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 325bbe4f vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.8%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (-1.6%, low confidence)
Vortex (geomean): hot 0.993x ➖ · cold 0.996x ➖
Parquet (geomean): hot 1.002x ➖ · cold 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.996x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1248011 / 1223583 / +2.0% 23064132 / 22393554 / +3.0% 0.05 / 0.05 / -1.0%
clickbench_q01/datafusion:vortex-file-compressed 6186778 / 6046842 / +2.3% 30780693 / 29592395 / +4.0% 0.20 / 0.20 / -1.6%
clickbench_q02/datafusion:vortex-file-compressed 10761038 / 10531240 / +2.2% 36229116 / 46036487 / -21.3% 🟢 0.30 / 0.23 / +29.8%
clickbench_q03/datafusion:vortex-file-compressed 13831948 / 12387916 / +11.7% 🔴 52995490 / 56727916 / -6.6% 0.26 / 0.22 / +19.5%
clickbench_q04/datafusion:vortex-file-compressed 55601934 / 58081216 / -4.3% 94069289 / 103589636 / -9.2% 0.59 / 0.56 / +5.4%
clickbench_q05/datafusion:vortex-file-compressed 75760908 / 79014320 / -4.1% 124965740 / 128484768 / -2.7% 0.61 / 0.61 / -1.4%
clickbench_q06/datafusion:vortex-file-compressed 1238155 / 1263943 / -2.0% 23251417 / 22422362 / +3.7% 0.05 / 0.06 / -5.5%
clickbench_q07/datafusion:vortex-file-compressed 9798501 / 9508768 / +3.0% 34616203 / 33881448 / +2.2% 0.28 / 0.28 / +0.9%
clickbench_q08/datafusion:vortex-file-compressed 76919184 / 79137674 / -2.8% 113549846 / 128803436 / -11.8% 🟢 0.68 / 0.61 / +10.3%
clickbench_q09/datafusion:vortex-file-compressed 169962306 / 173755480 / -2.2% 210064475 / 207375596 / +1.3% 0.81 / 0.84 / -3.4%
clickbench_q10/datafusion:vortex-file-compressed 23548796 / 23479735 / +0.3% 71533820 / 69620750 / +2.7% 0.33 / 0.34 / -2.4%
clickbench_q11/datafusion:vortex-file-compressed 25683404 / 26005739 / -1.2% 71120351 / 70384896 / +1.0% 0.36 / 0.37 / -2.3%
clickbench_q12/datafusion:vortex-file-compressed 72801157 / 75527217 / -3.6% 131089568 / 123896189 / +5.8% 0.56 / 0.61 / -8.9%
clickbench_q13/datafusion:vortex-file-compressed 118046088 / 115900178 / +1.9% 192163739 / 187353692 / +2.6% 0.61 / 0.62 / -0.7%
clickbench_q14/datafusion:vortex-file-compressed 74833117 / 75510882 / -0.9% 125555826 / 125936863 / -0.3% 0.60 / 0.60 / -0.6%
clickbench_q15/datafusion:vortex-file-compressed 61556994 / 63030918 / -2.3% 97943535 / 100187136 / -2.2% 0.63 / 0.63 / -0.1%
clickbench_q16/datafusion:vortex-file-compressed 149392759 / 155538995 / -4.0% 215576013 / 217221220 / -0.8% 0.69 / 0.72 / -3.2%
clickbench_q17/datafusion:vortex-file-compressed 150928176 / 155207311 / -2.8% 222987628 / 226552616 / -1.6% 0.68 / 0.69 / -1.2%
clickbench_q18/datafusion:vortex-file-compressed 297479141 / 294130736 / +1.1% 392758948 / 390830976 / +0.5% 0.76 / 0.75 / +0.6%
clickbench_q19/datafusion:vortex-file-compressed 8034200 / 8303792 / -3.2% 50158093 / 48242070 / +4.0% 0.16 / 0.17 / -6.9%
clickbench_q20/datafusion:vortex-file-compressed 65043182 / 71745774 / -9.3% 246105289 / 248435282 / -0.9% 0.26 / 0.29 / -8.5%
clickbench_q21/datafusion:vortex-file-compressed 81692117 / 79455405 / +2.8% 288499839 / 288506255 / -0.0% 0.28 / 0.28 / +2.8%
clickbench_q22/datafusion:vortex-file-compressed 90221794 / 91696814 / -1.6% 392569377 / 390845073 / +0.4% 0.23 / 0.23 / -2.0%
clickbench_q23/datafusion:vortex-file-compressed 184055380 / 183993637 / +0.0% 539394600 / 539539151 / -0.0% 0.34 / 0.34 / +0.1%
clickbench_q24/datafusion:vortex-file-compressed 15301460 / 15307686 / -0.0% 74195267 / 70032970 / +5.9% 0.21 / 0.22 / -5.6%
clickbench_q25/datafusion:vortex-file-compressed 19181674 / 19863486 / -3.4% 65090123 / 62923085 / +3.4% 0.29 / 0.32 / -6.6%
clickbench_q26/datafusion:vortex-file-compressed 16157556 / 16533236 / -2.3% 71136419 / 70743668 / +0.6% 0.23 / 0.23 / -2.8%
clickbench_q27/datafusion:vortex-file-compressed 103140084 / 101740724 / +1.4% 256802957 / 251569553 / +2.1% 0.40 / 0.40 / -0.7%
clickbench_q28/datafusion:vortex-file-compressed 557545029 / 562333160 / -0.9% 651262629 / 643537242 / +1.2% 0.86 / 0.87 / -2.0%
clickbench_q29/datafusion:vortex-file-compressed 26260768 / 24245137 / +8.3% 53617661 / 53670057 / -0.1% 0.49 / 0.45 / +8.4%
clickbench_q30/datafusion:vortex-file-compressed 56396496 / 57397381 / -1.7% 113582124 / 112998342 / +0.5% 0.50 / 0.51 / -2.2%
clickbench_q31/datafusion:vortex-file-compressed 65084396 / 65356445 / -0.4% 153980134 / 163081172 / -5.6% 0.42 / 0.40 / +5.5%
clickbench_q32/datafusion:vortex-file-compressed 283765504 / 290282297 / -2.2% 390197053 / 393223115 / -0.8% 0.73 / 0.74 / -1.5%
clickbench_q33/datafusion:vortex-file-compressed 330795650 / 324626808 / +1.9% 478089563 / 432328318 / +10.6% 🔴 0.69 / 0.75 / -7.9%
clickbench_q34/datafusion:vortex-file-compressed 328825076 / 324894899 / +1.2% 474386690 / 444404496 / +6.7% 0.69 / 0.73 / -5.2%
clickbench_q35/datafusion:vortex-file-compressed 55606728 / 56027504 / -0.8% 92141753 / 93654723 / -1.6% 0.60 / 0.60 / +0.9%
clickbench_q36/datafusion:vortex-file-compressed 37427644 / 37622886 / -0.5% 68752407 / 67872658 / +1.3% 0.54 / 0.55 / -1.8%
clickbench_q37/datafusion:vortex-file-compressed 21437432 / 21259280 / +0.8% 48186544 / 47424626 / +1.6% 0.44 / 0.45 / -0.8%
clickbench_q38/datafusion:vortex-file-compressed 13150018 / 13259514 / -0.8% 40613610 / 41723747 / -2.7% 0.32 / 0.32 / +1.9%
clickbench_q39/datafusion:vortex-file-compressed 78861638 / 78839799 / +0.0% 112505548 / 111367852 / +1.0% 0.70 / 0.71 / -1.0%
clickbench_q40/datafusion:vortex-file-compressed 10716493 / 10378568 / +3.3% 35790925 / 36528657 / -2.0% 0.30 / 0.28 / +5.4%
clickbench_q41/datafusion:vortex-file-compressed 10229380 / 9976754 / +2.5% 34127201 / 34471787 / -1.0% 0.30 / 0.29 / +3.6%
clickbench_q42/datafusion:vortex-file-compressed 10082790 / 10423952 / -3.3% 36200862 / 35196628 / +2.9% 0.28 / 0.30 / -6.0%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1261472 / 1245842 / +1.3% 49358698 / 49718186 / -0.7% 0.03 / 0.03 / +2.0%
clickbench_q01/datafusion:parquet 15945767 / 15975198 / -0.2% 66724453 / 66883453 / -0.2% 0.24 / 0.24 / +0.1%
clickbench_q02/datafusion:parquet 19049259 / 19024956 / +0.1% 81421043 / 81292366 / +0.2% 0.23 / 0.23 / -0.0%
clickbench_q03/datafusion:parquet 16891314 / 17560503 / -3.8% 79877147 / 79048536 / +1.0% 0.21 / 0.22 / -4.8%
clickbench_q04/datafusion:parquet 62614683 / 62657254 / -0.1% 126068989 / 129056405 / -2.3% 0.50 / 0.49 / +2.3%
clickbench_q05/datafusion:parquet 88311867 / 89388218 / -1.2% 155992999 / 157935497 / -1.2% 0.57 / 0.57 / +0.0%
clickbench_q06/datafusion:parquet 1289235 / 1247492 / +3.3% 50144816 / 49860473 / +0.6% 0.03 / 0.03 / +2.8%
clickbench_q07/datafusion:parquet 17007464 / 16844414 / +1.0% 66978902 / 67110170 / -0.2% 0.25 / 0.25 / +1.2%
clickbench_q08/datafusion:parquet 84181908 / 85805378 / -1.9% 162408610 / 160618520 / +1.1% 0.52 / 0.53 / -3.0%
clickbench_q09/datafusion:parquet 190885098 / 187483740 / +1.8% 262530473 / 273970246 / -4.2% 0.73 / 0.68 / +6.3%
clickbench_q10/datafusion:parquet 35847880 / 35933968 / -0.2% 99839673 / 99356253 / +0.5% 0.36 / 0.36 / -0.7%
clickbench_q11/datafusion:parquet 43222813 / 42619872 / +1.4% 109140478 / 107756386 / +1.3% 0.40 / 0.40 / +0.1%
clickbench_q12/datafusion:parquet 96279087 / 96266114 / +0.0% 161935696 / 162038776 / -0.1% 0.59 / 0.59 / +0.1%
clickbench_q13/datafusion:parquet 148308944 / 146539911 / +1.2% 229917006 / 227411999 / +1.1% 0.65 / 0.64 / +0.1%
clickbench_q14/datafusion:parquet 102392972 / 102721975 / -0.3% 174850589 / 174323102 / +0.3% 0.59 / 0.59 / -0.6%
clickbench_q15/datafusion:parquet 71771788 / 72072821 / -0.4% 135962483 / 130369029 / +4.3% 0.53 / 0.55 / -4.5%
clickbench_q16/datafusion:parquet 155500964 / 155655536 / -0.1% 236812175 / 242072681 / -2.2% 0.66 / 0.64 / +2.1%
clickbench_q17/datafusion:parquet 157260268 / 156748302 / +0.3% 237278849 / 234690281 / +1.1% 0.66 / 0.67 / -0.8%
clickbench_q18/datafusion:parquet 308920230 / 311937038 / -1.0% 416991693 / 429885360 / -3.0% 0.74 / 0.73 / +2.1%
clickbench_q19/datafusion:parquet 19000100 / 18985055 / +0.1% 77371119 / 76428879 / +1.2% 0.25 / 0.25 / -1.1%
clickbench_q20/datafusion:parquet 179952768 / 178201950 / +1.0% 280980771 / 277984119 / +1.1% 0.64 / 0.64 / -0.1%
clickbench_q21/datafusion:parquet 173850880 / 174353110 / -0.3% 297836106 / 298763106 / -0.3% 0.58 / 0.58 / +0.0%
clickbench_q22/datafusion:parquet 260537618 / 264644574 / -1.6% 421171460 / 427231380 / -1.4% 0.62 / 0.62 / -0.1%
clickbench_q23/datafusion:parquet 1010059124 / 1015310230 / -0.5% 1186128765 / 1186767292 / -0.1% 0.85 / 0.86 / -0.5%
clickbench_q24/datafusion:parquet 29673594 / 30461840 / -2.6% 88939788 / 89550560 / -0.7% 0.33 / 0.34 / -1.9%
clickbench_q25/datafusion:parquet 37408290 / 36461936 / +2.6% 102638445 / 103796692 / -1.1% 0.36 / 0.35 / +3.8%
clickbench_q26/datafusion:parquet 30047292 / 30640387 / -1.9% 88857525 / 89946311 / -1.2% 0.34 / 0.34 / -0.7%
clickbench_q27/datafusion:parquet 192838046 / 192726410 / +0.1% 286582064 / 288972174 / -0.8% 0.67 / 0.67 / +0.9%
clickbench_q28/datafusion:parquet 616986090 / 621473269 / -0.7% 709077022 / 715604342 / -0.9% 0.87 / 0.87 / +0.2%
clickbench_q29/datafusion:parquet 29010800 / 28657065 / +1.2% 93751666 / 90415523 / +3.7% 0.31 / 0.32 / -2.4%
clickbench_q30/datafusion:parquet 89550720 / 91351340 / -2.0% 172273705 / 172111509 / +0.1% 0.52 / 0.53 / -2.1%
clickbench_q31/datafusion:parquet 104555371 / 102634058 / +1.9% 196397846 / 198577852 / -1.1% 0.53 / 0.52 / +3.0%
clickbench_q32/datafusion:parquet 304586406 / 311819602 / -2.3% 422630872 / 434802281 / -2.8% 0.72 / 0.72 / +0.5%
clickbench_q33/datafusion:parquet 376395126 / 380089808 / -1.0% 480535886 / 473796518 / +1.4% 0.78 / 0.80 / -2.4%
clickbench_q34/datafusion:parquet 377084552 / 376914011 / +0.0% 480606796 / 477819866 / +0.6% 0.78 / 0.79 / -0.5%
clickbench_q35/datafusion:parquet 64967727 / 65520001 / -0.8% 122975367 / 122720394 / +0.2% 0.53 / 0.53 / -1.0%
clickbench_q36/datafusion:parquet 73362180 / 73697400 / -0.5% 135094254 / 136472185 / -1.0% 0.54 / 0.54 / +0.6%
clickbench_q37/datafusion:parquet 35774206 / 35543201 / +0.6% 90335006 / 91265731 / -1.0% 0.40 / 0.39 / +1.7%
clickbench_q38/datafusion:parquet 47827615 / 48184051 / -0.7% 107896062 / 110190286 / -2.1% 0.44 / 0.44 / +1.4%
clickbench_q39/datafusion:parquet 143177040 / 143896086 / -0.5% 211630145 / 213345420 / -0.8% 0.68 / 0.67 / +0.3%
clickbench_q40/datafusion:parquet 19753542 / 20053370 / -1.5% 77154334 / 78117633 / -1.2% 0.26 / 0.26 / -0.3%
clickbench_q41/datafusion:parquet 18577396 / 18881718 / -1.6% 76051817 / 76285755 / -0.3% 0.24 / 0.25 / -1.3%
clickbench_q42/datafusion:parquet 19098737 / 19347004 / -1.3% 75128999 / 74154859 / +1.3% 0.25 / 0.26 / -2.6%
duckdb / vortex-file-compressed / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2190730 / 2237106 / -2.1% 25299839 / 25307876 / -0.0% 0.09 / 0.09 / -2.0%
clickbench_q01/duckdb:vortex-file-compressed 7570389 / 7655398 / -1.1% 28207855 / 30911132 / -8.7% 0.27 / 0.25 / +8.4%
clickbench_q02/duckdb:vortex-file-compressed 8464647 / 9039239 / -6.4% 36200442 / 38103656 / -5.0% 0.23 / 0.24 / -1.4%
clickbench_q03/duckdb:vortex-file-compressed 13861636 / 14038454 / -1.3% 50598166 / 51361504 / -1.5% 0.27 / 0.27 / +0.2%
clickbench_q04/duckdb:vortex-file-compressed 56288592 / 55959632 / +0.6% 91099254 / 90702001 / +0.4% 0.62 / 0.62 / +0.1%
clickbench_q05/duckdb:vortex-file-compressed 64406118 / 63897903 / +0.8% 96695403 / 96923586 / -0.2% 0.67 / 0.66 / +1.0%
clickbench_q06/duckdb:vortex-file-compressed 2678999 / 2644494 / +1.3% 30725396 / 29217110 / +5.2% 0.09 / 0.09 / -3.7%
clickbench_q07/duckdb:vortex-file-compressed 9148666 / 9511088 / -3.8% 31491227 / 30810489 / +2.2% 0.29 / 0.31 / -5.9%
clickbench_q08/duckdb:vortex-file-compressed 69491526 / 69255778 / +0.3% 105266402 / 107914279 / -2.5% 0.66 / 0.64 / +2.9%
clickbench_q09/duckdb:vortex-file-compressed 91468660 / 92548142 / -1.2% 128847709 / 128409391 / +0.3% 0.71 / 0.72 / -1.5%
clickbench_q10/duckdb:vortex-file-compressed 27640420 / 27689274 / -0.2% 72424423 / 72148281 / +0.4% 0.38 / 0.38 / -0.6%
clickbench_q11/duckdb:vortex-file-compressed 31038044 / 30540370 / +1.6% 75215438 / 79204582 / -5.0% 0.41 / 0.39 / +7.0%
clickbench_q12/duckdb:vortex-file-compressed 72720714 / 69892491 / +4.0% 99824624 / 100654921 / -0.8% 0.73 / 0.69 / +4.9%
clickbench_q13/duckdb:vortex-file-compressed 125985760 / 127172012 / -0.9% 168403738 / 169732824 / -0.8% 0.75 / 0.75 / -0.2%
clickbench_q14/duckdb:vortex-file-compressed 75618768 / 74951316 / +0.9% 109283855 / 108241821 / +1.0% 0.69 / 0.69 / -0.1%
clickbench_q15/duckdb:vortex-file-compressed 76109810 / 75857344 / +0.3% 108919275 / 109421143 / -0.5% 0.70 / 0.69 / +0.8%
clickbench_q16/duckdb:vortex-file-compressed 135257558 / 133718120 / +1.2% 174395319 / 172972559 / +0.8% 0.78 / 0.77 / +0.3%
clickbench_q17/duckdb:vortex-file-compressed 138445680 / 139145834 / -0.5% 171966774 / 176256527 / -2.4% 0.81 / 0.79 / +2.0%
clickbench_q18/duckdb:vortex-file-compressed 258365003 / 261284120 / -1.1% 302182093 / 305972300 / -1.2% 0.85 / 0.85 / +0.1%
clickbench_q19/duckdb:vortex-file-compressed 9408348 / 9433455 / -0.3% 38026179 / 38621943 / -1.5% 0.25 / 0.24 / +1.3%
clickbench_q20/duckdb:vortex-file-compressed 66225418 / 67552078 / -2.0% 167905355 / 169737178 / -1.1% 0.39 / 0.40 / -0.9%
clickbench_q21/duckdb:vortex-file-compressed 83598952 / 85506677 / -2.2% 191385312 / 194027861 / -1.4% 0.44 / 0.44 / -0.9%
clickbench_q22/duckdb:vortex-file-compressed 172994824 / 176474637 / -2.0% 348457671 / 345523729 / +0.8% 0.50 / 0.51 / -2.8%
clickbench_q23/duckdb:vortex-file-compressed 40084190 / 41929978 / -4.4% 85724595 / 90293247 / -5.1% 0.47 / 0.46 / +0.7%
clickbench_q24/duckdb:vortex-file-compressed 13112535 / 14160536 / -7.4% 40370351 / 39660096 / +1.8% 0.32 / 0.36 / -9.0%
clickbench_q25/duckdb:vortex-file-compressed 19486340 / 19419968 / +0.3% 54301753 / 54403251 / -0.2% 0.36 / 0.36 / +0.5%
clickbench_q26/duckdb:vortex-file-compressed 11358316 / 11388071 / -0.3% 36255852 / 39205981 / -7.5% 0.31 / 0.29 / +7.9%
clickbench_q27/duckdb:vortex-file-compressed 52725507 / 55108350 / -4.3% 186677099 / 180380940 / +3.5% 0.28 / 0.31 / -7.6%
clickbench_q28/duckdb:vortex-file-compressed 512873855 / 516077988 / -0.6% 561529702 / 559514013 / +0.4% 0.91 / 0.92 / -1.0%
clickbench_q29/duckdb:vortex-file-compressed 16803836 / 16801554 / +0.0% 43614372 / 43120020 / +1.1% 0.39 / 0.39 / -1.1%
clickbench_q30/duckdb:vortex-file-compressed 60514298 / 60694336 / -0.3% 110861060 / 112438538 / -1.4% 0.55 / 0.54 / +1.1%
clickbench_q31/duckdb:vortex-file-compressed 110702244 / 110928932 / -0.2% 197202495 / 200481515 / -1.6% 0.56 / 0.55 / +1.5%
clickbench_q32/duckdb:vortex-file-compressed 370250768 / 376905062 / -1.8% 404602132 / 411978991 / -1.8% 0.92 / 0.91 / +0.0%
clickbench_q33/duckdb:vortex-file-compressed 344176854 / 346800168 / -0.8% 400890373 / 400039829 / +0.2% 0.86 / 0.87 / -1.0%
clickbench_q34/duckdb:vortex-file-compressed 352899344 / 358757820 / -1.6% 423649306 / 415394371 / +2.0% 0.83 / 0.86 / -3.5%
clickbench_q35/duckdb:vortex-file-compressed 57612144 / 57165394 / +0.8% 89558809 / 89565873 / -0.0% 0.64 / 0.64 / +0.8%
clickbench_q36/duckdb:vortex-file-compressed 11566038 / 11736720 / -1.5% 33486017 / 31701737 / +5.6% 0.35 / 0.37 / -6.7%
clickbench_q37/duckdb:vortex-file-compressed 8298884 / 8307028 / -0.1% 29434784 / 28390029 / +3.7% 0.28 / 0.29 / -3.6%
clickbench_q38/duckdb:vortex-file-compressed 8937184 / 9089105 / -1.7% 29285721 / 28411635 / +3.1% 0.31 / 0.32 / -4.6%
clickbench_q39/duckdb:vortex-file-compressed 19029596 / 18985566 / +0.2% 39076943 / 41519995 / -5.9% 0.49 / 0.46 / +6.5%
clickbench_q40/duckdb:vortex-file-compressed 7331326 / 7541189 / -2.8% 28202316 / 26930257 / +4.7% 0.26 / 0.28 / -7.2%
clickbench_q41/duckdb:vortex-file-compressed 8434647 / 8447401 / -0.2% 29138021 / 30600085 / -4.8% 0.29 / 0.28 / +4.9%
clickbench_q42/duckdb:vortex-file-compressed 7494303 / 7460622 / +0.5% 27773840 / 28688927 / -3.2% 0.27 / 0.26 / +3.8%
duckdb / parquet / ns (1.006x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9195700 / 9718106 / -5.4% 14541020 / 14404944 / +0.9% 0.63 / 0.67 / -6.3%
clickbench_q01/duckdb:parquet 15523058 / 15834801 / -2.0% 20299821 / 20779530 / -2.3% 0.76 / 0.76 / +0.3%
clickbench_q02/duckdb:parquet 22283992 / 22998262 / -3.1% 33121524 / 30933941 / +7.1% 0.67 / 0.74 / -9.5%
clickbench_q03/duckdb:parquet 23536738 / 22952789 / +2.5% 36921935 / 36373798 / +1.5% 0.64 / 0.63 / +1.0%
clickbench_q04/duckdb:parquet 62105210 / 61553110 / +0.9% 76768150 / 78571229 / -2.3% 0.81 / 0.78 / +3.3%
clickbench_q05/duckdb:parquet 84239168 / 82357820 / +2.3% 96296683 / 96778532 / -0.5% 0.87 / 0.85 / +2.8%
clickbench_q06/duckdb:parquet 20839535 / 20631596 / +1.0% 26721681 / 27932745 / -4.3% 0.78 / 0.74 / +5.6%
clickbench_q07/duckdb:parquet 17324858 / 17411882 / -0.5% 23744678 / 23086324 / +2.9% 0.73 / 0.75 / -3.3%
clickbench_q08/duckdb:parquet 74463482 / 74193970 / +0.4% 88010022 / 88499093 / -0.6% 0.85 / 0.84 / +0.9%
clickbench_q09/duckdb:parquet 103850040 / 102344946 / +1.5% 118575414 / 118287242 / +0.2% 0.88 / 0.87 / +1.2%
clickbench_q10/duckdb:parquet 41817356 / 41585957 / +0.6% 52412460 / 53914290 / -2.8% 0.80 / 0.77 / +3.4%
clickbench_q11/duckdb:parquet 47461508 / 46376690 / +2.3% 62828547 / 62469950 / +0.6% 0.76 / 0.74 / +1.8%
clickbench_q12/duckdb:parquet 91963650 / 93246466 / -1.4% 107244207 / 106709132 / +0.5% 0.86 / 0.87 / -1.9%
clickbench_q13/duckdb:parquet 152561172 / 151353115 / +0.8% 168205635 / 168774480 / -0.3% 0.91 / 0.90 / +1.1%
clickbench_q14/duckdb:parquet 104080525 / 101132109 / +2.9% 119717617 / 121484338 / -1.5% 0.87 / 0.83 / +4.4%
clickbench_q15/duckdb:parquet 86788801 / 87152113 / -0.4% 101900542 / 99157583 / +2.8% 0.85 / 0.88 / -3.1%
clickbench_q16/duckdb:parquet 161791558 / 161518198 / +0.2% 180610044 / 177677559 / +1.7% 0.90 / 0.91 / -1.5%
clickbench_q17/duckdb:parquet 167324500 / 163501751 / +2.3% 180931208 / 179044078 / +1.1% 0.92 / 0.91 / +1.3%
clickbench_q18/duckdb:parquet 293468860 / 297760434 / -1.4% 321148011 / 317638716 / +1.1% 0.91 / 0.94 / -2.5%
clickbench_q19/duckdb:parquet 20314546 / 20044906 / +1.3% 27458636 / 26219883 / +4.7% 0.74 / 0.76 / -3.2%
clickbench_q20/duckdb:parquet 184164941 / 190656931 / -3.4% 236838376 / 223372775 / +6.0% 0.78 / 0.85 / -8.9%
clickbench_q21/duckdb:parquet 220341906 / 221775748 / -0.6% 276601558 / 270636772 / +2.2% 0.80 / 0.82 / -2.8%
clickbench_q22/duckdb:parquet 320019720 / 316494844 / +1.1% 370829215 / 356496439 / +4.0% 0.86 / 0.89 / -2.8%
clickbench_q23/duckdb:parquet 175074856 / 172903391 / +1.3% 226323499 / 233746562 / -3.2% 0.77 / 0.74 / +4.6%
clickbench_q24/duckdb:parquet 33776682 / 30525626 / +10.7% 🔴 46256196 / 44919682 / +3.0% 0.73 / 0.68 / +7.5%
clickbench_q25/duckdb:parquet 42539552 / 43279324 / -1.7% 57124996 / 55176174 / +3.5% 0.74 / 0.78 / -5.1%
clickbench_q26/duckdb:parquet 30174458 / 29909380 / +0.9% 47420996 / 47593911 / -0.4% 0.64 / 0.63 / +1.3%
clickbench_q27/duckdb:parquet 195884952 / 190317469 / +2.9% 232294915 / 230460935 / +0.8% 0.84 / 0.83 / +2.1%
clickbench_q28/duckdb:parquet 959624804 / 966912630 / -0.8% 946563616 / 939906810 / +0.7% 1.01 / 1.03 / -1.5%
clickbench_q29/duckdb:parquet 24288322 / 23708308 / +2.4% 31654885 / 31487776 / +0.5% 0.77 / 0.75 / +1.9%
clickbench_q30/duckdb:parquet 106272342 / 107434616 / -1.1% 127416623 / 126651318 / +0.6% 0.83 / 0.85 / -1.7%
clickbench_q31/duckdb:parquet 158965050 / 146264200 / +8.7% 174505936 / 172955499 / +0.9% 0.91 / 0.85 / +7.7%
clickbench_q32/duckdb:parquet 386595012 / 392919146 / -1.6% 416081495 / 417034375 / -0.2% 0.93 / 0.94 / -1.4%
clickbench_q33/duckdb:parquet 481258336 / 489452036 / -1.7% 452671201 / 442277693 / +2.3% 1.06 / 1.11 / -3.9%
clickbench_q34/duckdb:parquet 481871055 / 466236417 / +3.4% 461050138 / 469010681 / -1.7% 1.05 / 0.99 / +5.1%
clickbench_q35/duckdb:parquet 62161782 / 61471326 / +1.1% 79445663 / 75534239 / +5.2% 0.78 / 0.81 / -3.9%
clickbench_q36/duckdb:parquet 30305726 / 30715884 / -1.3% 36275021 / 36664389 / -1.1% 0.84 / 0.84 / -0.3%
clickbench_q37/duckdb:parquet 23454732 / 23465799 / -0.0% 29915967 / 29463089 / +1.5% 0.78 / 0.80 / -1.6%
clickbench_q38/duckdb:parquet 24312942 / 23803284 / +2.1% 29321018 / 30067802 / -2.5% 0.83 / 0.79 / +4.7%
clickbench_q39/duckdb:parquet 52804576 / 53454965 / -1.2% 60785903 / 60267957 / +0.9% 0.87 / 0.89 / -2.1%
clickbench_q40/duckdb:parquet 14871227 / 14620130 / +1.7% 19990097 / 20417625 / -2.1% 0.74 / 0.72 / +3.9%
clickbench_q41/duckdb:parquet 15509253 / 15522580 / -0.1% 20276028 / 20561068 / -1.4% 0.76 / 0.75 / +1.3%
clickbench_q42/duckdb:parquet 14546672 / 14508395 / +0.3% 20881292 / 21329381 / -2.1% 0.70 / 0.68 / +2.4%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 325bbe4f vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (-1.1%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 0.998x ➖
Parquet (geomean): hot 1.001x ➖ · cold 0.996x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.989x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15725755 / 16263915 / -3.3% 40351616 / 44263199 / -8.8% 0.39 / 0.37 / +6.1%
tpch_q02/datafusion:vortex-file-compressed 16864308 / 16894974 / -0.2% 36039821 / 36611616 / -1.6% 0.47 / 0.46 / +1.4%
tpch_q03/datafusion:vortex-file-compressed 19550569 / 19527766 / +0.1% 47549244 / 49847443 / -4.6% 0.41 / 0.39 / +5.0%
tpch_q04/datafusion:vortex-file-compressed 10097064 / 10188611 / -0.9% 35080985 / 35817404 / -2.1% 0.29 / 0.28 / +1.2%
tpch_q05/datafusion:vortex-file-compressed 37210980 / 37541382 / -0.9% 66134932 / 67849249 / -2.5% 0.56 / 0.55 / +1.7%
tpch_q06/datafusion:vortex-file-compressed 6130576 / 5955274 / +2.9% 26926637 / 28481717 / -5.5% 0.23 / 0.21 / +8.9%
tpch_q07/datafusion:vortex-file-compressed 51098637 / 51398304 / -0.6% 79686649 / 82045194 / -2.9% 0.64 / 0.63 / +2.4%
tpch_q08/datafusion:vortex-file-compressed 51616745 / 51875388 / -0.5% 82664077 / 80701452 / +2.4% 0.62 / 0.64 / -2.9%
tpch_q09/datafusion:vortex-file-compressed 47241278 / 47995869 / -1.6% 74927906 / 80826300 / -7.3% 0.63 / 0.59 / +6.2%
tpch_q10/datafusion:vortex-file-compressed 17342123 / 17741482 / -2.3% 49292462 / 53082340 / -7.1% 0.35 / 0.33 / +5.3%
tpch_q11/datafusion:vortex-file-compressed 14133004 / 14031627 / +0.7% 32385699 / 33512469 / -3.4% 0.44 / 0.42 / +4.2%
tpch_q12/datafusion:vortex-file-compressed 18027309 / 18328359 / -1.6% 42583848 / 45157861 / -5.7% 0.42 / 0.41 / +4.3%
tpch_q13/datafusion:vortex-file-compressed 19565200 / 19616934 / -0.3% 38202863 / 38185157 / +0.0% 0.51 / 0.51 / -0.3%
tpch_q14/datafusion:vortex-file-compressed 14675696 / 14594152 / +0.6% 40061804 / 39735581 / +0.8% 0.37 / 0.37 / -0.3%
tpch_q15/datafusion:vortex-file-compressed 18781001 / 18763971 / +0.1% 44574881 / 43533246 / +2.4% 0.42 / 0.43 / -2.2%
tpch_q16/datafusion:vortex-file-compressed 18206027 / 18234276 / -0.2% 38334768 / 37635522 / +1.9% 0.47 / 0.48 / -2.0%
tpch_q17/datafusion:vortex-file-compressed 28431355 / 28378421 / +0.2% 58440092 / 61847418 / -5.5% 0.49 / 0.46 / +6.0%
tpch_q18/datafusion:vortex-file-compressed 35616063 / 35305543 / +0.9% 58427232 / 61599150 / -5.1% 0.61 / 0.57 / +6.4%
tpch_q19/datafusion:vortex-file-compressed 10154054 / 11827307 / -14.1% 🟢 38220227 / 35891404 / +6.5% 0.27 / 0.33 / -19.4%
tpch_q20/datafusion:vortex-file-compressed 20183260 / 20441467 / -1.3% 45665025 / 46957425 / -2.8% 0.44 / 0.44 / +1.5%
tpch_q21/datafusion:vortex-file-compressed 39012256 / 38735030 / +0.7% 74218170 / 69895942 / +6.2% 0.53 / 0.55 / -5.1%
tpch_q22/datafusion:vortex-file-compressed 10659278 / 10820078 / -1.5% 30077089 / 29933093 / +0.5% 0.35 / 0.36 / -2.0%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72077694 / 71895679 / +0.3% 87933150 / 90101832 / -2.4% 0.82 / 0.80 / +2.7%
tpch_q02/datafusion:parquet 76462722 / 76098843 / +0.5% 89790935 / 90855700 / -1.2% 0.85 / 0.84 / +1.7%
tpch_q03/datafusion:parquet 81404063 / 81802859 / -0.5% 103575179 / 104624570 / -1.0% 0.79 / 0.78 / +0.5%
tpch_q04/datafusion:parquet 39571276 / 39443450 / +0.3% 58763641 / 56105007 / +4.7% 0.67 / 0.70 / -4.2%
tpch_q05/datafusion:parquet 110030342 / 110243073 / -0.2% 136587827 / 137233632 / -0.5% 0.81 / 0.80 / +0.3%
tpch_q06/datafusion:parquet 31421525 / 31285870 / +0.4% 46633951 / 48958203 / -4.7% 0.67 / 0.64 / +5.4%
tpch_q07/datafusion:parquet 112987545 / 112628638 / +0.3% 143118751 / 140164965 / +2.1% 0.79 / 0.80 / -1.8%
tpch_q08/datafusion:parquet 116636469 / 117365432 / -0.6% 144555129 / 144858333 / -0.2% 0.81 / 0.81 / -0.4%
tpch_q09/datafusion:parquet 136872460 / 137648335 / -0.6% 165835579 / 165675523 / +0.1% 0.83 / 0.83 / -0.7%
tpch_q10/datafusion:parquet 103809984 / 104232599 / -0.4% 127255961 / 131557659 / -3.3% 0.82 / 0.79 / +3.0%
tpch_q11/datafusion:parquet 62064903 / 61117621 / +1.5% 80609649 / 83469534 / -3.4% 0.77 / 0.73 / +5.2%
tpch_q12/datafusion:parquet 63898850 / 63935260 / -0.1% 85122080 / 85713684 / -0.7% 0.75 / 0.75 / +0.6%
tpch_q13/datafusion:parquet 143423865 / 143039529 / +0.3% 163536922 / 163205266 / +0.2% 0.88 / 0.88 / +0.1%
tpch_q14/datafusion:parquet 47735672 / 47461665 / +0.6% 67963490 / 70523444 / -3.6% 0.70 / 0.67 / +4.4%
tpch_q15/datafusion:parquet 74095649 / 73406392 / +0.9% 92126717 / 92742867 / -0.7% 0.80 / 0.79 / +1.6%
tpch_q16/datafusion:parquet 43542884 / 43563928 / -0.0% 59119708 / 63270122 / -6.6% 0.74 / 0.69 / +7.0%
tpch_q17/datafusion:parquet 124811718 / 123301020 / +1.2% 143271698 / 147211074 / -2.7% 0.87 / 0.84 / +4.0%
tpch_q18/datafusion:parquet 121378510 / 121046192 / +0.3% 144194154 / 142737474 / +1.0% 0.84 / 0.85 / -0.7%
tpch_q19/datafusion:parquet 56957991 / 57598916 / -1.1% 82554384 / 84233107 / -2.0% 0.69 / 0.68 / +0.9%
tpch_q20/datafusion:parquet 78144388 / 77933849 / +0.3% 102862723 / 103206085 / -0.3% 0.76 / 0.76 / +0.6%
tpch_q21/datafusion:parquet 112951712 / 113408807 / -0.4% 138785996 / 138663269 / +0.1% 0.81 / 0.82 / -0.5%
tpch_q22/datafusion:parquet 51079861 / 52165988 / -2.1% 68790779 / 67936274 / +1.3% 0.74 / 0.77 / -3.3%
duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9358274 / 9761332 / -4.1% 20601902 / 18912466 / +8.9% 0.45 / 0.52 / -12.0%
tpch_q02/duckdb:vortex-file-compressed 15164590 / 15133618 / +0.2% 24984668 / 25240568 / -1.0% 0.61 / 0.60 / +1.2%
tpch_q03/duckdb:vortex-file-compressed 18705866 / 18478693 / +1.2% 34969830 / 35420760 / -1.3% 0.53 / 0.52 / +2.5%
tpch_q04/duckdb:vortex-file-compressed 12402537 / 12526559 / -1.0% 27695597 / 26797289 / +3.4% 0.45 / 0.47 / -4.2%
tpch_q05/duckdb:vortex-file-compressed 20283715 / 19984330 / +1.5% 37365622 / 35135251 / +6.3% 0.54 / 0.57 / -4.6%
tpch_q06/duckdb:vortex-file-compressed 4713842 / 4707229 / +0.1% 15151233 / 14897236 / +1.7% 0.31 / 0.32 / -1.5%
tpch_q07/duckdb:vortex-file-compressed 24871471 / 24433501 / +1.8% 40725311 / 40669053 / +0.1% 0.61 / 0.60 / +1.7%
tpch_q08/duckdb:vortex-file-compressed 21051657 / 21158117 / -0.5% 38557035 / 37360088 / +3.2% 0.55 / 0.57 / -3.6%
tpch_q09/duckdb:vortex-file-compressed 23095362 / 21780886 / +6.0% 39951354 / 39377115 / +1.5% 0.58 / 0.55 / +4.5%
tpch_q10/duckdb:vortex-file-compressed 22848245 / 23061494 / -0.9% 38918008 / 40021706 / -2.8% 0.59 / 0.58 / +1.9%
tpch_q11/duckdb:vortex-file-compressed 8165291 / 8190706 / -0.3% 17809391 / 17311375 / +2.9% 0.46 / 0.47 / -3.1%
tpch_q12/duckdb:vortex-file-compressed 14639795 / 14552453 / +0.6% 27284622 / 27518794 / -0.9% 0.54 / 0.53 / +1.5%
tpch_q13/duckdb:vortex-file-compressed 19648537 / 19645042 / +0.0% 32611521 / 32940206 / -1.0% 0.60 / 0.60 / +1.0%
tpch_q14/duckdb:vortex-file-compressed 11306701 / 11380023 / -0.6% 24311511 / 24837163 / -2.1% 0.47 / 0.46 / +1.5%
tpch_q15/duckdb:vortex-file-compressed 8619011 / 8545626 / +0.9% 20931533 / 20629863 / +1.5% 0.41 / 0.41 / -0.6%
tpch_q16/duckdb:vortex-file-compressed 16694264 / 16616443 / +0.5% 23474977 / 22882070 / +2.6% 0.71 / 0.73 / -2.1%
tpch_q17/duckdb:vortex-file-compressed 12658193 / 12625912 / +0.3% 28850196 / 26443070 / +9.1% 0.44 / 0.48 / -8.1%
tpch_q18/duckdb:vortex-file-compressed 24820430 / 24532908 / +1.2% 34368150 / 34479790 / -0.3% 0.72 / 0.71 / +1.5%
tpch_q19/duckdb:vortex-file-compressed 11615438 / 12047148 / -3.6% 26920066 / 25716209 / +4.7% 0.43 / 0.47 / -7.9%
tpch_q20/duckdb:vortex-file-compressed 14275469 / 14345954 / -0.5% 30769449 / 30444524 / +1.1% 0.46 / 0.47 / -1.5%
tpch_q21/duckdb:vortex-file-compressed 37543026 / 37122052 / +1.1% 57983820 / 57121904 / +1.5% 0.65 / 0.65 / -0.4%
tpch_q22/duckdb:vortex-file-compressed 16764843 / 16816566 / -0.3% 26200075 / 25979595 / +0.8% 0.64 / 0.65 / -1.1%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47750757 / 47858045 / -0.2% 54559099 / 54404459 / +0.3% 0.88 / 0.88 / -0.5%
tpch_q02/duckdb:parquet 48276305 / 48336474 / -0.1% 55113473 / 55353685 / -0.4% 0.88 / 0.87 / +0.3%
tpch_q03/duckdb:parquet 60426986 / 60227192 / +0.3% 68909382 / 68349323 / +0.8% 0.88 / 0.88 / -0.5%
tpch_q04/duckdb:parquet 34768845 / 34720265 / +0.1% 42939167 / 43310065 / -0.9% 0.81 / 0.80 / +1.0%
tpch_q05/duckdb:parquet 67149273 / 67254941 / -0.2% 77758028 / 77626992 / +0.2% 0.86 / 0.87 / -0.3%
tpch_q06/duckdb:parquet 21513664 / 21944900 / -2.0% 27567959 / 27248080 / +1.2% 0.78 / 0.81 / -3.1%
tpch_q07/duckdb:parquet 64065254 / 63950143 / +0.2% 73526835 / 73664982 / -0.2% 0.87 / 0.87 / +0.4%
tpch_q08/duckdb:parquet 75897923 / 75776774 / +0.2% 87058860 / 86626463 / +0.5% 0.87 / 0.87 / -0.3%
tpch_q09/duckdb:parquet 107941679 / 107707033 / +0.2% 119369094 / 119514067 / -0.1% 0.90 / 0.90 / +0.3%
tpch_q10/duckdb:parquet 105891508 / 105854709 / +0.0% 118994766 / 118365462 / +0.5% 0.89 / 0.89 / -0.5%
tpch_q11/duckdb:parquet 29388717 / 29396110 / -0.0% 35074139 / 34577937 / +1.4% 0.84 / 0.85 / -1.4%
tpch_q12/duckdb:parquet 37266537 / 37190745 / +0.2% 44369747 / 44080916 / +0.7% 0.84 / 0.84 / -0.4%
tpch_q13/duckdb:parquet 176079088 / 174943548 / +0.6% 182310531 / 181832631 / +0.3% 0.97 / 0.96 / +0.4%
tpch_q14/duckdb:parquet 42359200 / 42368298 / -0.0% 51140350 / 51640657 / -1.0% 0.83 / 0.82 / +1.0%
tpch_q15/duckdb:parquet 32650099 / 32604664 / +0.1% 41610748 / 41186217 / +1.0% 0.78 / 0.79 / -0.9%
tpch_q16/duckdb:parquet 47531668 / 47438886 / +0.2% 53350484 / 52839714 / +1.0% 0.89 / 0.90 / -0.8%
tpch_q17/duckdb:parquet 47875915 / 47948653 / -0.2% 57039858 / 56916284 / +0.2% 0.84 / 0.84 / -0.4%
tpch_q18/duckdb:parquet 74513899 / 74218067 / +0.4% 81158481 / 81836806 / -0.8% 0.92 / 0.91 / +1.2%
tpch_q19/duckdb:parquet 48573879 / 47859814 / +1.5% 56700837 / 54599501 / +3.8% 0.86 / 0.88 / -2.3%
tpch_q20/duckdb:parquet 63552909 / 63470737 / +0.1% 73724972 / 74451035 / -1.0% 0.86 / 0.85 / +1.1%
tpch_q21/duckdb:parquet 106696854 / 106811631 / -0.1% 117001240 / 115756341 / +1.1% 0.91 / 0.92 / -1.2%
tpch_q22/duckdb:parquet 50659009 / 50510487 / +0.3% 58990143 / 58832593 / +0.3% 0.86 / 0.86 / +0.0%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 325bbe4f vs base 246a397e
Vortex (geomean): hot 1.002x ➖ · cold 0.928x ➖


datafusion / vortex-file-compressed / ns (1.002x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44295418 / 44174877 / +0.3% 83048443 / 83381591 / -0.4% 0.53 / 0.53 / +0.7%
polarsignals_q01/datafusion:vortex-file-compressed 52657954 / 59498684 / -11.5% 🟢 107491368 / 113392846 / -5.2% 0.49 / 0.52 / -6.6%
polarsignals_q02/datafusion:vortex-file-compressed 12101533 / 11978216 / +1.0% 40137448 / 49588551 / -19.1% 🟢 0.30 / 0.24 / +24.8%
polarsignals_q03/datafusion:vortex-file-compressed 55120594 / 54233533 / +1.6% 110812844 / 112439358 / -1.4% 0.50 / 0.48 / +3.1%
polarsignals_q04/datafusion:vortex-file-compressed 9172238 / 9157702 / +0.2% 36653249 / 40279396 / -9.0% 0.25 / 0.23 / +10.1%
polarsignals_q05/datafusion:vortex-file-compressed 11486560 / 11581688 / -0.8% 40193958 / 44512288 / -9.7% 0.29 / 0.26 / +9.8%
polarsignals_q06/datafusion:vortex-file-compressed 22813700 / 23169506 / -1.5% 49352931 / 52769004 / -6.5% 0.46 / 0.44 / +5.3%
polarsignals_q07/datafusion:vortex-file-compressed 10466072 / 10570672 / -1.0% 38014902 / 41644590 / -8.7% 0.28 / 0.25 / +8.5%
polarsignals_q08/datafusion:vortex-file-compressed 109357861 / 97258934 / +12.4% 🔴 153392097 / 150877578 / +1.7% 0.71 / 0.64 / +10.6%
polarsignals_q09/datafusion:vortex-file-compressed 10051030 / 9737686 / +3.2% 34592784 / 39267571 / -11.9% 🟢 0.29 / 0.25 / +17.2%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 325bbe4f vs base 246a397e
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -6.1%
Engines: DataFusion No clear signal (-14.2%, environment too noisy confidence) · DuckDB No clear signal (+2.8%, environment too noisy confidence)
Vortex (geomean): hot 1.015x ➖ · cold 0.998x ➖
Parquet (geomean): hot 1.080x ➖ · cold 1.083x ➖
Shifts: Parquet (control) +8.0% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 212389677 / 220831264 / -3.8% 790146376 / 576458480 / +37.1% 🔴 0.27 / 0.38 / -29.8%
tpch_q02/datafusion:vortex-file-compressed 347959618 / 308669932 / +12.7% 659203715 / 674528013 / -2.3% 0.53 / 0.46 / +15.3%
tpch_q03/datafusion:vortex-file-compressed 381791945 / 347086704 / +10.0% 990403425 / 871608881 / +13.6% 0.39 / 0.40 / -3.2%
tpch_q04/datafusion:vortex-file-compressed 196920139 / 207021749 / -4.9% 427820698 / 422384755 / +1.3% 0.46 / 0.49 / -6.1%
tpch_q05/datafusion:vortex-file-compressed 382592080 / 425586511 / -10.1% 641559534 / 613441206 / +4.6% 0.60 / 0.69 / -14.0%
tpch_q06/datafusion:vortex-file-compressed 136948510 / 141424151 / -3.2% 297953950 / 371254228 / -19.7% 0.46 / 0.38 / +20.7%
tpch_q07/datafusion:vortex-file-compressed 381455201 / 462415225 / -17.5% 731050115 / 582547518 / +25.5% 0.52 / 0.79 / -34.3%
tpch_q08/datafusion:vortex-file-compressed 501421772 / 427390773 / +17.3% 589642731 / 601931393 / -2.0% 0.85 / 0.71 / +19.8%
tpch_q09/datafusion:vortex-file-compressed 285736364 / 268529658 / +6.4% 525623059 / 473357724 / +11.0% 0.54 / 0.57 / -4.2%
tpch_q10/datafusion:vortex-file-compressed 361104005 / 348508035 / +3.6% 482364677 / 528499094 / -8.7% 0.75 / 0.66 / +13.5%
tpch_q11/datafusion:vortex-file-compressed 282302799 / 257327413 / +9.7% 426615085 / 420659524 / +1.4% 0.66 / 0.61 / +8.2%
tpch_q12/datafusion:vortex-file-compressed 231372754 / 210715328 / +9.8% 392344209 / 429074710 / -8.6% 0.59 / 0.49 / +20.1%
tpch_q13/datafusion:vortex-file-compressed 131428184 / 131309055 / +0.1% 395405474 / 370354402 / +6.8% 0.33 / 0.35 / -6.3%
tpch_q14/datafusion:vortex-file-compressed 180294455 / 211521200 / -14.8% 387894691 / 383637559 / +1.1% 0.46 / 0.55 / -15.7%
tpch_q15/datafusion:vortex-file-compressed 304727484 / 292649172 / +4.1% 526094660 / 520914480 / +1.0% 0.58 / 0.56 / +3.1%
tpch_q16/datafusion:vortex-file-compressed 140528535 / 158770515 / -11.5% 257267981 / 318188188 / -19.1% 0.55 / 0.50 / +9.5%
tpch_q17/datafusion:vortex-file-compressed 298301190 / 307709054 / -3.1% 479711968 / 454845057 / +5.5% 0.62 / 0.68 / -8.1%
tpch_q18/datafusion:vortex-file-compressed 424813637 / 590427775 / -28.0% 735525832 / 723635830 / +1.6% 0.58 / 0.82 / -29.2%
tpch_q19/datafusion:vortex-file-compressed 246631955 / 216120746 / +14.1% 405426058 / 356996489 / +13.6% 0.61 / 0.61 / +0.5%
tpch_q20/datafusion:vortex-file-compressed 267748737 / 292443661 / -8.4% 449036648 / 509890552 / -11.9% 0.60 / 0.57 / +4.0%
tpch_q21/datafusion:vortex-file-compressed 530542327 / 456400316 / +16.2% 751137467 / 730212380 / +2.9% 0.71 / 0.63 / +13.0%
tpch_q22/datafusion:vortex-file-compressed 169857489 / 167024301 / +1.7% 391762658 / 388209621 / +0.9% 0.43 / 0.43 / +0.8%
datafusion / parquet / ns (1.157x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 161011136 / 150351198 / +7.1% 502377361 / 460460005 / +9.1% 0.32 / 0.33 / -1.8%
tpch_q02/datafusion:parquet 285682980 / 284014916 / +0.6% 581344577 / 458008198 / +26.9% 0.49 / 0.62 / -20.8%
tpch_q03/datafusion:parquet 296366415 / 271007543 / +9.4% 682815174 / 753951884 / -9.4% 0.43 / 0.36 / +20.8%
tpch_q04/datafusion:parquet 165176252 / 133714329 / +23.5% 308197417 / 322406865 / -4.4% 0.54 / 0.41 / +29.2%
tpch_q05/datafusion:parquet 388280958 / 342356608 / +13.4% 563933772 / 468240904 / +20.4% 0.69 / 0.73 / -5.8%
tpch_q06/datafusion:parquet 152726078 / 112055911 / +36.3% 🔴 283194711 / 226141107 / +25.2% 0.54 / 0.50 / +8.8%
tpch_q07/datafusion:parquet 347853627 / 329957349 / +5.4% 534326527 / 516179984 / +3.5% 0.65 / 0.64 / +1.8%
tpch_q08/datafusion:parquet 461863215 / 432763020 / +6.7% 523335749 / 536690978 / -2.5% 0.88 / 0.81 / +9.4%
tpch_q09/datafusion:parquet 386622787 / 373806384 / +3.4% 551417176 / 539014441 / +2.3% 0.70 / 0.69 / +1.1%
tpch_q10/datafusion:parquet 341174923 / 309340609 / +10.3% 420953844 / 417479206 / +0.8% 0.81 / 0.74 / +9.4%
tpch_q11/datafusion:parquet 1596494141 / 261901027 / +509.6% 🔴 2050317309 / 373704730 / +448.6% 🔴 0.78 / 0.70 / +11.1%
tpch_q12/datafusion:parquet 202950872 / 162342440 / +25.0% 364965575 / 309500458 / +17.9% 0.56 / 0.52 / +6.0%
tpch_q13/datafusion:parquet 276145178 / 276376623 / -0.1% 478323874 / 436081873 / +9.7% 0.58 / 0.63 / -8.9%
tpch_q14/datafusion:parquet 143540528 / 157906152 / -9.1% 290349172 / 273555838 / +6.1% 0.49 / 0.58 / -14.4%
tpch_q15/datafusion:parquet 306824794 / 317865748 / -3.5% 478413019 / 523121657 / -8.5% 0.64 / 0.61 / +5.5%
tpch_q16/datafusion:parquet 102593171 / 111322386 / -7.8% 230255193 / 231410953 / -0.5% 0.45 / 0.48 / -7.4%
tpch_q17/datafusion:parquet 321082933 / 272274209 / +17.9% 785243281 / 526187695 / +49.2% 🔴 0.41 / 0.52 / -21.0%
tpch_q18/datafusion:parquet 336873035 / 341966792 / -1.5% 455130524 / 503106611 / -9.5% 0.74 / 0.68 / +8.9%
tpch_q19/datafusion:parquet 166483378 / 157601017 / +5.6% 294007902 / 273426259 / +7.5% 0.57 / 0.58 / -1.8%
tpch_q20/datafusion:parquet 232287263 / 235515300 / -1.4% 360328438 / 397076072 / -9.3% 0.64 / 0.59 / +8.7%
tpch_q21/datafusion:parquet 348104095 / 292874917 / +18.9% 733204743 / 463033836 / +58.3% 🔴 0.47 / 0.63 / -24.9%
tpch_q22/datafusion:parquet 155049812 / 160199804 / -3.2% 317009119 / 388871374 / -18.5% 0.49 / 0.41 / +18.7%
duckdb / vortex-file-compressed / ns (1.037x ➖, 0↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 248883000 / 247509334 / +0.6% 274499576 / 267181463 / +2.7% 0.91 / 0.93 / -2.1%
tpch_q02/duckdb:vortex-file-compressed 427202629 / 408988212 / +4.5% 477980248 / 495524216 / -3.5% 0.89 / 0.83 / +8.3%
tpch_q03/duckdb:vortex-file-compressed 414682078 / 416179552 / -0.4% 560793349 / 484765981 / +15.7% 0.74 / 0.86 / -13.9%
tpch_q04/duckdb:vortex-file-compressed 271619551 / 273734107 / -0.8% 293963293 / 309747374 / -5.1% 0.92 / 0.88 / +4.6%
tpch_q05/duckdb:vortex-file-compressed 785644764 / 585375507 / +34.2% 🔴 595627757 / 657952067 / -9.5% 1.32 / 0.89 / +48.3%
tpch_q06/duckdb:vortex-file-compressed 181931184 / 203012163 / -10.4% 236171718 / 217053599 / +8.8% 0.77 / 0.94 / -17.6%
tpch_q07/duckdb:vortex-file-compressed 422458440 / 433499388 / -2.5% 433289671 / 491006362 / -11.8% 0.98 / 0.88 / +10.4%
tpch_q08/duckdb:vortex-file-compressed 624313516 / 856662362 / -27.1% 717978186 / 924712147 / -22.4% 0.87 / 0.93 / -6.1%
tpch_q09/duckdb:vortex-file-compressed 655743972 / 430063376 / +52.5% 🔴 508090737 / 472261724 / +7.6% 1.29 / 0.91 / +41.7%
tpch_q10/duckdb:vortex-file-compressed 559767411 / 562615415 / -0.5% 634190394 / 577179328 / +9.9% 0.88 / 0.97 / -9.5%
tpch_q11/duckdb:vortex-file-compressed 417432473 / 295453825 / +41.3% 🔴 316815135 / 295294530 / +7.3% 1.32 / 1.00 / +31.7%
tpch_q12/duckdb:vortex-file-compressed 255884650 / 281391065 / -9.1% 298026286 / 342314564 / -12.9% 0.86 / 0.82 / +4.4%
tpch_q13/duckdb:vortex-file-compressed 227633214 / 257839733 / -11.7% 228295413 / 337095202 / -32.3% 🟢 1.00 / 0.76 / +30.4%
tpch_q14/duckdb:vortex-file-compressed 242663948 / 215999117 / +12.3% 388532337 / 312373489 / +24.4% 0.62 / 0.69 / -9.7%
tpch_q15/duckdb:vortex-file-compressed 251244159 / 339636073 / -26.0% 286522474 / 292926502 / -2.2% 0.88 / 1.16 / -24.4%
tpch_q16/duckdb:vortex-file-compressed 233631058 / 210376153 / +11.1% 225634233 / 230946559 / -2.3% 1.04 / 0.91 / +13.7%
tpch_q17/duckdb:vortex-file-compressed 566602556 / 324970756 / +74.4% 🔴 554870927 / 357086182 / +55.4% 🔴 1.02 / 0.91 / +12.2%
tpch_q18/duckdb:vortex-file-compressed 380206807 / 431733303 / -11.9% 393667041 / 402106068 / -2.1% 0.97 / 1.07 / -10.0%
tpch_q19/duckdb:vortex-file-compressed 281731863 / 303395982 / -7.1% 278573429 / 339697179 / -18.0% 1.01 / 0.89 / +13.2%
tpch_q20/duckdb:vortex-file-compressed 420178771 / 385636006 / +9.0% 437090003 / 483758671 / -9.6% 0.96 / 0.80 / +20.6%
tpch_q21/duckdb:vortex-file-compressed 663403043 / 656583605 / +1.0% 905769440 / 782358666 / +15.8% 0.73 / 0.84 / -12.7%
tpch_q22/duckdb:vortex-file-compressed 252733398 / 251855732 / +0.3% 247199632 / 334512025 / -26.1% 1.02 / 0.75 / +35.8%
duckdb / parquet / ns (1.009x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 225885654 / 152166910 / +48.4% 🔴 299390323 / 211204649 / +41.8% 🔴 0.75 / 0.72 / +4.7%
tpch_q02/duckdb:parquet 442519733 / 453471368 / -2.4% 446202075 / 426327264 / +4.7% 0.99 / 1.06 / -6.8%
tpch_q03/duckdb:parquet 429531736 / 358243434 / +19.9% 562027785 / 423368603 / +32.8% 🔴 0.76 / 0.85 / -9.7%
tpch_q04/duckdb:parquet 248611883 / 281717280 / -11.8% 311563940 / 332953926 / -6.4% 0.80 / 0.85 / -5.7%
tpch_q05/duckdb:parquet 568160623 / 536493872 / +5.9% 568688226 / 570606274 / -0.3% 1.00 / 0.94 / +6.3%
tpch_q06/duckdb:parquet 189992740 / 161239284 / +17.8% 215465819 / 206658661 / +4.3% 0.88 / 0.78 / +13.0%
tpch_q07/duckdb:parquet 428738582 / 436361603 / -1.7% 439684411 / 493434333 / -10.9% 0.98 / 0.88 / +10.3%
tpch_q08/duckdb:parquet 650422130 / 631844333 / +2.9% 705465531 / 652757052 / +8.1% 0.92 / 0.97 / -4.8%
tpch_q09/duckdb:parquet 549252157 / 564743109 / -2.7% 696748240 / 620443574 / +12.3% 0.79 / 0.91 / -13.4%
tpch_q10/duckdb:parquet 664050543 / 581110821 / +14.3% 615328209 / 636456873 / -3.3% 1.08 / 0.91 / +18.2%
tpch_q11/duckdb:parquet 256445931 / 285994921 / -10.3% 289417496 / 263711609 / +9.7% 0.89 / 1.08 / -18.3%
tpch_q12/duckdb:parquet 217991893 / 252866750 / -13.8% 254159696 / 291902719 / -12.9% 0.86 / 0.87 / -1.0%
tpch_q13/duckdb:parquet 342391634 / 369355879 / -7.3% 528353781 / 429176067 / +23.1% 0.65 / 0.86 / -24.7%
tpch_q14/duckdb:parquet 231499917 / 269935408 / -14.2% 318978458 / 344984516 / -7.5% 0.73 / 0.78 / -7.2%
tpch_q15/duckdb:parquet 194766373 / 212505719 / -8.3% 188586435 / 228893439 / -17.6% 1.03 / 0.93 / +11.2%
tpch_q16/duckdb:parquet 280076888 / 275747511 / +1.6% 353611720 / 327100698 / +8.1% 0.79 / 0.84 / -6.0%
tpch_q17/duckdb:parquet 270147664 / 263952606 / +2.3% 315261187 / 331901361 / -5.0% 0.86 / 0.80 / +7.7%
tpch_q18/duckdb:parquet 420729834 / 382490629 / +10.0% 392193241 / 393794532 / -0.4% 1.07 / 0.97 / +10.4%
tpch_q19/duckdb:parquet 241727737 / 266061746 / -9.1% 287136352 / 345007366 / -16.8% 0.84 / 0.77 / +9.2%
tpch_q20/duckdb:parquet 446450288 / 448150426 / -0.4% 452985744 / 480087501 / -5.6% 0.99 / 0.93 / +5.6%
tpch_q21/duckdb:parquet 464512200 / 418893862 / +10.9% 536037531 / 454759125 / +17.9% 0.87 / 0.92 / -5.9%
tpch_q22/duckdb:parquet 282487949 / 323115195 / -12.6% 298584974 / 335134028 / -10.9% 0.95 / 0.96 / -1.9%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 325bbe4f vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-1.1%, low confidence) · DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 0.992x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.997x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.988x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 93120361 / 92421374 / +0.8% 153567331 / 147337644 / +4.2% 0.61 / 0.63 / -3.3%
tpch_q02/datafusion:vortex-file-compressed 63562950 / 65027104 / -2.3% 94791769 / 94796662 / -0.0% 0.67 / 0.69 / -2.2%
tpch_q03/datafusion:vortex-file-compressed 64007585 / 63028520 / +1.6% 126643225 / 120349559 / +5.2% 0.51 / 0.52 / -3.5%
tpch_q04/datafusion:vortex-file-compressed 34211310 / 33815475 / +1.2% 79723275 / 69506239 / +14.7% 🔴 0.43 / 0.49 / -11.8%
tpch_q05/datafusion:vortex-file-compressed 115727970 / 117313380 / -1.4% 178372134 / 176710106 / +0.9% 0.65 / 0.66 / -2.3%
tpch_q06/datafusion:vortex-file-compressed 10223996 / 10725012 / -4.7% 56906501 / 57362676 / -0.8% 0.18 / 0.19 / -3.9%
tpch_q07/datafusion:vortex-file-compressed 134914766 / 134275774 / +0.5% 206098553 / 209952759 / -1.8% 0.65 / 0.64 / +2.4%
tpch_q08/datafusion:vortex-file-compressed 138547041 / 142650106 / -2.9% 194857767 / 221708280 / -12.1% 🟢 0.71 / 0.64 / +10.5%
tpch_q09/datafusion:vortex-file-compressed 178635304 / 184132835 / -3.0% 232959297 / 257568148 / -9.6% 0.77 / 0.71 / +7.3%
tpch_q10/datafusion:vortex-file-compressed 69584172 / 69455539 / +0.2% 132827212 / 134716861 / -1.4% 0.52 / 0.52 / +1.6%
tpch_q11/datafusion:vortex-file-compressed 43039181 / 43143661 / -0.2% 68766841 / 67640381 / +1.7% 0.63 / 0.64 / -1.9%
tpch_q12/datafusion:vortex-file-compressed 35302881 / 35061881 / +0.7% 84507612 / 85227270 / -0.8% 0.42 / 0.41 / +1.5%
tpch_q13/datafusion:vortex-file-compressed 47035257 / 48574220 / -3.2% 81603916 / 87462734 / -6.7% 0.58 / 0.56 / +3.8%
tpch_q14/datafusion:vortex-file-compressed 21313274 / 21632584 / -1.5% 89526831 / 86011756 / +4.1% 0.24 / 0.25 / -5.3%
tpch_q15/datafusion:vortex-file-compressed 33599651 / 33883815 / -0.8% 90063453 / 91939519 / -2.0% 0.37 / 0.37 / +1.2%
tpch_q16/datafusion:vortex-file-compressed 36705724 / 37360931 / -1.8% 67611071 / 67235326 / +0.6% 0.54 / 0.56 / -2.3%
tpch_q17/datafusion:vortex-file-compressed 173698846 / 179258740 / -3.1% 221118737 / 225548853 / -2.0% 0.79 / 0.79 / -1.2%
tpch_q18/datafusion:vortex-file-compressed 196123976 / 208064713 / -5.7% 259911755 / 265841334 / -2.2% 0.75 / 0.78 / -3.6%
tpch_q19/datafusion:vortex-file-compressed 30768726 / 30852811 / -0.3% 84337166 / 90459069 / -6.8% 0.36 / 0.34 / +7.0%
tpch_q20/datafusion:vortex-file-compressed 60126866 / 60119739 / +0.0% 114590356 / 116242771 / -1.4% 0.52 / 0.52 / +1.5%
tpch_q21/datafusion:vortex-file-compressed 178376339 / 179920903 / -0.9% 240384029 / 236016105 / +1.9% 0.74 / 0.76 / -2.7%
tpch_q22/datafusion:vortex-file-compressed 25040617 / 24937759 / +0.4% 53542066 / 53553354 / -0.0% 0.47 / 0.47 / +0.4%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 88096527 / 87372046 / +0.8% 126572573 / 127117134 / -0.4% 0.70 / 0.69 / +1.3%
tpch_q02/datafusion:parquet 173213175 / 173541457 / -0.2% 202053000 / 200787531 / +0.6% 0.86 / 0.86 / -0.8%
tpch_q03/datafusion:parquet 135274729 / 135400852 / -0.1% 183151274 / 177515979 / +3.2% 0.74 / 0.76 / -3.2%
tpch_q04/datafusion:parquet 57564171 / 57301728 / +0.5% 92354821 / 90634805 / +1.9% 0.62 / 0.63 / -1.4%
tpch_q05/datafusion:parquet 167439513 / 167450726 / -0.0% 226805004 / 216918602 / +4.6% 0.74 / 0.77 / -4.4%
tpch_q06/datafusion:parquet 36437789 / 36759711 / -0.9% 78548155 / 73377160 / +7.0% 0.46 / 0.50 / -7.4%
tpch_q07/datafusion:parquet 214687433 / 217452485 / -1.3% 274630878 / 278757728 / -1.5% 0.78 / 0.78 / +0.2%
tpch_q08/datafusion:parquet 218207314 / 217547432 / +0.3% 291122386 / 281050041 / +3.6% 0.75 / 0.77 / -3.2%
tpch_q09/datafusion:parquet 308490798 / 309992739 / -0.5% 383171897 / 377617099 / +1.5% 0.81 / 0.82 / -1.9%
tpch_q10/datafusion:parquet 312411711 / 312607055 / -0.1% 378308070 / 374635413 / +1.0% 0.83 / 0.83 / -1.0%
tpch_q11/datafusion:parquet 127911608 / 126904955 / +0.8% 150559880 / 152092729 / -1.0% 0.85 / 0.83 / +1.8%
tpch_q12/datafusion:parquet 82490658 / 82490217 / +0.0% 121715176 / 119609598 / +1.8% 0.68 / 0.69 / -1.7%
tpch_q13/datafusion:parquet 210604555 / 210792627 / -0.1% 241477214 / 238505978 / +1.2% 0.87 / 0.88 / -1.3%
tpch_q14/datafusion:parquet 84934781 / 86178289 / -1.4% 187487794 / 190854700 / -1.8% 0.45 / 0.45 / +0.3%
tpch_q15/datafusion:parquet 106760304 / 106397081 / +0.3% 156561086 / 152062782 / +3.0% 0.68 / 0.70 / -2.5%
tpch_q16/datafusion:parquet 95002429 / 95891635 / -0.9% 121918129 / 122835240 / -0.7% 0.78 / 0.78 / -0.2%
tpch_q17/datafusion:parquet 214066654 / 215828919 / -0.8% 266830402 / 258232254 / +3.3% 0.80 / 0.84 / -4.0%
tpch_q18/datafusion:parquet 268178052 / 267911042 / +0.1% 317602866 / 315891179 / +0.5% 0.84 / 0.85 / -0.4%
tpch_q19/datafusion:parquet 108628757 / 108165843 / +0.4% 164085001 / 161949085 / +1.3% 0.66 / 0.67 / -0.9%
tpch_q20/datafusion:parquet 186063744 / 185545816 / +0.3% 248660855 / 247539770 / +0.5% 0.75 / 0.75 / -0.2%
tpch_q21/datafusion:parquet 243953399 / 244526968 / -0.2% 301698388 / 313261935 / -3.7% 0.81 / 0.78 / +3.6%
tpch_q22/datafusion:parquet 149787886 / 150249864 / -0.3% 174169009 / 175023324 / -0.5% 0.86 / 0.86 / +0.2%
duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 34059486 / 33717250 / +1.0% 68286763 / 72546071 / -5.9% 0.50 / 0.46 / +7.3%
tpch_q02/duckdb:vortex-file-compressed 28722606 / 28535483 / +0.7% 42609371 / 42812168 / -0.5% 0.67 / 0.67 / +1.1%
tpch_q03/duckdb:vortex-file-compressed 52959693 / 52395190 / +1.1% 106772502 / 107856916 / -1.0% 0.50 / 0.49 / +2.1%
tpch_q04/duckdb:vortex-file-compressed 51781211 / 51642374 / +0.3% 89807962 / 90715191 / -1.0% 0.58 / 0.57 / +1.3%
tpch_q05/duckdb:vortex-file-compressed 70263964 / 68284064 / +2.9% 110294978 / 112287453 / -1.8% 0.64 / 0.61 / +4.8%
tpch_q06/duckdb:vortex-file-compressed 15539419 / 15523980 / +0.1% 52588043 / 54001994 / -2.6% 0.30 / 0.29 / +2.8%
tpch_q07/duckdb:vortex-file-compressed 54963900 / 56289317 / -2.4% 110088882 / 109517607 / +0.5% 0.50 / 0.51 / -2.9%
tpch_q08/duckdb:vortex-file-compressed 87659242 / 87993665 / -0.4% 132153623 / 136034326 / -2.9% 0.66 / 0.65 / +2.5%
tpch_q09/duckdb:vortex-file-compressed 103313727 / 104478542 / -1.1% 160213982 / 160545830 / -0.2% 0.64 / 0.65 / -0.9%
tpch_q10/duckdb:vortex-file-compressed 96512990 / 96530974 / -0.0% 151338227 / 149480239 / +1.2% 0.64 / 0.65 / -1.2%
tpch_q11/duckdb:vortex-file-compressed 13225460 / 13271624 / -0.3% 29484575 / 28437282 / +3.7% 0.45 / 0.47 / -3.9%
tpch_q12/duckdb:vortex-file-compressed 44923122 / 44829286 / +0.2% 83465072 / 82101250 / +1.7% 0.54 / 0.55 / -1.4%
tpch_q13/duckdb:vortex-file-compressed 71702447 / 73482635 / -2.4% 102057021 / 100644151 / +1.4% 0.70 / 0.73 / -3.8%
tpch_q14/duckdb:vortex-file-compressed 28363714 / 28597524 / -0.8% 72201606 / 75301257 / -4.1% 0.39 / 0.38 / +3.4%
tpch_q15/duckdb:vortex-file-compressed 24836858 / 24850425 / -0.1% 64501377 / 64680737 / -0.3% 0.39 / 0.38 / +0.2%
tpch_q16/duckdb:vortex-file-compressed 49353436 / 48665139 / +1.4% 59208642 / 57917111 / +2.2% 0.83 / 0.84 / -0.8%
tpch_q17/duckdb:vortex-file-compressed 34515862 / 35017407 / -1.4% 68940731 / 68787564 / +0.2% 0.50 / 0.51 / -1.7%
tpch_q18/duckdb:vortex-file-compressed 106014958 / 101349193 / +4.6% 122759538 / 121104468 / +1.4% 0.86 / 0.84 / +3.2%
tpch_q19/duckdb:vortex-file-compressed 28070970 / 27586274 / +1.8% 73927289 / 75468750 / -2.0% 0.38 / 0.37 / +3.9%
tpch_q20/duckdb:vortex-file-compressed 42500140 / 42028653 / +1.1% 92210131 / 94143242 / -2.1% 0.46 / 0.45 / +3.2%
tpch_q21/duckdb:vortex-file-compressed 94495669 / 92926669 / +1.7% 147764284 / 149459387 / -1.1% 0.64 / 0.62 / +2.9%
tpch_q22/duckdb:vortex-file-compressed 32570602 / 32967821 / -1.2% 49522622 / 50673568 / -2.3% 0.66 / 0.65 / +1.1%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67903621 / 68059780 / -0.2% 87848503 / 89550266 / -1.9% 0.77 / 0.76 / +1.7%
tpch_q02/duckdb:parquet 86545065 / 87335480 / -0.9% 98139029 / 97718209 / +0.4% 0.88 / 0.89 / -1.3%
tpch_q03/duckdb:parquet 109683243 / 110511015 / -0.7% 141984898 / 142463897 / -0.3% 0.77 / 0.78 / -0.4%
tpch_q04/duckdb:parquet 76333505 / 76502436 / -0.2% 99651936 / 99440715 / +0.2% 0.77 / 0.77 / -0.4%
tpch_q05/duckdb:parquet 125050497 / 124172926 / +0.7% 156613535 / 157124433 / -0.3% 0.80 / 0.79 / +1.0%
tpch_q06/duckdb:parquet 35541554 / 35619223 / -0.2% 58127497 / 66005123 / -11.9% 🟢 0.61 / 0.54 / +13.3%
tpch_q07/duckdb:parquet 116962782 / 117398526 / -0.4% 155816275 / 154106673 / +1.1% 0.75 / 0.76 / -1.5%
tpch_q08/duckdb:parquet 147326143 / 147136506 / +0.1% 190061129 / 191273949 / -0.6% 0.78 / 0.77 / +0.8%
tpch_q09/duckdb:parquet 237575341 / 236712079 / +0.4% 280754232 / 283406742 / -0.9% 0.85 / 0.84 / +1.3%
tpch_q10/duckdb:parquet 311764789 / 314185931 / -0.8% 339336101 / 343372079 / -1.2% 0.92 / 0.92 / +0.4%
tpch_q11/duckdb:parquet 43319198 / 43742423 / -1.0% 50343877 / 50965528 / -1.2% 0.86 / 0.86 / +0.3%
tpch_q12/duckdb:parquet 70824081 / 71137236 / -0.4% 92676855 / 91779500 / +1.0% 0.76 / 0.78 / -1.4%
tpch_q13/duckdb:parquet 292797935 / 293366910 / -0.2% 305442352 / 308621731 / -1.0% 0.96 / 0.95 / +0.8%
tpch_q14/duckdb:parquet 101358205 / 102273386 / -0.9% 138467344 / 141851063 / -2.4% 0.73 / 0.72 / +1.5%
tpch_q15/duckdb:parquet 58320462 / 57070305 / +2.2% 85009228 / 86533692 / -1.8% 0.69 / 0.66 / +4.0%
tpch_q16/duckdb:parquet 99782549 / 100916878 / -1.1% 106679779 / 107993358 / -1.2% 0.94 / 0.93 / +0.1%
tpch_q17/duckdb:parquet 82961663 / 82884448 / +0.1% 113524905 / 124989202 / -9.2% 0.73 / 0.66 / +10.2%
tpch_q18/duckdb:parquet 155344377 / 157350187 / -1.3% 174990771 / 174516370 / +0.3% 0.89 / 0.90 / -1.5%
tpch_q19/duckdb:parquet 96933735 / 98221882 / -1.3% 127661335 / 134004453 / -4.7% 0.76 / 0.73 / +3.6%
tpch_q20/duckdb:parquet 146485411 / 147378796 / -0.6% 183165032 / 187264562 / -2.2% 0.80 / 0.79 / +1.6%
tpch_q21/duckdb:parquet 255453454 / 251811968 / +1.4% 278103303 / 275521800 / +0.9% 0.92 / 0.91 / +0.5%
tpch_q22/duckdb:parquet 168090933 / 168385842 / -0.2% 180591262 / 180610188 / -0.0% 0.93 / 0.93 / -0.2%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 325bbe4f vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (-0.5%, low confidence) · DuckDB No clear signal (-0.7%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 0.993x ➖
Parquet (geomean): hot 1.002x ➖ · cold 1.000x ➖
Shifts: Parquet (control) +0.2% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21026190 / 21075930 / -0.2% 38234592 / 38638247 / -1.0% 0.55 / 0.55 / +0.8%
tpcds_q02/datafusion:vortex-file-compressed 43830115 / 44337330 / -1.1% 63949797 / 64322678 / -0.6% 0.69 / 0.69 / -0.6%
tpcds_q03/datafusion:vortex-file-compressed 11063046 / 11162676 / -0.9% 25433964 / 27874319 / -8.8% 0.43 / 0.40 / +8.6%
tpcds_q04/datafusion:vortex-file-compressed 86094286 / 86734277 / -0.7% 119567234 / 118451152 / +0.9% 0.72 / 0.73 / -1.7%
tpcds_q05/datafusion:vortex-file-compressed 56132714 / 56827797 / -1.2% 75348167 / 76114099 / -1.0% 0.74 / 0.75 / -0.2%
tpcds_q06/datafusion:vortex-file-compressed 22460025 / 22692446 / -1.0% 41973836 / 42045614 / -0.2% 0.54 / 0.54 / -0.9%
tpcds_q07/datafusion:vortex-file-compressed 28775122 / 28756891 / +0.1% 49672983 / 50270298 / -1.2% 0.58 / 0.57 / +1.3%
tpcds_q08/datafusion:vortex-file-compressed 24056425 / 24565008 / -2.1% 43236767 / 44075611 / -1.9% 0.56 / 0.56 / -0.2%
tpcds_q09/datafusion:vortex-file-compressed 21112325 / 21207415 / -0.4% 38757011 / 35851284 / +8.1% 0.54 / 0.59 / -7.9%
tpcds_q10/datafusion:vortex-file-compressed 26567366 / 27171788 / -2.2% 47615684 / 48716984 / -2.3% 0.56 / 0.56 / +0.0%
tpcds_q11/datafusion:vortex-file-compressed 53329532 / 52909560 / +0.8% 78045737 / 79987379 / -2.4% 0.68 / 0.66 / +3.3%
tpcds_q12/datafusion:vortex-file-compressed 14559275 / 14883221 / -2.2% 31729879 / 31358319 / +1.2% 0.46 / 0.47 / -3.3%
tpcds_q13/datafusion:vortex-file-compressed 30775247 / 31185554 / -1.3% 54599214 / 56269502 / -3.0% 0.56 / 0.55 / +1.7%
tpcds_q14/datafusion:vortex-file-compressed 486364858 / 489067088 / -0.6% 546483009 / 543494011 / +0.5% 0.89 / 0.90 / -1.1%
tpcds_q15/datafusion:vortex-file-compressed 12362568 / 12361730 / +0.0% 32497859 / 32624708 / -0.4% 0.38 / 0.38 / +0.4%
tpcds_q16/datafusion:vortex-file-compressed 18104097 / 18767600 / -3.5% 36498537 / 37497209 / -2.7% 0.50 / 0.50 / -0.9%
tpcds_q17/datafusion:vortex-file-compressed 54476582 / 54689321 / -0.4% 76073032 / 71444295 / +6.5% 0.72 / 0.77 / -6.4%
tpcds_q18/datafusion:vortex-file-compressed 62903697 / 62745430 / +0.3% 87630485 / 84923290 / +3.2% 0.72 / 0.74 / -2.8%
tpcds_q19/datafusion:vortex-file-compressed 16378425 / 16953830 / -3.4% 36877343 / 38328755 / -3.8% 0.44 / 0.44 / +0.4%
tpcds_q20/datafusion:vortex-file-compressed 16133446 / 15971812 / +1.0% 34482532 / 36958911 / -6.7% 0.47 / 0.43 / +8.3%
tpcds_q21/datafusion:vortex-file-compressed 14965224 / 16341850 / -8.4% 38207196 / 37152728 / +2.8% 0.39 / 0.44 / -11.0%
tpcds_q22/datafusion:vortex-file-compressed 49594080 / 49281792 / +0.6% 72237133 / 72884478 / -0.9% 0.69 / 0.68 / +1.5%
tpcds_q23/datafusion:vortex-file-compressed 70697596 / 70660138 / +0.1% 93322833 / 98187087 / -5.0% 0.76 / 0.72 / +5.3%
tpcds_q24/datafusion:vortex-file-compressed 64828660 / 64849742 / -0.0% 83477247 / 85912267 / -2.8% 0.78 / 0.75 / +2.9%
tpcds_q25/datafusion:vortex-file-compressed 48530485 / 48102446 / +0.9% 65986390 / 73606543 / -10.4% 🟢 0.74 / 0.65 / +12.5%
tpcds_q26/datafusion:vortex-file-compressed 26163628 / 25675571 / +1.9% 47209454 / 46144233 / +2.3% 0.55 / 0.56 / -0.4%
tpcds_q27/datafusion:vortex-file-compressed 57066234 / 57037719 / +0.0% 82363948 / 79256017 / +3.9% 0.69 / 0.72 / -3.7%
tpcds_q28/datafusion:vortex-file-compressed 23269596 / 24421590 / -4.7% 37957683 / 41637022 / -8.8% 0.61 / 0.59 / +4.5%
tpcds_q29/datafusion:vortex-file-compressed 51965714 / 53192800 / -2.3% 66408698 / 75657345 / -12.2% 🟢 0.78 / 0.70 / +11.3%
tpcds_q30/datafusion:vortex-file-compressed 26625446 / 25828708 / +3.1% 44222253 / 43291925 / +2.1% 0.60 / 0.60 / +0.9%
tpcds_q31/datafusion:vortex-file-compressed 57755810 / 58867606 / -1.9% 82448683 / 83455412 / -1.2% 0.70 / 0.71 / -0.7%
tpcds_q32/datafusion:vortex-file-compressed 12343090 / 12386412 / -0.3% 28495591 / 28927311 / -1.5% 0.43 / 0.43 / +1.2%
tpcds_q33/datafusion:vortex-file-compressed 27217089 / 27251526 / -0.1% 48323483 / 48738507 / -0.9% 0.56 / 0.56 / +0.7%
tpcds_q34/datafusion:vortex-file-compressed 17332414 / 17480834 / -0.8% 35623652 / 34421823 / +3.5% 0.49 / 0.51 / -4.2%
tpcds_q35/datafusion:vortex-file-compressed 29779692 / 30075320 / -1.0% 53507127 / 53053102 / +0.9% 0.56 / 0.57 / -1.8%
tpcds_q36/datafusion:vortex-file-compressed 46327616 / 46675208 / -0.7% 69815802 / 69079110 / +1.1% 0.66 / 0.68 / -1.8%
tpcds_q37/datafusion:vortex-file-compressed 11794830 / 11904318 / -0.9% 33254302 / 33415021 / -0.5% 0.35 / 0.36 / -0.4%
tpcds_q38/datafusion:vortex-file-compressed 25409388 / 25706742 / -1.2% 47830404 / 46753111 / +2.3% 0.53 / 0.55 / -3.4%
tpcds_q39/datafusion:vortex-file-compressed 64295638 / 64869784 / -0.9% 89365558 / 89570934 / -0.2% 0.72 / 0.72 / -0.7%
tpcds_q40/datafusion:vortex-file-compressed 23073672 / 23325174 / -1.1% 42915496 / 42047023 / +2.1% 0.54 / 0.55 / -3.1%
tpcds_q41/datafusion:vortex-file-compressed 20503822 / 20342688 / +0.8% 33063680 / 31695807 / +4.3% 0.62 / 0.64 / -3.4%
tpcds_q42/datafusion:vortex-file-compressed 10980211 / 10755524 / +2.1% 26615424 / 26462137 / +0.6% 0.41 / 0.41 / +1.5%
tpcds_q43/datafusion:vortex-file-compressed 12423093 / 12549322 / -1.0% 32561751 / 31280405 / +4.1% 0.38 / 0.40 / -4.9%
tpcds_q44/datafusion:vortex-file-compressed 28254042 / 28515654 / -0.9% 51203897 / 50995861 / +0.4% 0.55 / 0.56 / -1.3%
tpcds_q45/datafusion:vortex-file-compressed 16528362 / 16298120 / +1.4% 34523251 / 33457337 / +3.2% 0.48 / 0.49 / -1.7%
tpcds_q46/datafusion:vortex-file-compressed 23061924 / 23229427 / -0.7% 46699441 / 44755548 / +4.3% 0.49 / 0.52 / -4.9%
tpcds_q47/datafusion:vortex-file-compressed 75459322 / 74695810 / +1.0% 102836490 / 101833669 / +1.0% 0.73 / 0.73 / +0.0%
tpcds_q48/datafusion:vortex-file-compressed 29266708 / 28485442 / +2.7% 51244250 / 50825432 / +0.8% 0.57 / 0.56 / +1.9%
tpcds_q49/datafusion:vortex-file-compressed 55993343 / 56616678 / -1.1% 77981529 / 79193807 / -1.5% 0.72 / 0.71 / +0.4%
tpcds_q50/datafusion:vortex-file-compressed 29951783 / 30225275 / -0.9% 51306746 / 51542216 / -0.5% 0.58 / 0.59 / -0.5%
tpcds_q51/datafusion:vortex-file-compressed 65965569 / 66238316 / -0.4% 85621821 / 85961923 / -0.4% 0.77 / 0.77 / -0.0%
tpcds_q52/datafusion:vortex-file-compressed 11460752 / 11173757 / +2.6% 26621847 / 26707892 / -0.3% 0.43 / 0.42 / +2.9%
tpcds_q53/datafusion:vortex-file-compressed 18196720 / 17815272 / +2.1% 38223609 / 38592794 / -1.0% 0.48 / 0.46 / +3.1%
tpcds_q54/datafusion:vortex-file-compressed 31281212 / 31294044 / -0.0% 54014767 / 54411096 / -0.7% 0.58 / 0.58 / +0.7%
tpcds_q55/datafusion:vortex-file-compressed 10817310 / 10977064 / -1.5% 26085592 / 26445815 / -1.4% 0.41 / 0.42 / -0.1%
tpcds_q56/datafusion:vortex-file-compressed 26141846 / 26267608 / -0.5% 46519686 / 47242232 / -1.5% 0.56 / 0.56 / +1.1%
tpcds_q57/datafusion:vortex-file-compressed 62231576 / 61853212 / +0.6% 86431194 / 86088207 / +0.4% 0.72 / 0.72 / +0.2%
tpcds_q58/datafusion:vortex-file-compressed 38513534 / 38380444 / +0.3% 64559807 / 63376054 / +1.9% 0.60 / 0.61 / -1.5%
tpcds_q59/datafusion:vortex-file-compressed 30163235 / 29424571 / +2.5% 54658047 / 53366384 / +2.4% 0.55 / 0.55 / +0.1%
tpcds_q60/datafusion:vortex-file-compressed 26284074 / 25428852 / +3.4% 46905948 / 46248957 / +1.4% 0.56 / 0.55 / +1.9%
tpcds_q61/datafusion:vortex-file-compressed 21241324 / 21069785 / +0.8% 42724356 / 42650322 / +0.2% 0.50 / 0.49 / +0.6%
tpcds_q62/datafusion:vortex-file-compressed 16491668 / 16464280 / +0.2% 33775861 / 34481569 / -2.0% 0.49 / 0.48 / +2.3%
tpcds_q63/datafusion:vortex-file-compressed 17539481 / 17537600 / +0.0% 37753339 / 37514994 / +0.6% 0.46 / 0.47 / -0.6%
tpcds_q64/datafusion:vortex-file-compressed 211760762 / 209658176 / +1.0% 245233452 / 244014821 / +0.5% 0.86 / 0.86 / +0.5%
tpcds_q65/datafusion:vortex-file-compressed 72972548 / 71931186 / +1.4% 93277577 / 93293623 / -0.0% 0.78 / 0.77 / +1.5%
tpcds_q66/datafusion:vortex-file-compressed 50143680 / 50314022 / -0.3% 71755000 / 73443461 / -2.3% 0.70 / 0.69 / +2.0%
tpcds_q67/datafusion:vortex-file-compressed 50320718 / 50809885 / -1.0% 79598540 / 80439935 / -1.0% 0.63 / 0.63 / +0.1%
tpcds_q68/datafusion:vortex-file-compressed 22746667 / 22935066 / -0.8% 45065577 / 46212376 / -2.5% 0.50 / 0.50 / +1.7%
tpcds_q69/datafusion:vortex-file-compressed 25533298 / 25957220 / -1.6% 48673389 / 48199065 / +1.0% 0.52 / 0.54 / -2.6%
tpcds_q70/datafusion:vortex-file-compressed 70677848 / 70921686 / -0.3% 92971501 / 91526378 / +1.6% 0.76 / 0.77 / -1.9%
tpcds_q71/datafusion:vortex-file-compressed 18233742 / 19479654 / -6.4% 38831007 / 39385822 / -1.4% 0.47 / 0.49 / -5.1%
tpcds_q72/datafusion:vortex-file-compressed 351460724 / 349635619 / +0.5% 376745118 / 390053124 / -3.4% 0.93 / 0.90 / +4.1%
tpcds_q73/datafusion:vortex-file-compressed 16135834 / 16370256 / -1.4% 34619680 / 35825318 / -3.4% 0.47 / 0.46 / +2.0%
tpcds_q74/datafusion:vortex-file-compressed 40012342 / 40729710 / -1.8% 66790382 / 66101755 / +1.0% 0.60 / 0.62 / -2.8%
tpcds_q75/datafusion:vortex-file-compressed 136354498 / 133231577 / +2.3% 162309623 / 159508865 / +1.8% 0.84 / 0.84 / +0.6%
tpcds_q76/datafusion:vortex-file-compressed 29332646 / 29878010 / -1.8% 47363438 / 49131830 / -3.6% 0.62 / 0.61 / +1.8%
tpcds_q77/datafusion:vortex-file-compressed 44674520 / 44794824 / -0.3% 64787239 / 68725579 / -5.7% 0.69 / 0.65 / +5.8%
tpcds_q78/datafusion:vortex-file-compressed 63477303 / 64149016 / -1.0% 89837013 / 91826652 / -2.2% 0.71 / 0.70 / +1.1%
tpcds_q79/datafusion:vortex-file-compressed 19519434 / 19747138 / -1.2% 41592665 / 41330856 / +0.6% 0.47 / 0.48 / -1.8%
tpcds_q80/datafusion:vortex-file-compressed 72182550 / 73516756 / -1.8% 98790337 / 103399339 / -4.5% 0.73 / 0.71 / +2.8%
tpcds_q81/datafusion:vortex-file-compressed 26461792 / 26433507 / +0.1% 44410148 / 44049315 / +0.8% 0.60 / 0.60 / -0.7%
tpcds_q82/datafusion:vortex-file-compressed 12056289 / 12061347 / -0.0% 32307387 / 33334269 / -3.1% 0.37 / 0.36 / +3.1%
tpcds_q83/datafusion:vortex-file-compressed 32595052 / 32437804 / +0.5% 50659826 / 52048289 / -2.7% 0.64 / 0.62 / +3.2%
tpcds_q84/datafusion:vortex-file-compressed 10170917 / 10107068 / +0.6% 25653535 / 25586667 / +0.3% 0.40 / 0.40 / +0.4%
tpcds_q85/datafusion:vortex-file-compressed 52443070 / 53327322 / -1.7% 77394706 / 79919547 / -3.2% 0.68 / 0.67 / +1.6%
tpcds_q86/datafusion:vortex-file-compressed 15836734 / 15658314 / +1.1% 32346670 / 32167556 / +0.6% 0.49 / 0.49 / +0.6%
tpcds_q87/datafusion:vortex-file-compressed 25611553 / 26232334 / -2.4% 46494517 / 48269535 / -3.7% 0.55 / 0.54 / +1.4%
tpcds_q88/datafusion:vortex-file-compressed 31479654 / 31404654 / +0.2% 51410882 / 50217706 / +2.4% 0.61 / 0.63 / -2.1%
tpcds_q89/datafusion:vortex-file-compressed 20676745 / 20857143 / -0.9% 42203922 / 40998842 / +2.9% 0.49 / 0.51 / -3.7%
tpcds_q90/datafusion:vortex-file-compressed 9920004 / 9857710 / +0.6% 24824395 / 24004775 / +3.4% 0.40 / 0.41 / -2.7%
tpcds_q91/datafusion:vortex-file-compressed 15890014 / 16590985 / -4.2% 35280689 / 36406808 / -3.1% 0.45 / 0.46 / -1.2%
tpcds_q92/datafusion:vortex-file-compressed 13166482 / 12785642 / +3.0% 27734731 / 28212901 / -1.7% 0.47 / 0.45 / +4.8%
tpcds_q93/datafusion:vortex-file-compressed 20565174 / 20514612 / +0.2% 41190826 / 39172325 / +5.2% 0.50 / 0.52 / -4.7%
tpcds_q94/datafusion:vortex-file-compressed 18249032 / 18329141 / -0.4% 35808865 / 37017769 / -3.3% 0.51 / 0.50 / +2.9%
tpcds_q95/datafusion:vortex-file-compressed 42169996 / 41892583 / +0.7% 62444718 / 60792282 / +2.7% 0.68 / 0.69 / -2.0%
tpcds_q96/datafusion:vortex-file-compressed 7479481 / 7680347 / -2.6% 23278991 / 24590568 / -5.3% 0.32 / 0.31 / +2.9%
tpcds_q97/datafusion:vortex-file-compressed 16896712 / 16976546 / -0.5% 37231320 / 36962622 / +0.7% 0.45 / 0.46 / -1.2%
tpcds_q98/datafusion:vortex-file-compressed 16118508 / 16323012 / -1.3% 34638790 / 35491744 / -2.4% 0.47 / 0.46 / +1.2%
tpcds_q99/datafusion:vortex-file-compressed 15883786 / 16055726 / -1.1% 34190676 / 34645287 / -1.3% 0.46 / 0.46 / +0.2%
datafusion / parquet / ns (1.000x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 42411713 / 42790168 / -0.9% 58298566 / 57645148 / +1.1% 0.73 / 0.74 / -2.0%
tpcds_q02/datafusion:parquet 55260682 / 54765044 / +0.9% 70063939 / 70421354 / -0.5% 0.79 / 0.78 / +1.4%
tpcds_q03/datafusion:parquet 18935970 / 19097265 / -0.8% 30871608 / 30445091 / +1.4% 0.61 / 0.63 / -2.2%
tpcds_q04/datafusion:parquet 176562042 / 178887614 / -1.3% 203467360 / 202039145 / +0.7% 0.87 / 0.89 / -2.0%
tpcds_q05/datafusion:parquet 67266900 / 67878001 / -0.9% 89110331 / 89709488 / -0.7% 0.75 / 0.76 / -0.2%
tpcds_q06/datafusion:parquet 33768407 / 33778804 / -0.0% 47033300 / 45692699 / +2.9% 0.72 / 0.74 / -2.9%
tpcds_q07/datafusion:parquet 46917010 / 47393786 / -1.0% 65496405 / 65545052 / -0.1% 0.72 / 0.72 / -0.9%
tpcds_q08/datafusion:parquet 31106832 / 30786170 / +1.0% 46267838 / 43159155 / +7.2% 0.67 / 0.71 / -5.7%
tpcds_q09/datafusion:parquet 33955842 / 30591208 / +11.0% 🔴 43192634 / 42974319 / +0.5% 0.79 / 0.71 / +10.4%
tpcds_q10/datafusion:parquet 44021180 / 43909954 / +0.3% 56504314 / 58393927 / -3.2% 0.78 / 0.75 / +3.6%
tpcds_q11/datafusion:parquet 98341553 / 97359220 / +1.0% 114665024 / 119001225 / -3.6% 0.86 / 0.82 / +4.8%
tpcds_q12/datafusion:parquet 23716062 / 23515044 / +0.9% 34809054 / 34010680 / +2.3% 0.68 / 0.69 / -1.5%
tpcds_q13/datafusion:parquet 45939738 / 46313484 / -0.8% 67778997 / 68018563 / -0.4% 0.68 / 0.68 / -0.5%
tpcds_q14/datafusion:parquet 532901114 / 534683184 / -0.3% 585395634 / 582375794 / +0.5% 0.91 / 0.92 / -0.8%
tpcds_q15/datafusion:parquet 24035894 / 24175697 / -0.6% 38375882 / 36583322 / +4.9% 0.63 / 0.66 / -5.2%
tpcds_q16/datafusion:parquet 36557018 / 37052644 / -1.3% 48342090 / 49572893 / -2.5% 0.76 / 0.75 / +1.2%
tpcds_q17/datafusion:parquet 72902312 / 75207760 / -3.1% 98044492 / 98319183 / -0.3% 0.74 / 0.76 / -2.8%
tpcds_q18/datafusion:parquet 64040632 / 67278429 / -4.8% 88766150 / 89472378 / -0.8% 0.72 / 0.75 / -4.1%
tpcds_q19/datafusion:parquet 29613842 / 29426323 / +0.6% 43453068 / 42286597 / +2.8% 0.68 / 0.70 / -2.1%
tpcds_q20/datafusion:parquet 25099835 / 24728196 / +1.5% 36329240 / 35453048 / +2.5% 0.69 / 0.70 / -0.9%
tpcds_q21/datafusion:parquet 20498256 / 19988597 / +2.5% 31818835 / 33163707 / -4.1% 0.64 / 0.60 / +6.9%
tpcds_q22/datafusion:parquet 77533706 / 77207674 / +0.4% 88781095 / 87517272 / +1.4% 0.87 / 0.88 / -1.0%
tpcds_q23/datafusion:parquet 91483776 / 91103138 / +0.4% 112835603 / 115810894 / -2.6% 0.81 / 0.79 / +3.1%
tpcds_q24/datafusion:parquet 90800233 / 90312194 / +0.5% 114834979 / 114753768 / +0.1% 0.79 / 0.79 / +0.5%
tpcds_q25/datafusion:parquet 81145427 / 82183728 / -1.3% 100586028 / 101090115 / -0.5% 0.81 / 0.81 / -0.8%
tpcds_q26/datafusion:parquet 42876152 / 43975604 / -2.5% 59601822 / 60140227 / -0.9% 0.72 / 0.73 / -1.6%
tpcds_q27/datafusion:parquet 75295000 / 75256415 / +0.1% 98419197 / 96796596 / +1.7% 0.77 / 0.78 / -1.6%
tpcds_q28/datafusion:parquet 28443464 / 28282492 / +0.6% 42995025 / 40540051 / +6.1% 0.66 / 0.70 / -5.2%
tpcds_q29/datafusion:parquet 75307674 / 76327373 / -1.3% 99421150 / 95497789 / +4.1% 0.76 / 0.80 / -5.2%
tpcds_q30/datafusion:parquet 45297337 / 44172996 / +2.5% 57078629 / 56428909 / +1.2% 0.79 / 0.78 / +1.4%
tpcds_q31/datafusion:parquet 81345390 / 81059734 / +0.4% 96632473 / 97847034 / -1.2% 0.84 / 0.83 / +1.6%
tpcds_q32/datafusion:parquet 26540046 / 26106716 / +1.7% 39492521 / 38996408 / +1.3% 0.67 / 0.67 / +0.4%
tpcds_q33/datafusion:parquet 36894308 / 36632188 / +0.7% 53862651 / 51696853 / +4.2% 0.68 / 0.71 / -3.3%
tpcds_q34/datafusion:parquet 24240662 / 24283762 / -0.2% 34586681 / 35496823 / -2.6% 0.70 / 0.68 / +2.4%
tpcds_q35/datafusion:parquet 50095858 / 51092331 / -2.0% 64770597 / 63128294 / +2.6% 0.77 / 0.81 / -4.4%
tpcds_q36/datafusion:parquet 52488829 / 52133216 / +0.7% 73698384 / 73276361 / +0.6% 0.71 / 0.71 / +0.1%
tpcds_q37/datafusion:parquet 21516732 / 21186441 / +1.6% 36084693 / 32501720 / +11.0% 🔴 0.60 / 0.65 / -8.5%
tpcds_q38/datafusion:parquet 43787306 / 44473320 / -1.5% 64161698 / 60661224 / +5.8% 0.68 / 0.73 / -6.9%
tpcds_q39/datafusion:parquet 67924853 / 67893870 / +0.0% 84287104 / 85512997 / -1.4% 0.81 / 0.79 / +1.5%
tpcds_q40/datafusion:parquet 30891962 / 30116612 / +2.6% 50516731 / 50944751 / -0.8% 0.61 / 0.59 / +3.4%
tpcds_q41/datafusion:parquet 19822744 / 19875884 / -0.3% 31499251 / 30988887 / +1.6% 0.63 / 0.64 / -1.9%
tpcds_q42/datafusion:parquet 18110448 / 18263912 / -0.8% 30833596 / 31580411 / -2.4% 0.59 / 0.58 / +1.6%
tpcds_q43/datafusion:parquet 19244929 / 19328598 / -0.4% 31502644 / 32363765 / -2.7% 0.61 / 0.60 / +2.3%
tpcds_q44/datafusion:parquet 34787964 / 34729506 / +0.2% 50089133 / 49650609 / +0.9% 0.69 / 0.70 / -0.7%
tpcds_q45/datafusion:parquet 27472584 / 27674712 / -0.7% 39933904 / 40581829 / -1.6% 0.69 / 0.68 / +0.9%
tpcds_q46/datafusion:parquet 28679013 / 28849347 / -0.6% 45557487 / 44446206 / +2.5% 0.63 / 0.65 / -3.0%
tpcds_q47/datafusion:parquet 97040296 / 97767068 / -0.7% 113242275 / 116071791 / -2.4% 0.86 / 0.84 / +1.7%
tpcds_q48/datafusion:parquet 41436629 / 42223134 / -1.9% 57814684 / 58362840 / -0.9% 0.72 / 0.72 / -0.9%
tpcds_q49/datafusion:parquet 70794987 / 71584984 / -1.1% 93193539 / 93559482 / -0.4% 0.76 / 0.77 / -0.7%
tpcds_q50/datafusion:parquet 47009266 / 47188732 / -0.4% 65604185 / 65957634 / -0.5% 0.72 / 0.72 / +0.2%
tpcds_q51/datafusion:parquet 75051096 / 75687516 / -0.8% 94684033 / 93987537 / +0.7% 0.79 / 0.81 / -1.6%
tpcds_q52/datafusion:parquet 18534919 / 18477546 / +0.3% 32426625 / 30516528 / +6.3% 0.57 / 0.61 / -5.6%
tpcds_q53/datafusion:parquet 22682720 / 22069787 / +2.8% 36836578 / 37394397 / -1.5% 0.62 / 0.59 / +4.3%
tpcds_q54/datafusion:parquet 53030487 / 53068499 / -0.1% 67373756 / 66798825 / +0.9% 0.79 / 0.79 / -0.9%
tpcds_q55/datafusion:parquet 18442536 / 18177591 / +1.5% 29344138 / 29615062 / -0.9% 0.63 / 0.61 / +2.4%
tpcds_q56/datafusion:parquet 41209123 / 40536538 / +1.7% 52933542 / 51702806 / +2.4% 0.78 / 0.78 / -0.7%
tpcds_q57/datafusion:parquet 99537956 / 100992704 / -1.4% 114983700 / 119321534 / -3.6% 0.87 / 0.85 / +2.3%
tpcds_q58/datafusion:parquet 65390441 / 65003510 / +0.6% 81825366 / 81993727 / -0.2% 0.80 / 0.79 / +0.8%
tpcds_q59/datafusion:parquet 47292642 / 47142071 / +0.3% 62694261 / 64332209 / -2.5% 0.75 / 0.73 / +2.9%
tpcds_q60/datafusion:parquet 39741394 / 41143805 / -3.4% 52973433 / 56528494 / -6.3% 0.75 / 0.73 / +3.1%
tpcds_q61/datafusion:parquet 36013383 / 37070528 / -2.9% 51560887 / 50658408 / +1.8% 0.70 / 0.73 / -4.6%
tpcds_q62/datafusion:parquet 25143954 / 25299585 / -0.6% 37370924 / 37400865 / -0.1% 0.67 / 0.68 / -0.5%
tpcds_q63/datafusion:parquet 22450452 / 22137338 / +1.4% 36439684 / 37267059 / -2.2% 0.62 / 0.59 / +3.7%
tpcds_q64/datafusion:parquet 288391539 / 283491307 / +1.7% 318297940 / 324365594 / -1.9% 0.91 / 0.87 / +3.7%
tpcds_q65/datafusion:parquet 121769718 / 121796900 / -0.0% 138018755 / 140340790 / -1.7% 0.88 / 0.87 / +1.7%
tpcds_q66/datafusion:parquet 59838976 / 60159790 / -0.5% 76141829 / 74271493 / +2.5% 0.79 / 0.81 / -3.0%
tpcds_q67/datafusion:parquet 68618331 / 69200688 / -0.8% 91702904 / 92158955 / -0.5% 0.75 / 0.75 / -0.3%
tpcds_q68/datafusion:parquet 28923732 / 28638674 / +1.0% 47557484 / 47694525 / -0.3% 0.61 / 0.60 / +1.3%
tpcds_q69/datafusion:parquet 43791409 / 43345552 / +1.0% 57935400 / 54686235 / +5.9% 0.76 / 0.79 / -4.6%
tpcds_q70/datafusion:parquet 81309727 / 80271896 / +1.3% 96756326 / 100088952 / -3.3% 0.84 / 0.80 / +4.8%
tpcds_q71/datafusion:parquet 25239484 / 24373552 / +3.6% 38230179 / 38366867 / -0.4% 0.66 / 0.64 / +3.9%
tpcds_q72/datafusion:parquet 524140959 / 527329837 / -0.6% 553907062 / 560736807 / -1.2% 0.95 / 0.94 / +0.6%
tpcds_q73/datafusion:parquet 23645348 / 23675195 / -0.1% 35692067 / 35651529 / +0.1% 0.66 / 0.66 / -0.2%
tpcds_q74/datafusion:parquet 70031196 / 69750544 / +0.4% 83411991 / 88419484 / -5.7% 0.84 / 0.79 / +6.4%
tpcds_q75/datafusion:parquet 151769234 / 154280426 / -1.6% 174761928 / 175992735 / -0.7% 0.87 / 0.88 / -0.9%
tpcds_q76/datafusion:parquet 33553752 / 32552642 / +3.1% 45567752 / 46197310 / -1.4% 0.74 / 0.70 / +4.5%
tpcds_q77/datafusion:parquet 56374344 / 55912258 / +0.8% 71358400 / 75401961 / -5.4% 0.79 / 0.74 / +6.5%
tpcds_q78/datafusion:parquet 87524186 / 86298158 / +1.4% 117742034 / 119573989 / -1.5% 0.74 / 0.72 / +3.0%
tpcds_q79/datafusion:parquet 26550220 / 26941018 / -1.5% 41755881 / 41670899 / +0.2% 0.64 / 0.65 / -1.7%
tpcds_q80/datafusion:parquet 79268428 / 79571648 / -0.4% 108815128 / 107798298 / +0.9% 0.73 / 0.74 / -1.3%
tpcds_q81/datafusion:parquet 37421837 / 37708022 / -0.8% 49636549 / 49644780 / -0.0% 0.75 / 0.76 / -0.7%
tpcds_q82/datafusion:parquet 22455238 / 22862742 / -1.8% 35230626 / 35659042 / -1.2% 0.64 / 0.64 / -0.6%
tpcds_q83/datafusion:parquet 59043323 / 58728850 / +0.5% 73287083 / 73572759 / -0.4% 0.81 / 0.80 / +0.9%
tpcds_q84/datafusion:parquet 25415340 / 27588446 / -7.9% 41462066 / 37424130 / +10.8% 🔴 0.61 / 0.74 / -16.8%
tpcds_q85/datafusion:parquet 80943994 / 80037900 / +1.1% 103465855 / 103303133 / +0.2% 0.78 / 0.77 / +1.0%
tpcds_q86/datafusion:parquet 21264278 / 20803682 / +2.2% 32348879 / 32694603 / -1.1% 0.66 / 0.64 / +3.3%
tpcds_q87/datafusion:parquet 44364424 / 44953774 / -1.3% 58543243 / 58673543 / -0.2% 0.76 / 0.77 / -1.1%
tpcds_q88/datafusion:parquet 37576040 / 37194222 / +1.0% 49580630 / 51481242 / -3.7% 0.76 / 0.72 / +4.9%
tpcds_q89/datafusion:parquet 25847386 / 25767740 / +0.3% 40066275 / 40885679 / -2.0% 0.65 / 0.63 / +2.4%
tpcds_q90/datafusion:parquet 15957666 / 15051543 / +6.0% 25998688 / 27168268 / -4.3% 0.61 / 0.55 / +10.8%
tpcds_q91/datafusion:parquet 32265952 / 32426770 / -0.5% 46147184 / 45756299 / +0.9% 0.70 / 0.71 / -1.3%
tpcds_q92/datafusion:parquet 26101971 / 26788312 / -2.6% 39345646 / 39570067 / -0.6% 0.66 / 0.68 / -2.0%
tpcds_q93/datafusion:parquet 27217678 / 26826836 / +1.5% 46206227 / 45720426 / +1.1% 0.59 / 0.59 / +0.4%
tpcds_q94/datafusion:parquet 34970704 / 35612212 / -1.8% 47968948 / 47235641 / +1.6% 0.73 / 0.75 / -3.3%
tpcds_q95/datafusion:parquet 64789700 / 64407442 / +0.6% 79919993 / 79417285 / +0.6% 0.81 / 0.81 / -0.0%
tpcds_q96/datafusion:parquet 13055878 / 13109518 / -0.4% 23241141 / 25052704 / -7.2% 0.56 / 0.52 / +7.4%
tpcds_q97/datafusion:parquet 35036353 / 35212817 / -0.5% 49625709 / 51110766 / -2.9% 0.71 / 0.69 / +2.5%
tpcds_q98/datafusion:parquet 24509678 / 24928664 / -1.7% 37378937 / 36311664 / +2.9% 0.66 / 0.69 / -4.5%
tpcds_q99/datafusion:parquet 29535734 / 29956348 / -1.4% 41340203 / 41613620 / -0.7% 0.71 / 0.72 / -0.8%
duckdb / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15927652 / 16142117 / -1.3% 25108767 / 24883739 / +0.9% 0.63 / 0.65 / -2.2%
tpcds_q02/duckdb:vortex-file-compressed 16711834 / 16709276 / +0.0% 22101507 / 22051108 / +0.2% 0.76 / 0.76 / -0.2%
tpcds_q03/duckdb:vortex-file-compressed 7003553 / 7045657 / -0.6% 15319994 / 16301596 / -6.0% 0.46 / 0.43 / +5.8%
tpcds_q04/duckdb:vortex-file-compressed 45967942 / 45758252 / +0.5% 55804223 / 56479163 / -1.2% 0.82 / 0.81 / +1.7%
tpcds_q05/duckdb:vortex-file-compressed 22882690 / 23036528 / -0.7% 32189835 / 32578849 / -1.2% 0.71 / 0.71 / +0.5%
tpcds_q06/duckdb:vortex-file-compressed 24151428 / 24423028 / -1.1% 37113935 / 38193338 / -2.8% 0.65 / 0.64 / +1.8%
tpcds_q07/duckdb:vortex-file-compressed 13317310 / 13353038 / -0.3% 23896003 / 24712568 / -3.3% 0.56 / 0.54 / +3.1%
tpcds_q08/duckdb:vortex-file-compressed 17271994 / 17520489 / -1.4% 25051849 / 25721441 / -2.6% 0.69 / 0.68 / +1.2%
tpcds_q09/duckdb:vortex-file-compressed 18998394 / 19111982 / -0.6% 30403476 / 29348465 / +3.6% 0.62 / 0.65 / -4.0%
tpcds_q10/duckdb:vortex-file-compressed 27513562 / 27612226 / -0.4% 41476396 / 40320225 / +2.9% 0.66 / 0.68 / -3.1%
tpcds_q11/duckdb:vortex-file-compressed 36773918 / 36903964 / -0.4% 45784981 / 46177346 / -0.8% 0.80 / 0.80 / +0.5%
tpcds_q12/duckdb:vortex-file-compressed 10019948 / 10200694 / -1.8% 16001391 / 17187152 / -6.9% 0.63 / 0.59 / +5.5%
tpcds_q13/duckdb:vortex-file-compressed 21018710 / 21263297 / -1.2% 34410480 / 32547269 / +5.7% 0.61 / 0.65 / -6.5%
tpcds_q14/duckdb:vortex-file-compressed 55178132 / 57809828 / -4.6% 66037926 / 68046783 / -3.0% 0.84 / 0.85 / -1.6%
tpcds_q15/duckdb:vortex-file-compressed 11054754 / 11119113 / -0.6% 18008566 / 18816176 / -4.3% 0.61 / 0.59 / +3.9%
tpcds_q16/duckdb:vortex-file-compressed 24624898 / 24266849 / +1.5% 34637707 / 34786209 / -0.4% 0.71 / 0.70 / +1.9%
tpcds_q17/duckdb:vortex-file-compressed 24535925 / 24227736 / +1.3% 36811313 / 36525117 / +0.8% 0.67 / 0.66 / +0.5%
tpcds_q18/duckdb:vortex-file-compressed 31490334 / 31509080 / -0.1% 40760806 / 41766543 / -2.4% 0.77 / 0.75 / +2.4%
tpcds_q19/duckdb:vortex-file-compressed 78073925 / 77960863 / +0.1% 88493671 / 89377861 / -1.0% 0.88 / 0.87 / +1.1%
tpcds_q20/duckdb:vortex-file-compressed 10900092 / 10971804 / -0.7% 18824051 / 17747764 / +6.1% 0.58 / 0.62 / -6.3%
tpcds_q21/duckdb:vortex-file-compressed 9479905 / 9745305 / -2.7% 20384102 / 20923879 / -2.6% 0.47 / 0.47 / -0.1%
tpcds_q22/duckdb:vortex-file-compressed 17527695 / 17585292 / -0.3% 29913811 / 29572488 / +1.2% 0.59 / 0.59 / -1.5%
tpcds_q23/duckdb:vortex-file-compressed 38575443 / 38130006 / +1.2% 50035355 / 49924896 / +0.2% 0.77 / 0.76 / +0.9%
tpcds_q24/duckdb:vortex-file-compressed 26386307 / 26574018 / -0.7% 37435088 / 36642246 / +2.2% 0.70 / 0.73 / -2.8%
tpcds_q25/duckdb:vortex-file-compressed 22970279 / 23695962 / -3.1% 34209340 / 36381968 / -6.0% 0.67 / 0.65 / +3.1%
tpcds_q26/duckdb:vortex-file-compressed 13001310 / 13100696 / -0.8% 20929432 / 21291607 / -1.7% 0.62 / 0.62 / +1.0%
tpcds_q27/duckdb:vortex-file-compressed 15622046 / 15963922 / -2.1% 26106060 / 27540444 / -5.2% 0.60 / 0.58 / +3.2%
tpcds_q28/duckdb:vortex-file-compressed 15456242 / 15588588 / -0.8% 26940464 / 26167172 / +3.0% 0.57 / 0.60 / -3.7%
tpcds_q29/duckdb:vortex-file-compressed 23068540 / 22710729 / +1.6% 34848697 / 34899355 / -0.1% 0.66 / 0.65 / +1.7%
tpcds_q30/duckdb:vortex-file-compressed 16171930 / 15872199 / +1.9% 24143579 / 24336692 / -0.8% 0.67 / 0.65 / +2.7%
tpcds_q31/duckdb:vortex-file-compressed 17497537 / 18069675 / -3.2% 26372100 / 26891648 / -1.9% 0.66 / 0.67 / -1.3%
tpcds_q32/duckdb:vortex-file-compressed 11503846 / 11623212 / -1.0% 21216569 / 20950684 / +1.3% 0.54 / 0.55 / -2.3%
tpcds_q33/duckdb:vortex-file-compressed 18687018 / 18357493 / +1.8% 28300134 / 28185569 / +0.4% 0.66 / 0.65 / +1.4%
tpcds_q34/duckdb:vortex-file-compressed 12813826 / 13014242 / -1.5% 22129989 / 23047270 / -4.0% 0.58 / 0.56 / +2.5%
tpcds_q35/duckdb:vortex-file-compressed 27793939 / 27929879 / -0.5% 39359646 / 39014716 / +0.9% 0.71 / 0.72 / -1.4%
tpcds_q36/duckdb:vortex-file-compressed 14033302 / 13908706 / +0.9% 24586587 / 23970044 / +2.6% 0.57 / 0.58 / -1.6%
tpcds_q37/duckdb:vortex-file-compressed 9484624 / 9515167 / -0.3% 23816722 / 24340830 / -2.2% 0.40 / 0.39 / +1.9%
tpcds_q38/duckdb:vortex-file-compressed 23938882 / 24300837 / -1.5% 32013119 / 32361884 / -1.1% 0.75 / 0.75 / -0.4%
tpcds_q39/duckdb:vortex-file-compressed 19329726 / 18334157 / +5.4% 33124106 / 33896858 / -2.3% 0.58 / 0.54 / +7.9%
tpcds_q40/duckdb:vortex-file-compressed 14127215 / 14107318 / +0.1% 20290596 / 20388858 / -0.5% 0.70 / 0.69 / +0.6%
tpcds_q41/duckdb:vortex-file-compressed 18792589 / 18789802 / +0.0% 25657207 / 25592058 / +0.3% 0.73 / 0.73 / -0.2%
tpcds_q42/duckdb:vortex-file-compressed 7129602 / 7115361 / +0.2% 15935565 / 16445425 / -3.1% 0.45 / 0.43 / +3.4%
tpcds_q43/duckdb:vortex-file-compressed 9753916 / 9847942 / -1.0% 19603640 / 19094789 / +2.7% 0.50 / 0.52 / -3.5%
tpcds_q44/duckdb:vortex-file-compressed 12658600 / 12546484 / +0.9% 24031692 / 24279354 / -1.0% 0.53 / 0.52 / +1.9%
tpcds_q45/duckdb:vortex-file-compressed 23597331 / 23264362 / +1.4% 30403847 / 31280867 / -2.8% 0.78 / 0.74 / +4.4%
tpcds_q46/duckdb:vortex-file-compressed 19495540 / 19680982 / -0.9% 27264653 / 27352411 / -0.3% 0.72 / 0.72 / -0.6%
tpcds_q47/duckdb:vortex-file-compressed 34590046 / 34836730 / -0.7% 44823361 / 45045037 / -0.5% 0.77 / 0.77 / -0.2%
tpcds_q48/duckdb:vortex-file-compressed 23388864 / 23197005 / +0.8% 36414605 / 36376826 / +0.1% 0.64 / 0.64 / +0.7%
tpcds_q49/duckdb:vortex-file-compressed 19064774 / 18947468 / +0.6% 30406080 / 31460092 / -3.4% 0.63 / 0.60 / +4.1%
tpcds_q50/duckdb:vortex-file-compressed 16788497 / 16868396 / -0.5% 26312338 / 27316563 / -3.7% 0.64 / 0.62 / +3.3%
tpcds_q51/duckdb:vortex-file-compressed 48649767 / 48747450 / -0.2% 59516741 / 76407317 / -22.1% 🟢 0.82 / 0.64 / +28.1%
tpcds_q52/duckdb:vortex-file-compressed 7281778 / 7223788 / +0.8% 16184767 / 16544978 / -2.2% 0.45 / 0.44 / +3.0%
tpcds_q53/duckdb:vortex-file-compressed 11745197 / 11580455 / +1.4% 20981491 / 20950001 / +0.2% 0.56 / 0.55 / +1.3%
tpcds_q54/duckdb:vortex-file-compressed 20698680 / 20288914 / +2.0% 30384692 / 30647003 / -0.9% 0.68 / 0.66 / +2.9%
tpcds_q55/duckdb:vortex-file-compressed 6931650 / 6902994 / +0.4% 15461611 / 15931120 / -2.9% 0.45 / 0.43 / +3.5%
tpcds_q56/duckdb:vortex-file-compressed 17878021 / 17960990 / -0.5% 28320678 / 27713372 / +2.2% 0.63 / 0.65 / -2.6%
tpcds_q57/duckdb:vortex-file-compressed 25645998 / 26098614 / -1.7% 33988009 / 34582639 / -1.7% 0.75 / 0.75 / -0.0%
tpcds_q58/duckdb:vortex-file-compressed 20431712 / 20331842 / +0.5% 31103334 / 30877019 / +0.7% 0.66 / 0.66 / -0.2%
tpcds_q59/duckdb:vortex-file-compressed 19238476 / 19688060 / -2.3% 26846742 / 27058532 / -0.8% 0.72 / 0.73 / -1.5%
tpcds_q60/duckdb:vortex-file-compressed 18923641 / 18617518 / +1.6% 29222926 / 29659067 / -1.5% 0.65 / 0.63 / +3.2%
tpcds_q61/duckdb:vortex-file-compressed 25191528 / 25605872 / -1.6% 34057029 / 34595872 / -1.6% 0.74 / 0.74 / -0.1%
tpcds_q62/duckdb:vortex-file-compressed 11466160 / 11685066 / -1.9% 18363336 / 18455703 / -0.5% 0.62 / 0.63 / -1.4%
tpcds_q63/duckdb:vortex-file-compressed 11094900 / 10996244 / +0.9% 20031476 / 20737428 / -3.4% 0.55 / 0.53 / +4.5%
tpcds_q64/duckdb:vortex-file-compressed 49171620 / 49381384 / -0.4% 65361042 / 66047661 / -1.0% 0.75 / 0.75 / +0.6%
tpcds_q65/duckdb:vortex-file-compressed 13018482 / 13292210 / -2.1% 22975671 / 23558633 / -2.5% 0.57 / 0.56 / +0.4%
tpcds_q66/duckdb:vortex-file-compressed 30324241 / 29707612 / +2.1% 34721222 / 35612347 / -2.5% 0.87 / 0.83 / +4.7%
tpcds_q67/duckdb:vortex-file-compressed 58506750 / 58292138 / +0.4% 67920644 / 66652555 / +1.9% 0.86 / 0.87 / -1.5%
tpcds_q68/duckdb:vortex-file-compressed 19117230 / 19064728 / +0.3% 27499651 / 27773620 / -1.0% 0.70 / 0.69 / +1.3%
tpcds_q69/duckdb:vortex-file-compressed 22915847 / 22826429 / +0.4% 38649565 / 37192445 / +3.9% 0.59 / 0.61 / -3.4%
tpcds_q70/duckdb:vortex-file-compressed 15493846 / 16314066 / -5.0% 26713615 / 27191282 / -1.8% 0.58 / 0.60 / -3.3%
tpcds_q71/duckdb:vortex-file-compressed 12873800 / 12617499 / +2.0% 24243051 / 23746617 / +2.1% 0.53 / 0.53 / -0.1%
tpcds_q72/duckdb:vortex-file-compressed 52611864 / 51945424 / +1.3% 64504112 / 62476510 / +3.2% 0.82 / 0.83 / -1.9%
tpcds_q73/duckdb:vortex-file-compressed 11653214 / 11909118 / -2.1% 20394488 / 21101470 / -3.4% 0.57 / 0.56 / +1.2%
tpcds_q74/duckdb:vortex-file-compressed 26367046 / 26041908 / +1.2% 33876402 / 34022832 / -0.4% 0.78 / 0.77 / +1.7%
tpcds_q75/duckdb:vortex-file-compressed 27873314 / 28133652 / -0.9% 38698451 / 38375865 / +0.8% 0.72 / 0.73 / -1.8%
tpcds_q76/duckdb:vortex-file-compressed 12809404 / 12764356 / +0.4% 22668043 / 22963071 / -1.3% 0.57 / 0.56 / +1.7%
tpcds_q77/duckdb:vortex-file-compressed 20697064 / 21418045 / -3.4% 31781062 / 32708962 / -2.8% 0.65 / 0.65 / -0.5%
tpcds_q78/duckdb:vortex-file-compressed 43006966 / 43337642 / -0.8% 54968080 / 53885227 / +2.0% 0.78 / 0.80 / -2.7%
tpcds_q79/duckdb:vortex-file-compressed 12869250 / 13232534 / -2.7% 22340369 / 21910779 / +2.0% 0.58 / 0.60 / -4.6%
tpcds_q80/duckdb:vortex-file-compressed 37558804 / 36847054 / +1.9% 49651471 / 49501801 / +0.3% 0.76 / 0.74 / +1.6%
tpcds_q81/duckdb:vortex-file-compressed 21042786 / 21429800 / -1.8% 29829896 / 30095533 / -0.9% 0.71 / 0.71 / -0.9%
tpcds_q82/duckdb:vortex-file-compressed 9746717 / 9708050 / +0.4% 24393342 / 25061879 / -2.7% 0.40 / 0.39 / +3.1%
tpcds_q83/duckdb:vortex-file-compressed 17303222 / 17427131 / -0.7% 24257962 / 24376519 / -0.5% 0.71 / 0.71 / -0.2%
tpcds_q84/duckdb:vortex-file-compressed 15592199 / 15770181 / -1.1% 23158875 / 23129342 / +0.1% 0.67 / 0.68 / -1.3%
tpcds_q85/duckdb:vortex-file-compressed 23810744 / 24403894 / -2.4% 35812501 / 36380296 / -1.6% 0.66 / 0.67 / -0.9%
tpcds_q86/duckdb:vortex-file-compressed 9613374 / 9717139 / -1.1% 15901799 / 15906721 / -0.0% 0.60 / 0.61 / -1.0%
tpcds_q87/duckdb:vortex-file-compressed 25587490 / 26017050 / -1.7% 33640558 / 33396290 / +0.7% 0.76 / 0.78 / -2.4%
tpcds_q88/duckdb:vortex-file-compressed 30294639 / 30324574 / -0.1% 37342052 / 38572757 / -3.2% 0.81 / 0.79 / +3.2%
tpcds_q89/duckdb:vortex-file-compressed 11973764 / 12106472 / -1.1% 21442292 / 20820791 / +3.0% 0.56 / 0.58 / -4.0%
tpcds_q90/duckdb:vortex-file-compressed 8100242 / 7989972 / +1.4% 15917611 / 15308508 / +4.0% 0.51 / 0.52 / -2.5%
tpcds_q91/duckdb:vortex-file-compressed 14558691 / 14428822 / +0.9% 21598486 / 23070665 / -6.4% 0.67 / 0.63 / +7.8%
tpcds_q92/duckdb:vortex-file-compressed 12069766 / 12093567 / -0.2% 20314920 / 20435129 / -0.6% 0.59 / 0.59 / +0.4%
tpcds_q93/duckdb:vortex-file-compressed 10711830 / 10489510 / +2.1% 23325972 / 23114016 / +0.9% 0.46 / 0.45 / +1.2%
tpcds_q94/duckdb:vortex-file-compressed 21807490 / 21924813 / -0.5% 31302110 / 32104172 / -2.5% 0.70 / 0.68 / +2.0%
tpcds_q95/duckdb:vortex-file-compressed 62625811 / 62938576 / -0.5% 72342976 / 71963612 / +0.5% 0.87 / 0.87 / -1.0%
tpcds_q96/duckdb:vortex-file-compressed 6877336 / 6838084 / +0.6% 14961021 / 14762606 / +1.3% 0.46 / 0.46 / -0.8%
tpcds_q97/duckdb:vortex-file-compressed 23319164 / 23163218 / +0.7% 32734143 / 31012754 / +5.6% 0.71 / 0.75 / -4.6%
tpcds_q98/duckdb:vortex-file-compressed 11553756 / 11360176 / +1.7% 20041648 / 19475284 / +2.9% 0.58 / 0.58 / -1.2%
tpcds_q99/duckdb:vortex-file-compressed 14358093 / 14668948 / -2.1% 22672559 / 22813440 / -0.6% 0.63 / 0.64 / -1.5%
duckdb / parquet / ns (1.004x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23992700 / 23966969 / +0.1% 30768773 / 30829019 / -0.2% 0.78 / 0.78 / +0.3%
tpcds_q02/duckdb:parquet 17900582 / 17973470 / -0.4% 23756023 / 23889142 / -0.6% 0.75 / 0.75 / +0.2%
tpcds_q03/duckdb:parquet 9732624 / 9784454 / -0.5% 15645186 / 15698965 / -0.3% 0.62 / 0.62 / -0.2%
tpcds_q04/duckdb:parquet 118113580 / 117912489 / +0.2% 123915817 / 126089418 / -1.7% 0.95 / 0.94 / +1.9%
tpcds_q05/duckdb:parquet 28081120 / 28395371 / -1.1% 32826279 / 32582262 / +0.7% 0.86 / 0.87 / -1.8%
tpcds_q06/duckdb:parquet 26279346 / 26216986 / +0.2% 35006495 / 35588221 / -1.6% 0.75 / 0.74 / +1.9%
tpcds_q07/duckdb:parquet 31247899 / 33420428 / -6.5% 38629800 / 38430436 / +0.5% 0.81 / 0.87 / -7.0%
tpcds_q08/duckdb:parquet 19647925 / 19585998 / +0.3% 25920616 / 26172260 / -1.0% 0.76 / 0.75 / +1.3%
tpcds_q09/duckdb:parquet 26104197 / 27371152 / -4.6% 29058117 / 29649948 / -2.0% 0.90 / 0.92 / -2.7%
tpcds_q10/duckdb:parquet 32426678 / 32361482 / +0.2% 39780931 / 40184705 / -1.0% 0.82 / 0.81 / +1.2%
tpcds_q11/duckdb:parquet 70467878 / 68514487 / +2.9% 76249201 / 76389272 / -0.2% 0.92 / 0.90 / +3.0%
tpcds_q12/duckdb:parquet 13999468 / 13876876 / +0.9% 19236592 / 19186188 / +0.3% 0.73 / 0.72 / +0.6%
tpcds_q13/duckdb:parquet 31172142 / 30368470 / +2.6% 39488336 / 40187836 / -1.7% 0.79 / 0.76 / +4.5%
tpcds_q14/duckdb:parquet 65984774 / 63510142 / +3.9% 67721353 / 67941108 / -0.3% 0.97 / 0.93 / +4.2%
tpcds_q15/duckdb:parquet 16626172 / 16546332 / +0.5% 22296111 / 22895550 / -2.6% 0.75 / 0.72 / +3.2%
tpcds_q16/duckdb:parquet 30077026 / 30007520 / +0.2% 36884603 / 36406547 / +1.3% 0.82 / 0.82 / -1.1%
tpcds_q17/duckdb:parquet 34329610 / 34177397 / +0.4% 39731636 / 40441172 / -1.8% 0.86 / 0.85 / +2.2%
tpcds_q18/duckdb:parquet 47022636 / 47042055 / -0.0% 54602208 / 54456240 / +0.3% 0.86 / 0.86 / -0.3%
tpcds_q19/duckdb:parquet 18576247 / 18502952 / +0.4% 26120303 / 25759438 / +1.4% 0.71 / 0.72 / -1.0%
tpcds_q20/duckdb:parquet 14796384 / 14883558 / -0.6% 19834336 / 19539428 / +1.5% 0.75 / 0.76 / -2.1%
tpcds_q21/duckdb:parquet 10589639 / 10610768 / -0.2% 16895848 / 17113867 / -1.3% 0.63 / 0.62 / +1.1%
tpcds_q22/duckdb:parquet 20755268 / 20553610 / +1.0% 26594800 / 26725059 / -0.5% 0.78 / 0.77 / +1.5%
tpcds_q23/duckdb:parquet 42475574 / 43575614 / -2.5% 47073539 / 46598579 / +1.0% 0.90 / 0.94 / -3.5%
tpcds_q24/duckdb:parquet 30012670 / 30367457 / -1.2% 36763430 / 36478211 / +0.8% 0.82 / 0.83 / -1.9%
tpcds_q25/duckdb:parquet 30342768 / 30221780 / +0.4% 36958096 / 36937818 / +0.1% 0.82 / 0.82 / +0.3%
tpcds_q26/duckdb:parquet 28986742 / 28776880 / +0.7% 35273421 / 35302112 / -0.1% 0.82 / 0.82 / +0.8%
tpcds_q27/duckdb:parquet 32892319 / 35523786 / -7.4% 41876940 / 41611405 / +0.6% 0.79 / 0.85 / -8.0%
tpcds_q28/duckdb:parquet 26641598 / 26328432 / +1.2% 34906672 / 34309155 / +1.7% 0.76 / 0.77 / -0.5%
tpcds_q29/duckdb:parquet 32941377 / 31825925 / +3.5% 38915908 / 38870785 / +0.1% 0.85 / 0.82 / +3.4%
tpcds_q30/duckdb:parquet 35241747 / 35121615 / +0.3% 44684792 / 44712118 / -0.1% 0.79 / 0.79 / +0.4%
tpcds_q31/duckdb:parquet 36003405 / 35271778 / +2.1% 43412300 / 42481930 / +2.2% 0.83 / 0.83 / -0.1%
tpcds_q32/duckdb:parquet 14134773 / 14057028 / +0.6% 20779714 / 20598153 / +0.9% 0.68 / 0.68 / -0.3%
tpcds_q33/duckdb:parquet 25075303 / 23124152 / +8.4% 29279423 / 29167207 / +0.4% 0.86 / 0.79 / +8.0%
tpcds_q34/duckdb:parquet 17413622 / 16934344 / +2.8% 24154189 / 24303526 / -0.6% 0.72 / 0.70 / +3.5%
tpcds_q35/duckdb:parquet 35187172 / 35187535 / -0.0% 43633512 / 43708254 / -0.2% 0.81 / 0.81 / +0.2%
tpcds_q36/duckdb:parquet 40046350 / 39353736 / +1.8% 46946872 / 47971471 / -2.1% 0.85 / 0.82 / +4.0%
tpcds_q37/duckdb:parquet 12669968 / 12699916 / -0.2% 19420117 / 19775516 / -1.8% 0.65 / 0.64 / +1.6%
tpcds_q38/duckdb:parquet 29814724 / 29409083 / +1.4% 33636192 / 33644782 / -0.0% 0.89 / 0.87 / +1.4%
tpcds_q39/duckdb:parquet 23247618 / 23268776 / -0.1% 29712122 / 30173448 / -1.5% 0.78 / 0.77 / +1.5%
tpcds_q40/duckdb:parquet 15896785 / 15818668 / +0.5% 21582849 / 21350935 / +1.1% 0.74 / 0.74 / -0.6%
tpcds_q41/duckdb:parquet 11864072 / 11937368 / -0.6% 17915918 / 17654837 / +1.5% 0.66 / 0.68 / -2.1%
tpcds_q42/duckdb:parquet 9569179 / 9467242 / +1.1% 15432505 / 15390992 / +0.3% 0.62 / 0.62 / +0.8%
tpcds_q43/duckdb:parquet 12082404 / 13469714 / -10.3% 🟢 17844383 / 18054883 / -1.2% 0.68 / 0.75 / -9.2%
tpcds_q44/duckdb:parquet 21276994 / 21728390 / -2.1% 27139402 / 27212840 / -0.3% 0.78 / 0.80 / -1.8%
tpcds_q45/duckdb:parquet 20820847 / 20743408 / +0.4% 27441473 / 27840154 / -1.4% 0.76 / 0.75 / +1.8%
tpcds_q46/duckdb:parquet 36508742 / 36989149 / -1.3% 43568751 / 44071441 / -1.1% 0.84 / 0.84 / -0.2%
tpcds_q47/duckdb:parquet 34788473 / 34549854 / +0.7% 41754530 / 41188971 / +1.4% 0.83 / 0.84 / -0.7%
tpcds_q48/duckdb:parquet 28566820 / 30458733 / -6.2% 37052879 / 37126578 / -0.2% 0.77 / 0.82 / -6.0%
tpcds_q49/duckdb:parquet 29270314 / 30077962 / -2.7% 36851488 / 35486466 / +3.8% 0.79 / 0.85 / -6.3%
tpcds_q50/duckdb:parquet 19187694 / 19303932 / -0.6% 25634013 / 25663854 / -0.1% 0.75 / 0.75 / -0.5%
tpcds_q51/duckdb:parquet 51503525 / 51972089 / -0.9% 60657423 / 60028308 / +1.0% 0.85 / 0.87 / -1.9%
tpcds_q52/duckdb:parquet 9595986 / 9584687 / +0.1% 15670581 / 15536302 / +0.9% 0.61 / 0.62 / -0.7%
tpcds_q53/duckdb:parquet 13877214 / 13859535 / +0.1% 21067234 / 21051270 / +0.1% 0.66 / 0.66 / +0.1%
tpcds_q54/duckdb:parquet 25067242 / 24769012 / +1.2% 32011296 / 32317507 / -0.9% 0.78 / 0.77 / +2.2%
tpcds_q55/duckdb:parquet 9434285 / 9458322 / -0.3% 15064169 / 15628508 / -3.6% 0.63 / 0.61 / +3.5%
tpcds_q56/duckdb:parquet 25660593 / 24451846 / +4.9% 29944818 / 30263945 / -1.1% 0.86 / 0.81 / +6.1%
tpcds_q57/duckdb:parquet 30576273 / 30496694 / +0.3% 36029671 / 36082806 / -0.1% 0.85 / 0.85 / +0.4%
tpcds_q58/duckdb:parquet 25285708 / 24048685 / +5.1% 29428616 / 29574418 / -0.5% 0.86 / 0.81 / +5.7%
tpcds_q59/duckdb:parquet 22723232 / 22781209 / -0.3% 28873436 / 28822798 / +0.2% 0.79 / 0.79 / -0.4%
tpcds_q60/duckdb:parquet 28170266 / 26326926 / +7.0% 32958706 / 32439784 / +1.6% 0.85 / 0.81 / +5.3%
tpcds_q61/duckdb:parquet 25211322 / 24386621 / +3.4% 28897276 / 28840820 / +0.2% 0.87 / 0.85 / +3.2%
tpcds_q62/duckdb:parquet 12764578 / 12837852 / -0.6% 17970909 / 18021543 / -0.3% 0.71 / 0.71 / -0.3%
tpcds_q63/duckdb:parquet 13357164 / 13411461 / -0.4% 20080431 / 20165946 / -0.4% 0.67 / 0.67 / +0.0%
tpcds_q64/duckdb:parquet 70656994 / 70200230 / +0.7% 79423579 / 80412181 / -1.2% 0.89 / 0.87 / +1.9%
tpcds_q65/duckdb:parquet 19989136 / 18687231 / +7.0% 26261284 / 26192155 / +0.3% 0.76 / 0.71 / +6.7%
tpcds_q66/duckdb:parquet 32960670 / 33369771 / -1.2% 37930497 / 37725314 / +0.5% 0.87 / 0.88 / -1.8%
tpcds_q67/duckdb:parquet 60929444 / 60819089 / +0.2% 67621243 / 67228661 / +0.6% 0.90 / 0.90 / -0.4%
tpcds_q68/duckdb:parquet 30422818 / 29259984 / +4.0% 36076652 / 36839271 / -2.1% 0.84 / 0.79 / +6.2%
tpcds_q69/duckdb:parquet 25585243 / 25569940 / +0.1% 34331903 / 34423942 / -0.3% 0.75 / 0.74 / +0.3%
tpcds_q70/duckdb:parquet 19111291 / 19192084 / -0.4% 27256576 / 26739741 / +1.9% 0.70 / 0.72 / -2.3%
tpcds_q71/duckdb:parquet 16986694 / 17054927 / -0.4% 23925591 / 23954836 / -0.1% 0.71 / 0.71 / -0.3%
tpcds_q72/duckdb:parquet 53226234 / 52932942 / +0.6% 59764543 / 59845214 / -0.1% 0.89 / 0.88 / +0.7%
tpcds_q73/duckdb:parquet 14850022 / 14661652 / +1.3% 21414931 / 21893138 / -2.2% 0.69 / 0.67 / +3.5%
tpcds_q74/duckdb:parquet 85151052 / 84390668 / +0.9% 90414766 / 91452584 / -1.1% 0.94 / 0.92 / +2.1%
tpcds_q75/duckdb:parquet 44731418 / 44687585 / +0.1% 50632755 / 50609140 / +0.0% 0.88 / 0.88 / +0.1%
tpcds_q76/duckdb:parquet 18970368 / 19040094 / -0.4% 23257199 / 23607159 / -1.5% 0.82 / 0.81 / +1.1%
tpcds_q77/duckdb:parquet 26785904 / 25425972 / +5.3% 31504631 / 32155175 / -2.0% 0.85 / 0.79 / +7.5%
tpcds_q78/duckdb:parquet 77774820 / 77093010 / +0.9% 86111442 / 84250182 / +2.2% 0.90 / 0.92 / -1.3%
tpcds_q79/duckdb:parquet 23968504 / 21130690 / +13.4% 🔴 29051069 / 29307556 / -0.9% 0.83 / 0.72 / +14.4%
tpcds_q80/duckdb:parquet 35909503 / 37184819 / -3.4% 44021428 / 43847529 / +0.4% 0.82 / 0.85 / -3.8%
tpcds_q81/duckdb:parquet 36307696 / 35976995 / +0.9% 44362121 / 44333291 / +0.1% 0.82 / 0.81 / +0.9%
tpcds_q82/duckdb:parquet 13362394 / 13373336 / -0.1% 20392832 / 20170460 / +1.1% 0.66 / 0.66 / -1.2%
tpcds_q83/duckdb:parquet 20210352 / 20056018 / +0.8% 25035366 / 24832676 / +0.8% 0.81 / 0.81 / -0.0%
tpcds_q84/duckdb:parquet 23022218 / 22552006 / +2.1% 28700249 / 28863502 / -0.6% 0.80 / 0.78 / +2.7%
tpcds_q85/duckdb:parquet 31756628 / 32295063 / -1.7% 39597985 / 39757757 / -0.4% 0.80 / 0.81 / -1.3%
tpcds_q86/duckdb:parquet 11847970 / 11671840 / +1.5% 16841174 / 17041774 / -1.2% 0.70 / 0.68 / +2.7%
tpcds_q87/duckdb:parquet 31287636 / 31295030 / -0.0% 35471227 / 35573309 / -0.3% 0.88 / 0.88 / +0.3%
tpcds_q88/duckdb:parquet 38153903 / 38174937 / -0.1% 41599279 / 41231775 / +0.9% 0.92 / 0.93 / -0.9%
tpcds_q89/duckdb:parquet 14092736 / 15086220 / -6.6% 21707266 / 21158011 / +2.6% 0.65 / 0.71 / -8.9%
tpcds_q90/duckdb:parquet 10014906 / 9834406 / +1.8% 14639391 / 15371268 / -4.8% 0.68 / 0.64 / +6.9%
tpcds_q91/duckdb:parquet 20826099 / 20811260 / +0.1% 28614368 / 28789486 / -0.6% 0.73 / 0.72 / +0.7%
tpcds_q92/duckdb:parquet 15453822 / 15505942 / -0.3% 21624245 / 21884251 / -1.2% 0.71 / 0.71 / +0.9%
tpcds_q93/duckdb:parquet 14314299 / 14008072 / +2.2% 20435875 / 20243382 / +1.0% 0.70 / 0.69 / +1.2%
tpcds_q94/duckdb:parquet 25347168 / 25514996 / -0.7% 32584747 / 32909651 / -1.0% 0.78 / 0.78 / +0.3%
tpcds_q95/duckdb:parquet 43483497 / 43842982 / -0.8% 49503282 / 49538887 / -0.1% 0.88 / 0.89 / -0.7%
tpcds_q96/duckdb:parquet 8189016 / 8142782 / +0.6% 13560948 / 13576831 / -0.1% 0.60 / 0.60 / +0.7%
tpcds_q97/duckdb:parquet 27537212 / 27093344 / +1.6% 34278136 / 32358898 / +5.9% 0.80 / 0.84 / -4.1%
tpcds_q98/duckdb:parquet 16532678 / 16374839 / +1.0% 23053791 / 23141567 / -0.4% 0.72 / 0.71 / +1.3%
tpcds_q99/duckdb:parquet 18658946 / 18656013 / +0.0% 24721143 / 24696138 / +0.1% 0.75 / 0.76 / -0.1%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 325bbe4f vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Engines: DataFusion No clear signal (+2.2%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): hot 1.012x ➖ · cold 1.012x ➖
Parquet (geomean): hot 1.004x ➖ · cold 1.011x ➖
Shifts: Parquet (control) +0.4% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.022x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6058397 / 6024191 / +0.6% 19749978 / 21309376 / -7.3% 0.31 / 0.28 / +8.5%
fineweb_q01/datafusion:vortex-file-compressed 8996481 / 9747476 / -7.7% 48212763 / 42020755 / +14.7% 🔴 0.19 / 0.23 / -19.6%
fineweb_q02/datafusion:vortex-file-compressed 11846906 / 11618604 / +2.0% 40926315 / 41766392 / -2.0% 0.29 / 0.28 / +4.1%
fineweb_q03/datafusion:vortex-file-compressed 17262614 / 17329895 / -0.4% 105308882 / 108086646 / -2.6% 0.16 / 0.16 / +2.2%
fineweb_q04/datafusion:vortex-file-compressed 64310546 / 65737414 / -2.2% 148967621 / 145352776 / +2.5% 0.43 / 0.45 / -4.5%
fineweb_q05/datafusion:vortex-file-compressed 62415404 / 61795532 / +1.0% 142003892 / 137019662 / +3.6% 0.44 / 0.45 / -2.5%
fineweb_q06/datafusion:vortex-file-compressed 18025244 / 18066823 / -0.2% 103949629 / 104665880 / -0.7% 0.17 / 0.17 / +0.5%
fineweb_q07/datafusion:vortex-file-compressed 18473357 / 18844782 / -2.0% 105006087 / 103604493 / +1.4% 0.18 / 0.18 / -3.3%
fineweb_q08/datafusion:vortex-file-compressed 9934058 / 7447691 / +33.4% 🔴 31036394 / 30345802 / +2.3% 0.32 / 0.25 / +30.4%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9248724 / 9347190 / -1.1% 36146074 / 33061275 / +9.3% 0.26 / 0.28 / -9.5%
fineweb_q01/datafusion:parquet 74365979 / 74932425 / -0.8% 151422765 / 150742572 / +0.5% 0.49 / 0.50 / -1.2%
fineweb_q02/datafusion:parquet 74088291 / 74583498 / -0.7% 150399861 / 163418319 / -8.0% 0.49 / 0.46 / +7.9%
fineweb_q03/datafusion:parquet 73213766 / 73245926 / -0.0% 151757264 / 146136322 / +3.8% 0.48 / 0.50 / -3.7%
fineweb_q04/datafusion:parquet 82559673 / 81855403 / +0.9% 151613920 / 149348852 / +1.5% 0.54 / 0.55 / -0.6%
fineweb_q05/datafusion:parquet 80133114 / 79554145 / +0.7% 146050528 / 154855107 / -5.7% 0.55 / 0.51 / +6.8%
fineweb_q06/datafusion:parquet 74908365 / 75032262 / -0.2% 148757904 / 149137469 / -0.3% 0.50 / 0.50 / +0.1%
fineweb_q07/datafusion:parquet 74783274 / 73707845 / +1.5% 146805114 / 147218019 / -0.3% 0.51 / 0.50 / +1.7%
fineweb_q08/datafusion:parquet 73335908 / 73897006 / -0.8% 146928561 / 148685620 / -1.2% 0.50 / 0.50 / +0.4%
duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2110020 / 2054080 / +2.7% 7154507 / 8030872 / -10.9% 🟢 0.29 / 0.26 / +15.3%
fineweb_q01/duckdb:vortex-file-compressed 7563579 / 8039040 / -5.9% 27905585 / 27088970 / +3.0% 0.27 / 0.30 / -8.7%
fineweb_q02/duckdb:vortex-file-compressed 9634427 / 9083977 / +6.1% 32609948 / 31774590 / +2.6% 0.30 / 0.29 / +3.3%
fineweb_q03/duckdb:vortex-file-compressed 18993518 / 19157832 / -0.9% 98720266 / 98793352 / -0.1% 0.19 / 0.19 / -0.8%
fineweb_q04/duckdb:vortex-file-compressed 65441764 / 65255572 / +0.3% 110869104 / 112260318 / -1.2% 0.59 / 0.58 / +1.5%
fineweb_q05/duckdb:vortex-file-compressed 65531216 / 65341412 / +0.3% 112121023 / 108297733 / +3.5% 0.58 / 0.60 / -3.1%
fineweb_q06/duckdb:vortex-file-compressed 18268733 / 18257114 / +0.1% 98346689 / 91068935 / +8.0% 0.19 / 0.20 / -7.3%
fineweb_q07/duckdb:vortex-file-compressed 18781068 / 17490810 / +7.4% 97220171 / 91425750 / +6.3% 0.19 / 0.19 / +1.0%
fineweb_q08/duckdb:vortex-file-compressed 4564448 / 4946861 / -7.7% 13348855 / 13182286 / +1.3% 0.34 / 0.38 / -8.9%
duckdb / parquet / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23822138 / 23445777 / +1.6% 28504128 / 28195844 / +1.1% 0.84 / 0.83 / +0.5%
fineweb_q01/duckdb:parquet 53604381 / 53982162 / -0.7% 76646609 / 71997604 / +6.5% 0.70 / 0.75 / -6.7%
fineweb_q02/duckdb:parquet 58714100 / 57294482 / +2.5% 78650746 / 77346633 / +1.7% 0.75 / 0.74 / +0.8%
fineweb_q03/duckdb:parquet 119180320 / 117275600 / +1.6% 181277339 / 177695815 / +2.0% 0.66 / 0.66 / -0.4%
fineweb_q04/duckdb:parquet 163167610 / 162362744 / +0.5% 215620445 / 207889629 / +3.7% 0.76 / 0.78 / -3.1%
fineweb_q05/duckdb:parquet 159668078 / 154398161 / +3.4% 195292019 / 198729928 / -1.7% 0.82 / 0.78 / +5.2%
fineweb_q06/duckdb:parquet 88332132 / 87783252 / +0.6% 152246720 / 145322183 / +4.8% 0.58 / 0.60 / -4.0%
fineweb_q07/duckdb:parquet 89659325 / 91502205 / -2.0% 146850394 / 144300475 / +1.8% 0.61 / 0.63 / -3.7%
fineweb_q08/duckdb:parquet 29131956 / 29233083 / -0.3% 30624598 / 29945779 / +2.3% 0.95 / 0.98 / -2.6%

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant