Skip to content

Build each Scan V2 file plan once under concurrent scans - #11139

Draft
joseph-isaacs wants to merge 1 commit into
developfrom
ji/scan-v2-plan-cache-once
Draft

joseph-isaacs wants to merge 1 commit into
developfrom
ji/scan-v2-plan-cache-once

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Split out of #10964 as an independently measurable piece.

DuckDB threads that open the same file race to lower its root and optimize the same projection and filter plans. ScanCache kept the first result, but every racing scan still paid for planning. This makes concurrent scans wait for one build and reuse it.

Threads that open the same file race to lower its root and optimize the same projection and
filter plans. The cache kept the first result but every racing scan paid for planning. Use
per-key `OnceCell`s so concurrent scans wait for one build and reuse it, independently per
projection and filter.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01UeniB9gdaaoxAeUkYj48Q3
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added changelog/performance A performance improvement action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Nov 3, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 3, 2026
@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 050a008 polarsignals 1 Explore Profiling Data
🟢 Done 050a008 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 050a008 tpch-s3 1 Explore Profiling Data
🟢 Done 050a008 fineweb 1 Explore Profiling Data
🟢 Done 050a008 tpcds-nvme 1 Explore Profiling Data
🟢 Done 050a008 clickbench-nvme 1 Explore Profiling Data
🟢 Done 050a008 tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 050a0087 vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.6%
Engines: DataFusion No clear signal (-2.8%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): hot 0.983x ➖ · cold 0.992x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.002x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.972x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16063440 / 16263915 / -1.2% 43647066 / 44263199 / -1.4% 0.37 / 0.37 / +0.2%
tpch_q02/datafusion:vortex-file-compressed 16651230 / 16894974 / -1.4% 34859818 / 36611616 / -4.8% 0.48 / 0.46 / +3.5%
tpch_q03/datafusion:vortex-file-compressed 19528020 / 19527766 / +0.0% 48205412 / 49847443 / -3.3% 0.41 / 0.39 / +3.4%
tpch_q04/datafusion:vortex-file-compressed 9761866 / 10188611 / -4.2% 34322393 / 35817404 / -4.2% 0.28 / 0.28 / -0.0%
tpch_q05/datafusion:vortex-file-compressed 37464202 / 37541382 / -0.2% 71581820 / 67849249 / +5.5% 0.52 / 0.55 / -5.4%
tpch_q06/datafusion:vortex-file-compressed 4348473 / 5955274 / -27.0% 🟢 27099317 / 28481717 / -4.9% 0.16 / 0.21 / -23.3%
tpch_q07/datafusion:vortex-file-compressed 51535664 / 51398304 / +0.3% 81592002 / 82045194 / -0.6% 0.63 / 0.63 / +0.8%
tpch_q08/datafusion:vortex-file-compressed 50957963 / 51875388 / -1.8% 82438010 / 80701452 / +2.2% 0.62 / 0.64 / -3.8%
tpch_q09/datafusion:vortex-file-compressed 47479771 / 47995869 / -1.1% 79800357 / 80826300 / -1.3% 0.59 / 0.59 / +0.2%
tpch_q10/datafusion:vortex-file-compressed 16995534 / 17741482 / -4.2% 51765584 / 53082340 / -2.5% 0.33 / 0.33 / -1.8%
tpch_q11/datafusion:vortex-file-compressed 14091281 / 14031627 / +0.4% 32590008 / 33512469 / -2.8% 0.43 / 0.42 / +3.3%
tpch_q12/datafusion:vortex-file-compressed 18519740 / 18328359 / +1.0% 41118265 / 45157861 / -8.9% 0.45 / 0.41 / +11.0%
tpch_q13/datafusion:vortex-file-compressed 19662197 / 19616934 / +0.2% 38341190 / 38185157 / +0.4% 0.51 / 0.51 / -0.2%
tpch_q14/datafusion:vortex-file-compressed 14496662 / 14594152 / -0.7% 35675019 / 39735581 / -10.2% 🟢 0.41 / 0.37 / +10.6%
tpch_q15/datafusion:vortex-file-compressed 18854528 / 18763971 / +0.5% 44283682 / 43533246 / +1.7% 0.43 / 0.43 / -1.2%
tpch_q16/datafusion:vortex-file-compressed 17953436 / 18234276 / -1.5% 36476396 / 37635522 / -3.1% 0.49 / 0.48 / +1.6%
tpch_q17/datafusion:vortex-file-compressed 28911014 / 28378421 / +1.9% 60516971 / 61847418 / -2.2% 0.48 / 0.46 / +4.1%
tpch_q18/datafusion:vortex-file-compressed 35696342 / 35305543 / +1.1% 60801755 / 61599150 / -1.3% 0.59 / 0.57 / +2.4%
tpch_q19/datafusion:vortex-file-compressed 9686072 / 11827307 / -18.1% 🟢 36679751 / 35891404 / +2.2% 0.26 / 0.33 / -19.9%
tpch_q20/datafusion:vortex-file-compressed 20282154 / 20441467 / -0.8% 43234540 / 46957425 / -7.9% 0.47 / 0.44 / +7.8%
tpch_q21/datafusion:vortex-file-compressed 38879127 / 38735030 / +0.4% 68173724 / 69895942 / -2.5% 0.57 / 0.55 / +2.9%
tpch_q22/datafusion:vortex-file-compressed 10760572 / 10820078 / -0.5% 30435486 / 29933093 / +1.7% 0.35 / 0.36 / -2.2%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71807304 / 71895679 / -0.1% 90612985 / 90101832 / +0.6% 0.79 / 0.80 / -0.7%
tpch_q02/datafusion:parquet 77072468 / 76098843 / +1.3% 92081474 / 90855700 / +1.3% 0.84 / 0.84 / -0.1%
tpch_q03/datafusion:parquet 81116571 / 81802859 / -0.8% 103580833 / 104624570 / -1.0% 0.78 / 0.78 / +0.2%
tpch_q04/datafusion:parquet 39438659 / 39443450 / -0.0% 60472091 / 56105007 / +7.8% 0.65 / 0.70 / -7.2%
tpch_q05/datafusion:parquet 110796727 / 110243073 / +0.5% 136872530 / 137233632 / -0.3% 0.81 / 0.80 / +0.8%
tpch_q06/datafusion:parquet 31053112 / 31285870 / -0.7% 48265224 / 48958203 / -1.4% 0.64 / 0.64 / +0.7%
tpch_q07/datafusion:parquet 113347927 / 112628638 / +0.6% 140022235 / 140164965 / -0.1% 0.81 / 0.80 / +0.7%
tpch_q08/datafusion:parquet 116552764 / 117365432 / -0.7% 144636066 / 144858333 / -0.2% 0.81 / 0.81 / -0.5%
tpch_q09/datafusion:parquet 137505505 / 137648335 / -0.1% 166667725 / 165675523 / +0.6% 0.83 / 0.83 / -0.7%
tpch_q10/datafusion:parquet 103846962 / 104232599 / -0.4% 126954435 / 131557659 / -3.5% 0.82 / 0.79 / +3.2%
tpch_q11/datafusion:parquet 62218545 / 61117621 / +1.8% 82015465 / 83469534 / -1.7% 0.76 / 0.73 / +3.6%
tpch_q12/datafusion:parquet 63647289 / 63935260 / -0.5% 85260501 / 85713684 / -0.5% 0.75 / 0.75 / +0.1%
tpch_q13/datafusion:parquet 143356813 / 143039529 / +0.2% 165022836 / 163205266 / +1.1% 0.87 / 0.88 / -0.9%
tpch_q14/datafusion:parquet 47542853 / 47461665 / +0.2% 70803850 / 70523444 / +0.4% 0.67 / 0.67 / -0.2%
tpch_q15/datafusion:parquet 74830891 / 73406392 / +1.9% 93886039 / 92742867 / +1.2% 0.80 / 0.79 / +0.7%
tpch_q16/datafusion:parquet 43400474 / 43563928 / -0.4% 63795615 / 63270122 / +0.8% 0.68 / 0.69 / -1.2%
tpch_q17/datafusion:parquet 123355717 / 123301020 / +0.0% 145175248 / 147211074 / -1.4% 0.85 / 0.84 / +1.4%
tpch_q18/datafusion:parquet 120847065 / 121046192 / -0.2% 144701988 / 142737474 / +1.4% 0.84 / 0.85 / -1.5%
tpch_q19/datafusion:parquet 57001886 / 57598916 / -1.0% 85470940 / 84233107 / +1.5% 0.67 / 0.68 / -2.5%
tpch_q20/datafusion:parquet 77194601 / 77933849 / -0.9% 101674026 / 103206085 / -1.5% 0.76 / 0.76 / +0.5%
tpch_q21/datafusion:parquet 113310222 / 113408807 / -0.1% 139420620 / 138663269 / +0.5% 0.81 / 0.82 / -0.6%
tpch_q22/datafusion:parquet 51503702 / 52165988 / -1.3% 68879362 / 67936274 / +1.4% 0.75 / 0.77 / -2.6%
duckdb / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9110882 / 9761332 / -6.7% 19415308 / 18912466 / +2.7% 0.47 / 0.52 / -9.1%
tpch_q02/duckdb:vortex-file-compressed 15223761 / 15133618 / +0.6% 25808978 / 25240568 / +2.3% 0.59 / 0.60 / -1.6%
tpch_q03/duckdb:vortex-file-compressed 18802362 / 18478693 / +1.8% 34968808 / 35420760 / -1.3% 0.54 / 0.52 / +3.1%
tpch_q04/duckdb:vortex-file-compressed 12407126 / 12526559 / -1.0% 27024298 / 26797289 / +0.8% 0.46 / 0.47 / -1.8%
tpch_q05/duckdb:vortex-file-compressed 20703504 / 19984330 / +3.6% 37094440 / 35135251 / +5.6% 0.56 / 0.57 / -1.9%
tpch_q06/duckdb:vortex-file-compressed 4703827 / 4707229 / -0.1% 14397900 / 14897236 / -3.4% 0.33 / 0.32 / +3.4%
tpch_q07/duckdb:vortex-file-compressed 24183865 / 24433501 / -1.0% 40506184 / 40669053 / -0.4% 0.60 / 0.60 / -0.6%
tpch_q08/duckdb:vortex-file-compressed 20665323 / 21158117 / -2.3% 37446717 / 37360088 / +0.2% 0.55 / 0.57 / -2.6%
tpch_q09/duckdb:vortex-file-compressed 22903218 / 21780886 / +5.2% 38135146 / 39377115 / -3.2% 0.60 / 0.55 / +8.6%
tpch_q10/duckdb:vortex-file-compressed 22743132 / 23061494 / -1.4% 38991193 / 40021706 / -2.6% 0.58 / 0.58 / +1.2%
tpch_q11/duckdb:vortex-file-compressed 8040552 / 8190706 / -1.8% 17533590 / 17311375 / +1.3% 0.46 / 0.47 / -3.1%
tpch_q12/duckdb:vortex-file-compressed 14569876 / 14552453 / +0.1% 26677743 / 27518794 / -3.1% 0.55 / 0.53 / +3.3%
tpch_q13/duckdb:vortex-file-compressed 19322787 / 19645042 / -1.6% 31544701 / 32940206 / -4.2% 0.61 / 0.60 / +2.7%
tpch_q14/duckdb:vortex-file-compressed 11305796 / 11380023 / -0.7% 25243555 / 24837163 / +1.6% 0.45 / 0.46 / -2.3%
tpch_q15/duckdb:vortex-file-compressed 8671213 / 8545626 / +1.5% 20011146 / 20629863 / -3.0% 0.43 / 0.41 / +4.6%
tpch_q16/duckdb:vortex-file-compressed 16621880 / 16616443 / +0.0% 22517906 / 22882070 / -1.6% 0.74 / 0.73 / +1.7%
tpch_q17/duckdb:vortex-file-compressed 12612418 / 12625912 / -0.1% 27501897 / 26443070 / +4.0% 0.46 / 0.48 / -4.0%
tpch_q18/duckdb:vortex-file-compressed 23627505 / 24532908 / -3.7% 34305539 / 34479790 / -0.5% 0.69 / 0.71 / -3.2%
tpch_q19/duckdb:vortex-file-compressed 11482350 / 12047148 / -4.7% 26700356 / 25716209 / +3.8% 0.43 / 0.47 / -8.2%
tpch_q20/duckdb:vortex-file-compressed 14532215 / 14345954 / +1.3% 33441035 / 30444524 / +9.8% 0.43 / 0.47 / -7.8%
tpch_q21/duckdb:vortex-file-compressed 37246616 / 37122052 / +0.3% 58671280 / 57121904 / +2.7% 0.63 / 0.65 / -2.3%
tpch_q22/duckdb:vortex-file-compressed 16527620 / 16816566 / -1.7% 27387835 / 25979595 / +5.4% 0.60 / 0.65 / -6.8%
duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47609848 / 47858045 / -0.5% 54348699 / 54404459 / -0.1% 0.88 / 0.88 / -0.4%
tpch_q02/duckdb:parquet 48381684 / 48336474 / +0.1% 56228850 / 55353685 / +1.6% 0.86 / 0.87 / -1.5%
tpch_q03/duckdb:parquet 60096048 / 60227192 / -0.2% 67901331 / 68349323 / -0.7% 0.89 / 0.88 / +0.4%
tpch_q04/duckdb:parquet 34722650 / 34720265 / +0.0% 43702061 / 43310065 / +0.9% 0.79 / 0.80 / -0.9%
tpch_q05/duckdb:parquet 67074245 / 67254941 / -0.3% 77599056 / 77626992 / -0.0% 0.86 / 0.87 / -0.2%
tpch_q06/duckdb:parquet 21791141 / 21944900 / -0.7% 27424077 / 27248080 / +0.6% 0.79 / 0.81 / -1.3%
tpch_q07/duckdb:parquet 63924473 / 63950143 / -0.0% 73139224 / 73664982 / -0.7% 0.87 / 0.87 / +0.7%
tpch_q08/duckdb:parquet 75213396 / 75776774 / -0.7% 86034540 / 86626463 / -0.7% 0.87 / 0.87 / -0.1%
tpch_q09/duckdb:parquet 108163137 / 107707033 / +0.4% 120209070 / 119514067 / +0.6% 0.90 / 0.90 / -0.2%
tpch_q10/duckdb:parquet 105605358 / 105854709 / -0.2% 116412382 / 118365462 / -1.7% 0.91 / 0.89 / +1.4%
tpch_q11/duckdb:parquet 29208150 / 29396110 / -0.6% 35127384 / 34577937 / +1.6% 0.83 / 0.85 / -2.2%
tpch_q12/duckdb:parquet 37203247 / 37190745 / +0.0% 44518801 / 44080916 / +1.0% 0.84 / 0.84 / -1.0%
tpch_q13/duckdb:parquet 174212375 / 174943548 / -0.4% 182256049 / 181832631 / +0.2% 0.96 / 0.96 / -0.6%
tpch_q14/duckdb:parquet 42330021 / 42368298 / -0.1% 50995472 / 51640657 / -1.2% 0.83 / 0.82 / +1.2%
tpch_q15/duckdb:parquet 32507060 / 32604664 / -0.3% 40869882 / 41186217 / -0.8% 0.80 / 0.79 / +0.5%
tpch_q16/duckdb:parquet 46916516 / 47438886 / -1.1% 52655630 / 52839714 / -0.3% 0.89 / 0.90 / -0.8%
tpch_q17/duckdb:parquet 47964330 / 47948653 / +0.0% 57634025 / 56916284 / +1.3% 0.83 / 0.84 / -1.2%
tpch_q18/duckdb:parquet 73730603 / 74218067 / -0.7% 81367678 / 81836806 / -0.6% 0.91 / 0.91 / -0.1%
tpch_q19/duckdb:parquet 48333494 / 47859814 / +1.0% 54986886 / 54599501 / +0.7% 0.88 / 0.88 / +0.3%
tpch_q20/duckdb:parquet 63241097 / 63470737 / -0.4% 74639537 / 74451035 / +0.3% 0.85 / 0.85 / -0.6%
tpch_q21/duckdb:parquet 106708758 / 106811631 / -0.1% 116571107 / 115756341 / +0.7% 0.92 / 0.92 / -0.8%
tpch_q22/duckdb:parquet 50477924 / 50510487 / -0.1% 59426264 / 58832593 / +1.0% 0.85 / 0.86 / -1.1%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 050a0087 vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): hot 1.011x ➖ · cold 0.937x ➖
Parquet (geomean): hot 1.008x ➖ · cold 0.972x ➖
Shifts: Parquet (control) +0.8% · Median polish +1.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.013x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6143812 / 6024191 / +2.0% 18654842 / 21309376 / -12.5% 🟢 0.33 / 0.28 / +16.5%
fineweb_q01/datafusion:vortex-file-compressed 8864450 / 9747476 / -9.1% 34533443 / 42020755 / -17.8% 🟢 0.26 / 0.23 / +10.7%
fineweb_q02/datafusion:vortex-file-compressed 10904777 / 11618604 / -6.1% 37325430 / 41766392 / -10.6% 🟢 0.29 / 0.28 / +5.0%
fineweb_q03/datafusion:vortex-file-compressed 17576420 / 17329895 / +1.4% 101235117 / 108086646 / -6.3% 0.17 / 0.16 / +8.3%
fineweb_q04/datafusion:vortex-file-compressed 64427440 / 65737414 / -2.0% 146644946 / 145352776 / +0.9% 0.44 / 0.45 / -2.9%
fineweb_q05/datafusion:vortex-file-compressed 62719068 / 61795532 / +1.5% 134451131 / 137019662 / -1.9% 0.47 / 0.45 / +3.4%
fineweb_q06/datafusion:vortex-file-compressed 18195418 / 18066823 / +0.7% 97069733 / 104665880 / -7.3% 0.19 / 0.17 / +8.6%
fineweb_q07/datafusion:vortex-file-compressed 16216131 / 18844782 / -13.9% 🟢 99118014 / 103604493 / -4.3% 0.16 / 0.18 / -10.1%
fineweb_q08/datafusion:vortex-file-compressed 10944966 / 7447691 / +47.0% 🔴 32323276 / 30345802 / +6.5% 0.34 / 0.25 / +38.0%
datafusion / parquet / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9439944 / 9347190 / +1.0% 31311700 / 33061275 / -5.3% 0.30 / 0.28 / +6.6%
fineweb_q01/datafusion:parquet 76308701 / 74932425 / +1.8% 143014686 / 150742572 / -5.1% 0.53 / 0.50 / +7.3%
fineweb_q02/datafusion:parquet 75611778 / 74583498 / +1.4% 147200606 / 163418319 / -9.9% 0.51 / 0.46 / +12.5%
fineweb_q03/datafusion:parquet 73382374 / 73245926 / +0.2% 142059717 / 146136322 / -2.8% 0.52 / 0.50 / +3.1%
fineweb_q04/datafusion:parquet 81936972 / 81855403 / +0.1% 141857876 / 149348852 / -5.0% 0.58 / 0.55 / +5.4%
fineweb_q05/datafusion:parquet 80173550 / 79554145 / +0.8% 139089598 / 154855107 / -10.2% 🟢 0.58 / 0.51 / +12.2%
fineweb_q06/datafusion:parquet 76433991 / 75032262 / +1.9% 145080939 / 149137469 / -2.7% 0.53 / 0.50 / +4.7%
fineweb_q07/datafusion:parquet 74249379 / 73707845 / +0.7% 142254467 / 147218019 / -3.4% 0.52 / 0.50 / +4.2%
fineweb_q08/datafusion:parquet 75327344 / 73897006 / +1.9% 143059128 / 148685620 / -3.8% 0.53 / 0.50 / +5.9%
duckdb / vortex-file-compressed / ns (1.010x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2071536 / 2054080 / +0.8% 7161957 / 8030872 / -10.8% 🟢 0.29 / 0.26 / +13.1%
fineweb_q01/duckdb:vortex-file-compressed 8185130 / 8039040 / +1.8% 25474586 / 27088970 / -6.0% 0.32 / 0.30 / +8.3%
fineweb_q02/duckdb:vortex-file-compressed 9683589 / 9083977 / +6.6% 28403316 / 31774590 / -10.6% 🟢 0.34 / 0.29 / +19.3%
fineweb_q03/duckdb:vortex-file-compressed 19150840 / 19157832 / -0.0% 87531089 / 98793352 / -11.4% 🟢 0.22 / 0.19 / +12.8%
fineweb_q04/duckdb:vortex-file-compressed 65288650 / 65255572 / +0.1% 105357271 / 112260318 / -6.1% 0.62 / 0.58 / +6.6%
fineweb_q05/duckdb:vortex-file-compressed 65303759 / 65341412 / -0.1% 102088652 / 108297733 / -5.7% 0.64 / 0.60 / +6.0%
fineweb_q06/duckdb:vortex-file-compressed 18544512 / 18257114 / +1.6% 88524898 / 91068935 / -2.8% 0.21 / 0.20 / +4.5%
fineweb_q07/duckdb:vortex-file-compressed 17837875 / 17490810 / +2.0% 87987059 / 91425750 / -3.8% 0.20 / 0.19 / +6.0%
fineweb_q08/duckdb:vortex-file-compressed 4775284 / 4946861 / -3.5% 13117954 / 13182286 / -0.5% 0.36 / 0.38 / -3.0%
duckdb / parquet / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23901972 / 23445777 / +1.9% 28324037 / 28195844 / +0.5% 0.84 / 0.83 / +1.5%
fineweb_q01/duckdb:parquet 54719716 / 53982162 / +1.4% 70352452 / 71997604 / -2.3% 0.78 / 0.75 / +3.7%
fineweb_q02/duckdb:parquet 59156806 / 57294482 / +3.3% 74968691 / 77346633 / -3.1% 0.79 / 0.74 / +6.5%
fineweb_q03/duckdb:parquet 117843952 / 117275600 / +0.5% 178818347 / 177695815 / +0.6% 0.66 / 0.66 / -0.1%
fineweb_q04/duckdb:parquet 161733276 / 162362744 / -0.4% 207627448 / 207889629 / -0.1% 0.78 / 0.78 / -0.3%
fineweb_q05/duckdb:parquet 158923210 / 154398161 / +2.9% 196801348 / 198729928 / -1.0% 0.81 / 0.78 / +3.9%
fineweb_q06/duckdb:parquet 86944106 / 87783252 / -1.0% 146786360 / 145322183 / +1.0% 0.59 / 0.60 / -1.9%
fineweb_q07/duckdb:parquet 89476786 / 91502205 / -2.2% 145317291 / 144300475 / +0.7% 0.62 / 0.63 / -2.9%
fineweb_q08/duckdb:parquet 28620354 / 29233083 / -2.1% 30563318 / 29945779 / +2.1% 0.94 / 0.98 / -4.1%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 050a0087 vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (+1.1%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.001x ➖
Parquet (geomean): hot 0.994x ➖ · cold 1.000x ➖
Shifts: Parquet (control) -0.6% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1245737 / 1223583 / +1.8% 22917346 / 22393554 / +2.3% 0.05 / 0.05 / -0.5%
clickbench_q01/datafusion:vortex-file-compressed 5993365 / 6046842 / -0.9% 29969977 / 29592395 / +1.3% 0.20 / 0.20 / -2.1%
clickbench_q02/datafusion:vortex-file-compressed 10367554 / 10531240 / -1.6% 39709498 / 46036487 / -13.7% 🟢 0.26 / 0.23 / +14.1%
clickbench_q03/datafusion:vortex-file-compressed 13009434 / 12387916 / +5.0% 59245260 / 56727916 / +4.4% 0.22 / 0.22 / +0.6%
clickbench_q04/datafusion:vortex-file-compressed 57889830 / 58081216 / -0.3% 103028495 / 103589636 / -0.5% 0.56 / 0.56 / +0.2%
clickbench_q05/datafusion:vortex-file-compressed 77318796 / 79014320 / -2.1% 119949552 / 128484768 / -6.6% 0.64 / 0.61 / +4.8%
clickbench_q06/datafusion:vortex-file-compressed 1261794 / 1263943 / -0.2% 22631296 / 22422362 / +0.9% 0.06 / 0.06 / -1.1%
clickbench_q07/datafusion:vortex-file-compressed 9230371 / 9508768 / -2.9% 38102292 / 33881448 / +12.5% 🔴 0.24 / 0.28 / -13.7%
clickbench_q08/datafusion:vortex-file-compressed 77279928 / 79137674 / -2.3% 119557267 / 128803436 / -7.2% 0.65 / 0.61 / +5.2%
clickbench_q09/datafusion:vortex-file-compressed 167914606 / 173755480 / -3.4% 219863298 / 207375596 / +6.0% 0.76 / 0.84 / -8.9%
clickbench_q10/datafusion:vortex-file-compressed 23150207 / 23479735 / -1.4% 71690683 / 69620750 / +3.0% 0.32 / 0.34 / -4.3%
clickbench_q11/datafusion:vortex-file-compressed 25833516 / 26005739 / -0.7% 72367440 / 70384896 / +2.8% 0.36 / 0.37 / -3.4%
clickbench_q12/datafusion:vortex-file-compressed 73797020 / 75527217 / -2.3% 122913143 / 123896189 / -0.8% 0.60 / 0.61 / -1.5%
clickbench_q13/datafusion:vortex-file-compressed 118535768 / 115900178 / +2.3% 180601991 / 187353692 / -3.6% 0.66 / 0.62 / +6.1%
clickbench_q14/datafusion:vortex-file-compressed 77396512 / 75510882 / +2.5% 123686741 / 125936863 / -1.8% 0.63 / 0.60 / +4.4%
clickbench_q15/datafusion:vortex-file-compressed 64151850 / 63030918 / +1.8% 102459368 / 100187136 / +2.3% 0.63 / 0.63 / -0.5%
clickbench_q16/datafusion:vortex-file-compressed 151247764 / 155538995 / -2.8% 212105119 / 217221220 / -2.4% 0.71 / 0.72 / -0.4%
clickbench_q17/datafusion:vortex-file-compressed 153654410 / 155207311 / -1.0% 232884294 / 226552616 / +2.8% 0.66 / 0.69 / -3.7%
clickbench_q18/datafusion:vortex-file-compressed 293500069 / 294130736 / -0.2% 378656124 / 390830976 / -3.1% 0.78 / 0.75 / +3.0%
clickbench_q19/datafusion:vortex-file-compressed 7781338 / 8303792 / -6.3% 48473799 / 48242070 / +0.5% 0.16 / 0.17 / -6.7%
clickbench_q20/datafusion:vortex-file-compressed 67975578 / 71745774 / -5.3% 242541083 / 248435282 / -2.4% 0.28 / 0.29 / -3.0%
clickbench_q21/datafusion:vortex-file-compressed 78115730 / 79455405 / -1.7% 288298230 / 288506255 / -0.1% 0.27 / 0.28 / -1.6%
clickbench_q22/datafusion:vortex-file-compressed 92194924 / 91696814 / +0.5% 398484669 / 390845073 / +2.0% 0.23 / 0.23 / -1.4%
clickbench_q23/datafusion:vortex-file-compressed 181092317 / 183993637 / -1.6% 543659872 / 539539151 / +0.8% 0.33 / 0.34 / -2.3%
clickbench_q24/datafusion:vortex-file-compressed 14902016 / 15307686 / -2.7% 75067892 / 70032970 / +7.2% 0.20 / 0.22 / -9.2%
clickbench_q25/datafusion:vortex-file-compressed 18928412 / 19863486 / -4.7% 61885554 / 62923085 / -1.6% 0.31 / 0.32 / -3.1%
clickbench_q26/datafusion:vortex-file-compressed 16064755 / 16533236 / -2.8% 69934433 / 70743668 / -1.1% 0.23 / 0.23 / -1.7%
clickbench_q27/datafusion:vortex-file-compressed 101673575 / 101740724 / -0.1% 255953692 / 251569553 / +1.7% 0.40 / 0.40 / -1.8%
clickbench_q28/datafusion:vortex-file-compressed 561549414 / 562333160 / -0.1% 660207526 / 643537242 / +2.6% 0.85 / 0.87 / -2.7%
clickbench_q29/datafusion:vortex-file-compressed 24134352 / 24245137 / -0.5% 58701378 / 53670057 / +9.4% 0.41 / 0.45 / -9.0%
clickbench_q30/datafusion:vortex-file-compressed 56334820 / 57397381 / -1.9% 112698666 / 112998342 / -0.3% 0.50 / 0.51 / -1.6%
clickbench_q31/datafusion:vortex-file-compressed 64847256 / 65356445 / -0.8% 157207575 / 163081172 / -3.6% 0.41 / 0.40 / +2.9%
clickbench_q32/datafusion:vortex-file-compressed 286453794 / 290282297 / -1.3% 386167726 / 393223115 / -1.8% 0.74 / 0.74 / +0.5%
clickbench_q33/datafusion:vortex-file-compressed 320353366 / 324626808 / -1.3% 430661728 / 432328318 / -0.4% 0.74 / 0.75 / -0.9%
clickbench_q34/datafusion:vortex-file-compressed 324309090 / 324894899 / -0.2% 445949108 / 444404496 / +0.3% 0.73 / 0.73 / -0.5%
clickbench_q35/datafusion:vortex-file-compressed 58111937 / 56027504 / +3.7% 90448366 / 93654723 / -3.4% 0.64 / 0.60 / +7.4%
clickbench_q36/datafusion:vortex-file-compressed 37493944 / 37622886 / -0.3% 67210365 / 67872658 / -1.0% 0.56 / 0.55 / +0.6%
clickbench_q37/datafusion:vortex-file-compressed 21098932 / 21259280 / -0.8% 47492110 / 47424626 / +0.1% 0.44 / 0.45 / -0.9%
clickbench_q38/datafusion:vortex-file-compressed 13256398 / 13259514 / -0.0% 41087039 / 41723747 / -1.5% 0.32 / 0.32 / +1.5%
clickbench_q39/datafusion:vortex-file-compressed 78513504 / 78839799 / -0.4% 112938088 / 111367852 / +1.4% 0.70 / 0.71 / -1.8%
clickbench_q40/datafusion:vortex-file-compressed 10752519 / 10378568 / +3.6% 36812123 / 36528657 / +0.8% 0.29 / 0.28 / +2.8%
clickbench_q41/datafusion:vortex-file-compressed 10160613 / 9976754 / +1.8% 35624332 / 34471787 / +3.3% 0.29 / 0.29 / -1.5%
clickbench_q42/datafusion:vortex-file-compressed 10977351 / 10423952 / +5.3% 36075529 / 35196628 / +2.5% 0.30 / 0.30 / +2.7%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1259464 / 1245842 / +1.1% 49091320 / 49718186 / -1.3% 0.03 / 0.03 / +2.4%
clickbench_q01/datafusion:parquet 15921772 / 15975198 / -0.3% 65254445 / 66883453 / -2.4% 0.24 / 0.24 / +2.2%
clickbench_q02/datafusion:parquet 19115520 / 19024956 / +0.5% 81499994 / 81292366 / +0.3% 0.23 / 0.23 / +0.2%
clickbench_q03/datafusion:parquet 17078882 / 17560503 / -2.7% 80833750 / 79048536 / +2.3% 0.21 / 0.22 / -4.9%
clickbench_q04/datafusion:parquet 64541580 / 62657254 / +3.0% 121867541 / 129056405 / -5.6% 0.53 / 0.49 / +9.1%
clickbench_q05/datafusion:parquet 88809200 / 89388218 / -0.6% 156422056 / 157935497 / -1.0% 0.57 / 0.57 / +0.3%
clickbench_q06/datafusion:parquet 1269849 / 1247492 / +1.8% 49039540 / 49860473 / -1.6% 0.03 / 0.03 / +3.5%
clickbench_q07/datafusion:parquet 16963220 / 16844414 / +0.7% 67866198 / 67110170 / +1.1% 0.25 / 0.25 / -0.4%
clickbench_q08/datafusion:parquet 84999860 / 85805378 / -0.9% 163014996 / 160618520 / +1.5% 0.52 / 0.53 / -2.4%
clickbench_q09/datafusion:parquet 183614404 / 187483740 / -2.1% 260963375 / 273970246 / -4.7% 0.70 / 0.68 / +2.8%
clickbench_q10/datafusion:parquet 36480625 / 35933968 / +1.5% 99437641 / 99356253 / +0.1% 0.37 / 0.36 / +1.4%
clickbench_q11/datafusion:parquet 43406402 / 42619872 / +1.8% 109766922 / 107756386 / +1.9% 0.40 / 0.40 / -0.0%
clickbench_q12/datafusion:parquet 95732651 / 96266114 / -0.6% 160263408 / 162038776 / -1.1% 0.60 / 0.59 / +0.5%
clickbench_q13/datafusion:parquet 148844582 / 146539911 / +1.6% 227690576 / 227411999 / +0.1% 0.65 / 0.64 / +1.4%
clickbench_q14/datafusion:parquet 102508189 / 102721975 / -0.2% 173785779 / 174323102 / -0.3% 0.59 / 0.59 / +0.1%
clickbench_q15/datafusion:parquet 69934132 / 72072821 / -3.0% 129477758 / 130369029 / -0.7% 0.54 / 0.55 / -2.3%
clickbench_q16/datafusion:parquet 157174442 / 155655536 / +1.0% 233138972 / 242072681 / -3.7% 0.67 / 0.64 / +4.8%
clickbench_q17/datafusion:parquet 157167242 / 156748302 / +0.3% 235884889 / 234690281 / +0.5% 0.67 / 0.67 / -0.2%
clickbench_q18/datafusion:parquet 308948767 / 311937038 / -1.0% 414643724 / 429885360 / -3.5% 0.75 / 0.73 / +2.7%
clickbench_q19/datafusion:parquet 19182002 / 18985055 / +1.0% 76180604 / 76428879 / -0.3% 0.25 / 0.25 / +1.4%
clickbench_q20/datafusion:parquet 178571833 / 178201950 / +0.2% 278502722 / 277984119 / +0.2% 0.64 / 0.64 / +0.0%
clickbench_q21/datafusion:parquet 172215352 / 174353110 / -1.2% 298625936 / 298763106 / -0.0% 0.58 / 0.58 / -1.2%
clickbench_q22/datafusion:parquet 261226248 / 264644574 / -1.3% 429164258 / 427231380 / +0.5% 0.61 / 0.62 / -1.7%
clickbench_q23/datafusion:parquet 1009825952 / 1015310230 / -0.5% 1203784747 / 1186767292 / +1.4% 0.84 / 0.86 / -1.9%
clickbench_q24/datafusion:parquet 29983408 / 30461840 / -1.6% 89773561 / 89550560 / +0.2% 0.33 / 0.34 / -1.8%
clickbench_q25/datafusion:parquet 35927555 / 36461936 / -1.5% 102473996 / 103796692 / -1.3% 0.35 / 0.35 / -0.2%
clickbench_q26/datafusion:parquet 30091759 / 30640387 / -1.8% 90053174 / 89946311 / +0.1% 0.33 / 0.34 / -1.9%
clickbench_q27/datafusion:parquet 193002754 / 192726410 / +0.1% 286448363 / 288972174 / -0.9% 0.67 / 0.67 / +1.0%
clickbench_q28/datafusion:parquet 616665792 / 621473269 / -0.8% 699127840 / 715604342 / -2.3% 0.88 / 0.87 / +1.6%
clickbench_q29/datafusion:parquet 29038784 / 28657065 / +1.3% 91774398 / 90415523 / +1.5% 0.32 / 0.32 / -0.2%
clickbench_q30/datafusion:parquet 89836798 / 91351340 / -1.7% 173454763 / 172111509 / +0.8% 0.52 / 0.53 / -2.4%
clickbench_q31/datafusion:parquet 102682245 / 102634058 / +0.0% 196450464 / 198577852 / -1.1% 0.52 / 0.52 / +1.1%
clickbench_q32/datafusion:parquet 307313476 / 311819602 / -1.4% 425470558 / 434802281 / -2.1% 0.72 / 0.72 / +0.7%
clickbench_q33/datafusion:parquet 376989098 / 380089808 / -0.8% 477749663 / 473796518 / +0.8% 0.79 / 0.80 / -1.6%
clickbench_q34/datafusion:parquet 375029600 / 376914011 / -0.5% 477237957 / 477819866 / -0.1% 0.79 / 0.79 / -0.4%
clickbench_q35/datafusion:parquet 64345624 / 65520001 / -1.8% 123432002 / 122720394 / +0.6% 0.52 / 0.53 / -2.4%
clickbench_q36/datafusion:parquet 73370219 / 73697400 / -0.4% 136013027 / 136472185 / -0.3% 0.54 / 0.54 / -0.1%
clickbench_q37/datafusion:parquet 35548546 / 35543201 / +0.0% 90902297 / 91265731 / -0.4% 0.39 / 0.39 / +0.4%
clickbench_q38/datafusion:parquet 47480750 / 48184051 / -1.5% 107643215 / 110190286 / -2.3% 0.44 / 0.44 / +0.9%
clickbench_q39/datafusion:parquet 143506694 / 143896086 / -0.3% 209158915 / 213345420 / -2.0% 0.69 / 0.67 / +1.7%
clickbench_q40/datafusion:parquet 19691348 / 20053370 / -1.8% 75873223 / 78117633 / -2.9% 0.26 / 0.26 / +1.1%
clickbench_q41/datafusion:parquet 18582998 / 18881718 / -1.6% 74866271 / 76285755 / -1.9% 0.25 / 0.25 / +0.3%
clickbench_q42/datafusion:parquet 19060632 / 19347004 / -1.5% 73741367 / 74154859 / -0.6% 0.26 / 0.26 / -0.9%
duckdb / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2194608 / 2237106 / -1.9% 25021737 / 25307876 / -1.1% 0.09 / 0.09 / -0.8%
clickbench_q01/duckdb:vortex-file-compressed 7583529 / 7655398 / -0.9% 30958812 / 30911132 / +0.2% 0.24 / 0.25 / -1.1%
clickbench_q02/duckdb:vortex-file-compressed 9017782 / 9039239 / -0.2% 36951765 / 38103656 / -3.0% 0.24 / 0.24 / +2.9%
clickbench_q03/duckdb:vortex-file-compressed 13902500 / 14038454 / -1.0% 49962372 / 51361504 / -2.7% 0.28 / 0.27 / +1.8%
clickbench_q04/duckdb:vortex-file-compressed 57057114 / 55959632 / +2.0% 93300399 / 90702001 / +2.9% 0.61 / 0.62 / -0.9%
clickbench_q05/duckdb:vortex-file-compressed 64508932 / 63897903 / +1.0% 93136630 / 96923586 / -3.9% 0.69 / 0.66 / +5.1%
clickbench_q06/duckdb:vortex-file-compressed 2776778 / 2644494 / +5.0% 30553476 / 29217110 / +4.6% 0.09 / 0.09 / +0.4%
clickbench_q07/duckdb:vortex-file-compressed 9951664 / 9511088 / +4.6% 30842625 / 30810489 / +0.1% 0.32 / 0.31 / +4.5%
clickbench_q08/duckdb:vortex-file-compressed 70380330 / 69255778 / +1.6% 105590594 / 107914279 / -2.2% 0.67 / 0.64 / +3.9%
clickbench_q09/duckdb:vortex-file-compressed 92915259 / 92548142 / +0.4% 131090775 / 128409391 / +2.1% 0.71 / 0.72 / -1.7%
clickbench_q10/duckdb:vortex-file-compressed 28205997 / 27689274 / +1.9% 71629393 / 72148281 / -0.7% 0.39 / 0.38 / +2.6%
clickbench_q11/duckdb:vortex-file-compressed 30976938 / 30540370 / +1.4% 75184719 / 79204582 / -5.1% 0.41 / 0.39 / +6.9%
clickbench_q12/duckdb:vortex-file-compressed 71205060 / 69892491 / +1.9% 104792945 / 100654921 / +4.1% 0.68 / 0.69 / -2.1%
clickbench_q13/duckdb:vortex-file-compressed 123375790 / 127172012 / -3.0% 170170733 / 169732824 / +0.3% 0.73 / 0.75 / -3.2%
clickbench_q14/duckdb:vortex-file-compressed 74429034 / 74951316 / -0.7% 106603919 / 108241821 / -1.5% 0.70 / 0.69 / +0.8%
clickbench_q15/duckdb:vortex-file-compressed 76582721 / 75857344 / +1.0% 112006286 / 109421143 / +2.4% 0.68 / 0.69 / -1.4%
clickbench_q16/duckdb:vortex-file-compressed 135301488 / 133718120 / +1.2% 174924335 / 172972559 / +1.1% 0.77 / 0.77 / +0.1%
clickbench_q17/duckdb:vortex-file-compressed 140899430 / 139145834 / +1.3% 174339468 / 176256527 / -1.1% 0.81 / 0.79 / +2.4%
clickbench_q18/duckdb:vortex-file-compressed 257237506 / 261284120 / -1.5% 299879732 / 305972300 / -2.0% 0.86 / 0.85 / +0.5%
clickbench_q19/duckdb:vortex-file-compressed 9764894 / 9433455 / +3.5% 37003113 / 38621943 / -4.2% 0.26 / 0.24 / +8.0%
clickbench_q20/duckdb:vortex-file-compressed 67823993 / 67552078 / +0.4% 167559806 / 169737178 / -1.3% 0.40 / 0.40 / +1.7%
clickbench_q21/duckdb:vortex-file-compressed 85380564 / 85506677 / -0.1% 192046312 / 194027861 / -1.0% 0.44 / 0.44 / +0.9%
clickbench_q22/duckdb:vortex-file-compressed 174493940 / 176474637 / -1.1% 350019481 / 345523729 / +1.3% 0.50 / 0.51 / -2.4%
clickbench_q23/duckdb:vortex-file-compressed 41188882 / 41929978 / -1.8% 88615779 / 90293247 / -1.9% 0.46 / 0.46 / +0.1%
clickbench_q24/duckdb:vortex-file-compressed 13797391 / 14160536 / -2.6% 36174523 / 39660096 / -8.8% 0.38 / 0.36 / +6.8%
clickbench_q25/duckdb:vortex-file-compressed 19617764 / 19419968 / +1.0% 54222461 / 54403251 / -0.3% 0.36 / 0.36 / +1.4%
clickbench_q26/duckdb:vortex-file-compressed 11602546 / 11388071 / +1.9% 36265602 / 39205981 / -7.5% 0.32 / 0.29 / +10.1%
clickbench_q27/duckdb:vortex-file-compressed 54438124 / 55108350 / -1.2% 184806054 / 180380940 / +2.5% 0.29 / 0.31 / -3.6%
clickbench_q28/duckdb:vortex-file-compressed 514300700 / 516077988 / -0.3% 571352922 / 559514013 / +2.1% 0.90 / 0.92 / -2.4%
clickbench_q29/duckdb:vortex-file-compressed 17103053 / 16801554 / +1.8% 47653631 / 43120020 / +10.5% 🔴 0.36 / 0.39 / -7.9%
clickbench_q30/duckdb:vortex-file-compressed 60962039 / 60694336 / +0.4% 112244288 / 112438538 / -0.2% 0.54 / 0.54 / +0.6%
clickbench_q31/duckdb:vortex-file-compressed 109743389 / 110928932 / -1.1% 178841255 / 200481515 / -10.8% 🟢 0.61 / 0.55 / +10.9%
clickbench_q32/duckdb:vortex-file-compressed 360753962 / 376905062 / -4.3% 400656431 / 411978991 / -2.7% 0.90 / 0.91 / -1.6%
clickbench_q33/duckdb:vortex-file-compressed 349214950 / 346800168 / +0.7% 409044357 / 400039829 / +2.3% 0.85 / 0.87 / -1.5%
clickbench_q34/duckdb:vortex-file-compressed 354813366 / 358757820 / -1.1% 416855752 / 415394371 / +0.4% 0.85 / 0.86 / -1.4%
clickbench_q35/duckdb:vortex-file-compressed 58788122 / 57165394 / +2.8% 89636866 / 89565873 / +0.1% 0.66 / 0.64 / +2.8%
clickbench_q36/duckdb:vortex-file-compressed 11698240 / 11736720 / -0.3% 33131554 / 31701737 / +4.5% 0.35 / 0.37 / -4.6%
clickbench_q37/duckdb:vortex-file-compressed 8395513 / 8307028 / +1.1% 32341650 / 28390029 / +13.9% 🔴 0.26 / 0.29 / -11.3%
clickbench_q38/duckdb:vortex-file-compressed 9242729 / 9089105 / +1.7% 29825549 / 28411635 / +5.0% 0.31 / 0.32 / -3.1%
clickbench_q39/duckdb:vortex-file-compressed 18992339 / 18985566 / +0.0% 41221336 / 41519995 / -0.7% 0.46 / 0.46 / +0.8%
clickbench_q40/duckdb:vortex-file-compressed 7504128 / 7541189 / -0.5% 28824665 / 26930257 / +7.0% 0.26 / 0.28 / -7.0%
clickbench_q41/duckdb:vortex-file-compressed 8588168 / 8447401 / +1.7% 30338723 / 30600085 / -0.9% 0.28 / 0.28 / +2.5%
clickbench_q42/duckdb:vortex-file-compressed 7542016 / 7460622 / +1.1% 28960113 / 28688927 / +0.9% 0.26 / 0.26 / +0.1%
duckdb / parquet / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9139045 / 9718106 / -6.0% 14465529 / 14404944 / +0.4% 0.63 / 0.67 / -6.4%
clickbench_q01/duckdb:parquet 15582104 / 15834801 / -1.6% 21629066 / 20779530 / +4.1% 0.72 / 0.76 / -5.5%
clickbench_q02/duckdb:parquet 22553924 / 22998262 / -1.9% 32936747 / 30933941 / +6.5% 0.68 / 0.74 / -7.9%
clickbench_q03/duckdb:parquet 22785252 / 22952789 / -0.7% 34517752 / 36373798 / -5.1% 0.66 / 0.63 / +4.6%
clickbench_q04/duckdb:parquet 61409998 / 61553110 / -0.2% 71334883 / 78571229 / -9.2% 0.86 / 0.78 / +9.9%
clickbench_q05/duckdb:parquet 82809246 / 82357820 / +0.5% 96880711 / 96778532 / +0.1% 0.85 / 0.85 / +0.4%
clickbench_q06/duckdb:parquet 20864182 / 20631596 / +1.1% 29759577 / 27932745 / +6.5% 0.70 / 0.74 / -5.1%
clickbench_q07/duckdb:parquet 17364352 / 17411882 / -0.3% 23228066 / 23086324 / +0.6% 0.75 / 0.75 / -0.9%
clickbench_q08/duckdb:parquet 74570876 / 74193970 / +0.5% 88468696 / 88499093 / -0.0% 0.84 / 0.84 / +0.5%
clickbench_q09/duckdb:parquet 103569028 / 102344946 / +1.2% 118045480 / 118287242 / -0.2% 0.88 / 0.87 / +1.4%
clickbench_q10/duckdb:parquet 41624822 / 41585957 / +0.1% 54373569 / 53914290 / +0.9% 0.77 / 0.77 / -0.8%
clickbench_q11/duckdb:parquet 46854222 / 46376690 / +1.0% 61922370 / 62469950 / -0.9% 0.76 / 0.74 / +1.9%
clickbench_q12/duckdb:parquet 92832800 / 93246466 / -0.4% 105218654 / 106709132 / -1.4% 0.88 / 0.87 / +1.0%
clickbench_q13/duckdb:parquet 151395298 / 151353115 / +0.0% 167868034 / 168774480 / -0.5% 0.90 / 0.90 / +0.6%
clickbench_q14/duckdb:parquet 100488345 / 101132109 / -0.6% 117603823 / 121484338 / -3.2% 0.85 / 0.83 / +2.6%
clickbench_q15/duckdb:parquet 86634650 / 87152113 / -0.6% 100888236 / 99157583 / +1.7% 0.86 / 0.88 / -2.3%
clickbench_q16/duckdb:parquet 163656814 / 161518198 / +1.3% 180217889 / 177677559 / +1.4% 0.91 / 0.91 / -0.1%
clickbench_q17/duckdb:parquet 164626266 / 163501751 / +0.7% 181000320 / 179044078 / +1.1% 0.91 / 0.91 / -0.4%
clickbench_q18/duckdb:parquet 296175088 / 297760434 / -0.5% 326676441 / 317638716 / +2.8% 0.91 / 0.94 / -3.3%
clickbench_q19/duckdb:parquet 19586756 / 20044906 / -2.3% 25644428 / 26219883 / -2.2% 0.76 / 0.76 / -0.1%
clickbench_q20/duckdb:parquet 183197003 / 190656931 / -3.9% 230337103 / 223372775 / +3.1% 0.80 / 0.85 / -6.8%
clickbench_q21/duckdb:parquet 213043730 / 221775748 / -3.9% 264951817 / 270636772 / -2.1% 0.80 / 0.82 / -1.9%
clickbench_q22/duckdb:parquet 328103267 / 316494844 / +3.7% 358982929 / 356496439 / +0.7% 0.91 / 0.89 / +2.9%
clickbench_q23/duckdb:parquet 174345632 / 172903391 / +0.8% 262949993 / 233746562 / +12.5% 🔴 0.66 / 0.74 / -10.4%
clickbench_q24/duckdb:parquet 30741483 / 30525626 / +0.7% 46147624 / 44919682 / +2.7% 0.67 / 0.68 / -2.0%
clickbench_q25/duckdb:parquet 41953855 / 43279324 / -3.1% 59068113 / 55176174 / +7.1% 0.71 / 0.78 / -9.4%
clickbench_q26/duckdb:parquet 30780342 / 29909380 / +2.9% 45278426 / 47593911 / -4.9% 0.68 / 0.63 / +8.2%
clickbench_q27/duckdb:parquet 187084818 / 190317469 / -1.7% 230335443 / 230460935 / -0.1% 0.81 / 0.83 / -1.6%
clickbench_q28/duckdb:parquet 964223814 / 966912630 / -0.3% 948600047 / 939906810 / +0.9% 1.02 / 1.03 / -1.2%
clickbench_q29/duckdb:parquet 24088037 / 23708308 / +1.6% 31801185 / 31487776 / +1.0% 0.76 / 0.75 / +0.6%
clickbench_q30/duckdb:parquet 106924010 / 107434616 / -0.5% 125962170 / 126651318 / -0.5% 0.85 / 0.85 / +0.1%
clickbench_q31/duckdb:parquet 136078322 / 146264200 / -7.0% 199952275 / 172955499 / +15.6% 🔴 0.68 / 0.85 / -19.5%
clickbench_q32/duckdb:parquet 388995773 / 392919146 / -1.0% 405605605 / 417034375 / -2.7% 0.96 / 0.94 / +1.8%
clickbench_q33/duckdb:parquet 463946940 / 489452036 / -5.2% 444175733 / 442277693 / +0.4% 1.04 / 1.11 / -5.6%
clickbench_q34/duckdb:parquet 469470441 / 466236417 / +0.7% 459166538 / 469010681 / -2.1% 1.02 / 0.99 / +2.9%
clickbench_q35/duckdb:parquet 61060852 / 61471326 / -0.7% 73472317 / 75534239 / -2.7% 0.83 / 0.81 / +2.1%
clickbench_q36/duckdb:parquet 30304633 / 30715884 / -1.3% 35653308 / 36664389 / -2.8% 0.85 / 0.84 / +1.5%
clickbench_q37/duckdb:parquet 23144676 / 23465799 / -1.4% 30472550 / 29463089 / +3.4% 0.76 / 0.80 / -4.6%
clickbench_q38/duckdb:parquet 23532726 / 23803284 / -1.1% 30260347 / 30067802 / +0.6% 0.78 / 0.79 / -1.8%
clickbench_q39/duckdb:parquet 52532557 / 53454965 / -1.7% 60112499 / 60267957 / -0.3% 0.87 / 0.89 / -1.5%
clickbench_q40/duckdb:parquet 15129968 / 14620130 / +3.5% 19702873 / 20417625 / -3.5% 0.77 / 0.72 / +7.2%
clickbench_q41/duckdb:parquet 15183418 / 15522580 / -2.2% 21240526 / 20561068 / +3.3% 0.71 / 0.75 / -5.3%
clickbench_q42/duckdb:parquet 14454228 / 14508395 / -0.4% 21192892 / 21329381 / -0.6% 0.68 / 0.68 / +0.3%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 050a0087 vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-0.7%, low confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 0.997x ➖ · cold 0.998x ➖
Parquet (geomean): hot 1.000x ➖ · cold 0.999x ➖
Shifts: Parquet (control) -0.0% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.994x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 20976897 / 21075930 / -0.5% 38755085 / 38638247 / +0.3% 0.54 / 0.55 / -0.8%
tpcds_q02/datafusion:vortex-file-compressed 44782340 / 44337330 / +1.0% 64303136 / 64322678 / -0.0% 0.70 / 0.69 / +1.0%
tpcds_q03/datafusion:vortex-file-compressed 11267037 / 11162676 / +0.9% 26583623 / 27874319 / -4.6% 0.42 / 0.40 / +5.8%
tpcds_q04/datafusion:vortex-file-compressed 87263201 / 86734277 / +0.6% 118265277 / 118451152 / -0.2% 0.74 / 0.73 / +0.8%
tpcds_q05/datafusion:vortex-file-compressed 57666280 / 56827797 / +1.5% 75132136 / 76114099 / -1.3% 0.77 / 0.75 / +2.8%
tpcds_q06/datafusion:vortex-file-compressed 23060062 / 22692446 / +1.6% 44002795 / 42045614 / +4.7% 0.52 / 0.54 / -2.9%
tpcds_q07/datafusion:vortex-file-compressed 28868404 / 28756891 / +0.4% 51274846 / 50270298 / +2.0% 0.56 / 0.57 / -1.6%
tpcds_q08/datafusion:vortex-file-compressed 24365562 / 24565008 / -0.8% 44010055 / 44075611 / -0.1% 0.55 / 0.56 / -0.7%
tpcds_q09/datafusion:vortex-file-compressed 19874830 / 21207415 / -6.3% 36458929 / 35851284 / +1.7% 0.55 / 0.59 / -7.8%
tpcds_q10/datafusion:vortex-file-compressed 26906106 / 27171788 / -1.0% 48193865 / 48716984 / -1.1% 0.56 / 0.56 / +0.1%
tpcds_q11/datafusion:vortex-file-compressed 51743333 / 52909560 / -2.2% 81239178 / 79987379 / +1.6% 0.64 / 0.66 / -3.7%
tpcds_q12/datafusion:vortex-file-compressed 14525862 / 14883221 / -2.4% 32053224 / 31358319 / +2.2% 0.45 / 0.47 / -4.5%
tpcds_q13/datafusion:vortex-file-compressed 30964840 / 31185554 / -0.7% 55183044 / 56269502 / -1.9% 0.56 / 0.55 / +1.2%
tpcds_q14/datafusion:vortex-file-compressed 488104113 / 489067088 / -0.2% 544271378 / 543494011 / +0.1% 0.90 / 0.90 / -0.3%
tpcds_q15/datafusion:vortex-file-compressed 12205747 / 12361730 / -1.3% 33481129 / 32624708 / +2.6% 0.36 / 0.38 / -3.8%
tpcds_q16/datafusion:vortex-file-compressed 18508652 / 18767600 / -1.4% 38095011 / 37497209 / +1.6% 0.49 / 0.50 / -2.9%
tpcds_q17/datafusion:vortex-file-compressed 54356640 / 54689321 / -0.6% 77764041 / 71444295 / +8.8% 0.70 / 0.77 / -8.7%
tpcds_q18/datafusion:vortex-file-compressed 63564110 / 62745430 / +1.3% 84691748 / 84923290 / -0.3% 0.75 / 0.74 / +1.6%
tpcds_q19/datafusion:vortex-file-compressed 16531238 / 16953830 / -2.5% 36580442 / 38328755 / -4.6% 0.45 / 0.44 / +2.2%
tpcds_q20/datafusion:vortex-file-compressed 16226446 / 15971812 / +1.6% 35076064 / 36958911 / -5.1% 0.46 / 0.43 / +7.0%
tpcds_q21/datafusion:vortex-file-compressed 15524048 / 16341850 / -5.0% 36681244 / 37152728 / -1.3% 0.42 / 0.44 / -3.8%
tpcds_q22/datafusion:vortex-file-compressed 49578320 / 49281792 / +0.6% 72646458 / 72884478 / -0.3% 0.68 / 0.68 / +0.9%
tpcds_q23/datafusion:vortex-file-compressed 70947220 / 70660138 / +0.4% 94314851 / 98187087 / -3.9% 0.75 / 0.72 / +4.5%
tpcds_q24/datafusion:vortex-file-compressed 65040524 / 64849742 / +0.3% 86154910 / 85912267 / +0.3% 0.75 / 0.75 / +0.0%
tpcds_q25/datafusion:vortex-file-compressed 47781642 / 48102446 / -0.7% 73403639 / 73606543 / -0.3% 0.65 / 0.65 / -0.4%
tpcds_q26/datafusion:vortex-file-compressed 25887737 / 25675571 / +0.8% 46569990 / 46144233 / +0.9% 0.56 / 0.56 / -0.1%
tpcds_q27/datafusion:vortex-file-compressed 57021136 / 57037719 / -0.0% 89921105 / 79256017 / +13.5% 🔴 0.63 / 0.72 / -11.9%
tpcds_q28/datafusion:vortex-file-compressed 18040826 / 24421590 / -26.1% 🟢 40707459 / 41637022 / -2.2% 0.44 / 0.59 / -24.4%
tpcds_q29/datafusion:vortex-file-compressed 53369328 / 53192800 / +0.3% 74354480 / 75657345 / -1.7% 0.72 / 0.70 / +2.1%
tpcds_q30/datafusion:vortex-file-compressed 26077498 / 25828708 / +1.0% 43422636 / 43291925 / +0.3% 0.60 / 0.60 / +0.7%
tpcds_q31/datafusion:vortex-file-compressed 58072192 / 58867606 / -1.4% 83077424 / 83455412 / -0.5% 0.70 / 0.71 / -0.9%
tpcds_q32/datafusion:vortex-file-compressed 12416557 / 12386412 / +0.2% 29081267 / 28927311 / +0.5% 0.43 / 0.43 / -0.3%
tpcds_q33/datafusion:vortex-file-compressed 27294070 / 27251526 / +0.2% 50095356 / 48738507 / +2.8% 0.54 / 0.56 / -2.6%
tpcds_q34/datafusion:vortex-file-compressed 17457810 / 17480834 / -0.1% 36073525 / 34421823 / +4.8% 0.48 / 0.51 / -4.7%
tpcds_q35/datafusion:vortex-file-compressed 29696277 / 30075320 / -1.3% 53608699 / 53053102 / +1.0% 0.55 / 0.57 / -2.3%
tpcds_q36/datafusion:vortex-file-compressed 46954155 / 46675208 / +0.6% 69172704 / 69079110 / +0.1% 0.68 / 0.68 / +0.5%
tpcds_q37/datafusion:vortex-file-compressed 11852016 / 11904318 / -0.4% 33110421 / 33415021 / -0.9% 0.36 / 0.36 / +0.5%
tpcds_q38/datafusion:vortex-file-compressed 25114130 / 25706742 / -2.3% 45321489 / 46753111 / -3.1% 0.55 / 0.55 / +0.8%
tpcds_q39/datafusion:vortex-file-compressed 64935370 / 64869784 / +0.1% 90386039 / 89570934 / +0.9% 0.72 / 0.72 / -0.8%
tpcds_q40/datafusion:vortex-file-compressed 23532575 / 23325174 / +0.9% 40729319 / 42047023 / -3.1% 0.58 / 0.55 / +4.2%
tpcds_q41/datafusion:vortex-file-compressed 20484419 / 20342688 / +0.7% 32062369 / 31695807 / +1.2% 0.64 / 0.64 / -0.5%
tpcds_q42/datafusion:vortex-file-compressed 10873587 / 10755524 / +1.1% 25573433 / 26462137 / -3.4% 0.43 / 0.41 / +4.6%
tpcds_q43/datafusion:vortex-file-compressed 12291045 / 12549322 / -2.1% 31180888 / 31280405 / -0.3% 0.39 / 0.40 / -1.7%
tpcds_q44/datafusion:vortex-file-compressed 27533478 / 28515654 / -3.4% 50099062 / 50995861 / -1.8% 0.55 / 0.56 / -1.7%
tpcds_q45/datafusion:vortex-file-compressed 16347022 / 16298120 / +0.3% 32994587 / 33457337 / -1.4% 0.50 / 0.49 / +1.7%
tpcds_q46/datafusion:vortex-file-compressed 24184375 / 23229427 / +4.1% 47470428 / 44755548 / +6.1% 0.51 / 0.52 / -1.8%
tpcds_q47/datafusion:vortex-file-compressed 74873946 / 74695810 / +0.2% 106203528 / 101833669 / +4.3% 0.71 / 0.73 / -3.9%
tpcds_q48/datafusion:vortex-file-compressed 29233190 / 28485442 / +2.6% 51739212 / 50825432 / +1.8% 0.57 / 0.56 / +0.8%
tpcds_q49/datafusion:vortex-file-compressed 56075976 / 56616678 / -1.0% 78167712 / 79193807 / -1.3% 0.72 / 0.71 / +0.3%
tpcds_q50/datafusion:vortex-file-compressed 29760017 / 30225275 / -1.5% 50373018 / 51542216 / -2.3% 0.59 / 0.59 / +0.7%
tpcds_q51/datafusion:vortex-file-compressed 66223684 / 66238316 / -0.0% 86426858 / 85961923 / +0.5% 0.77 / 0.77 / -0.6%
tpcds_q52/datafusion:vortex-file-compressed 11359320 / 11173757 / +1.7% 26594793 / 26707892 / -0.4% 0.43 / 0.42 / +2.1%
tpcds_q53/datafusion:vortex-file-compressed 17851334 / 17815272 / +0.2% 37718333 / 38592794 / -2.3% 0.47 / 0.46 / +2.5%
tpcds_q54/datafusion:vortex-file-compressed 31291430 / 31294044 / -0.0% 54446941 / 54411096 / +0.1% 0.57 / 0.58 / -0.1%
tpcds_q55/datafusion:vortex-file-compressed 10778180 / 10977064 / -1.8% 26352644 / 26445815 / -0.4% 0.41 / 0.42 / -1.5%
tpcds_q56/datafusion:vortex-file-compressed 26691382 / 26267608 / +1.6% 44848535 / 47242232 / -5.1% 0.60 / 0.56 / +7.0%
tpcds_q57/datafusion:vortex-file-compressed 62595236 / 61853212 / +1.2% 86531461 / 86088207 / +0.5% 0.72 / 0.72 / +0.7%
tpcds_q58/datafusion:vortex-file-compressed 38354870 / 38380444 / -0.1% 62487034 / 63376054 / -1.4% 0.61 / 0.61 / +1.4%
tpcds_q59/datafusion:vortex-file-compressed 29617328 / 29424571 / +0.7% 55278491 / 53366384 / +3.6% 0.54 / 0.55 / -2.8%
tpcds_q60/datafusion:vortex-file-compressed 26126928 / 25428852 / +2.7% 45161605 / 46248957 / -2.4% 0.58 / 0.55 / +5.2%
tpcds_q61/datafusion:vortex-file-compressed 22001553 / 21069785 / +4.4% 42078367 / 42650322 / -1.3% 0.52 / 0.49 / +5.8%
tpcds_q62/datafusion:vortex-file-compressed 16496939 / 16464280 / +0.2% 34064521 / 34481569 / -1.2% 0.48 / 0.48 / +1.4%
tpcds_q63/datafusion:vortex-file-compressed 17493781 / 17537600 / -0.2% 38336098 / 37514994 / +2.2% 0.46 / 0.47 / -2.4%
tpcds_q64/datafusion:vortex-file-compressed 210264412 / 209658176 / +0.3% 241077458 / 244014821 / -1.2% 0.87 / 0.86 / +1.5%
tpcds_q65/datafusion:vortex-file-compressed 71793796 / 71931186 / -0.2% 91552064 / 93293623 / -1.9% 0.78 / 0.77 / +1.7%
tpcds_q66/datafusion:vortex-file-compressed 50443344 / 50314022 / +0.3% 73583830 / 73443461 / +0.2% 0.69 / 0.69 / +0.1%
tpcds_q67/datafusion:vortex-file-compressed 50365474 / 50809885 / -0.9% 81020695 / 80439935 / +0.7% 0.62 / 0.63 / -1.6%
tpcds_q68/datafusion:vortex-file-compressed 23076648 / 22935066 / +0.6% 45486117 / 46212376 / -1.6% 0.51 / 0.50 / +2.2%
tpcds_q69/datafusion:vortex-file-compressed 25187806 / 25957220 / -3.0% 46364346 / 48199065 / -3.8% 0.54 / 0.54 / +0.9%
tpcds_q70/datafusion:vortex-file-compressed 70764716 / 70921686 / -0.2% 92505238 / 91526378 / +1.1% 0.76 / 0.77 / -1.3%
tpcds_q71/datafusion:vortex-file-compressed 18123562 / 19479654 / -7.0% 39229577 / 39385822 / -0.4% 0.46 / 0.49 / -6.6%
tpcds_q72/datafusion:vortex-file-compressed 339417298 / 349635619 / -2.9% 390265887 / 390053124 / +0.1% 0.87 / 0.90 / -3.0%
tpcds_q73/datafusion:vortex-file-compressed 16703950 / 16370256 / +2.0% 34995172 / 35825318 / -2.3% 0.48 / 0.46 / +4.5%
tpcds_q74/datafusion:vortex-file-compressed 40165328 / 40729710 / -1.4% 65860214 / 66101755 / -0.4% 0.61 / 0.62 / -1.0%
tpcds_q75/datafusion:vortex-file-compressed 135920778 / 133231577 / +2.0% 164070087 / 159508865 / +2.9% 0.83 / 0.84 / -0.8%
tpcds_q76/datafusion:vortex-file-compressed 29148424 / 29878010 / -2.4% 45879395 / 49131830 / -6.6% 0.64 / 0.61 / +4.5%
tpcds_q77/datafusion:vortex-file-compressed 45170834 / 44794824 / +0.8% 64552704 / 68725579 / -6.1% 0.70 / 0.65 / +7.4%
tpcds_q78/datafusion:vortex-file-compressed 65326016 / 64149016 / +1.8% 91357349 / 91826652 / -0.5% 0.72 / 0.70 / +2.4%
tpcds_q79/datafusion:vortex-file-compressed 19940974 / 19747138 / +1.0% 43090352 / 41330856 / +4.3% 0.46 / 0.48 / -3.1%
tpcds_q80/datafusion:vortex-file-compressed 73238520 / 73516756 / -0.4% 98894915 / 103399339 / -4.4% 0.74 / 0.71 / +4.2%
tpcds_q81/datafusion:vortex-file-compressed 26264833 / 26433507 / -0.6% 43368079 / 44049315 / -1.5% 0.61 / 0.60 / +0.9%
tpcds_q82/datafusion:vortex-file-compressed 11767016 / 12061347 / -2.4% 34334231 / 33334269 / +3.0% 0.34 / 0.36 / -5.3%
tpcds_q83/datafusion:vortex-file-compressed 33236500 / 32437804 / +2.5% 49220620 / 52048289 / -5.4% 0.68 / 0.62 / +8.3%
tpcds_q84/datafusion:vortex-file-compressed 10064057 / 10107068 / -0.4% 24909942 / 25586667 / -2.6% 0.40 / 0.40 / +2.3%
tpcds_q85/datafusion:vortex-file-compressed 53026804 / 53327322 / -0.6% 78758694 / 79919547 / -1.5% 0.67 / 0.67 / +0.9%
tpcds_q86/datafusion:vortex-file-compressed 15647729 / 15658314 / -0.1% 32312324 / 32167556 / +0.5% 0.48 / 0.49 / -0.5%
tpcds_q87/datafusion:vortex-file-compressed 25854930 / 26232334 / -1.4% 48889378 / 48269535 / +1.3% 0.53 / 0.54 / -2.7%
tpcds_q88/datafusion:vortex-file-compressed 30874000 / 31404654 / -1.7% 51637405 / 50217706 / +2.8% 0.60 / 0.63 / -4.4%
tpcds_q89/datafusion:vortex-file-compressed 21171874 / 20857143 / +1.5% 42317488 / 40998842 / +3.2% 0.50 / 0.51 / -1.7%
tpcds_q90/datafusion:vortex-file-compressed 9777142 / 9857710 / -0.8% 24145116 / 24004775 / +0.6% 0.40 / 0.41 / -1.4%
tpcds_q91/datafusion:vortex-file-compressed 15283435 / 16590985 / -7.9% 35702873 / 36406808 / -1.9% 0.43 / 0.46 / -6.1%
tpcds_q92/datafusion:vortex-file-compressed 12727032 / 12785642 / -0.5% 27256677 / 28212901 / -3.4% 0.47 / 0.45 / +3.0%
tpcds_q93/datafusion:vortex-file-compressed 20235472 / 20514612 / -1.4% 40351563 / 39172325 / +3.0% 0.50 / 0.52 / -4.2%
tpcds_q94/datafusion:vortex-file-compressed 18475590 / 18329141 / +0.8% 38001910 / 37017769 / +2.7% 0.49 / 0.50 / -1.8%
tpcds_q95/datafusion:vortex-file-compressed 41605779 / 41892583 / -0.7% 61395176 / 60792282 / +1.0% 0.68 / 0.69 / -1.7%
tpcds_q96/datafusion:vortex-file-compressed 7774210 / 7680347 / +1.2% 23890778 / 24590568 / -2.8% 0.33 / 0.31 / +4.2%
tpcds_q97/datafusion:vortex-file-compressed 16982698 / 16976546 / +0.0% 38104147 / 36962622 / +3.1% 0.45 / 0.46 / -3.0%
tpcds_q98/datafusion:vortex-file-compressed 16306138 / 16323012 / -0.1% 35815125 / 35491744 / +0.9% 0.46 / 0.46 / -1.0%
tpcds_q99/datafusion:vortex-file-compressed 15921890 / 16055726 / -0.8% 34709365 / 34645287 / +0.2% 0.46 / 0.46 / -1.0%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 43319478 / 42790168 / +1.2% 57975926 / 57645148 / +0.6% 0.75 / 0.74 / +0.7%
tpcds_q02/datafusion:parquet 54702490 / 54765044 / -0.1% 69246605 / 70421354 / -1.7% 0.79 / 0.78 / +1.6%
tpcds_q03/datafusion:parquet 18983897 / 19097265 / -0.6% 30676938 / 30445091 / +0.8% 0.62 / 0.63 / -1.3%
tpcds_q04/datafusion:parquet 179413930 / 178887614 / +0.3% 206236490 / 202039145 / +2.1% 0.87 / 0.89 / -1.7%
tpcds_q05/datafusion:parquet 67799755 / 67878001 / -0.1% 87721587 / 89709488 / -2.2% 0.77 / 0.76 / +2.1%
tpcds_q06/datafusion:parquet 34109072 / 33778804 / +1.0% 46987407 / 45692699 / +2.8% 0.73 / 0.74 / -1.8%
tpcds_q07/datafusion:parquet 47572224 / 47393786 / +0.4% 65878711 / 65545052 / +0.5% 0.72 / 0.72 / -0.1%
tpcds_q08/datafusion:parquet 31065098 / 30786170 / +0.9% 46588960 / 43159155 / +7.9% 0.67 / 0.71 / -6.5%
tpcds_q09/datafusion:parquet 32980032 / 30591208 / +7.8% 36896327 / 42974319 / -14.1% 🟢 0.89 / 0.71 / +25.6%
tpcds_q10/datafusion:parquet 43967780 / 43909954 / +0.1% 54085034 / 58393927 / -7.4% 0.81 / 0.75 / +8.1%
tpcds_q11/datafusion:parquet 97887660 / 97359220 / +0.5% 119278880 / 119001225 / +0.2% 0.82 / 0.82 / +0.3%
tpcds_q12/datafusion:parquet 23848903 / 23515044 / +1.4% 34641700 / 34010680 / +1.9% 0.69 / 0.69 / -0.4%
tpcds_q13/datafusion:parquet 45711686 / 46313484 / -1.3% 67187530 / 68018563 / -1.2% 0.68 / 0.68 / -0.1%
tpcds_q14/datafusion:parquet 537133292 / 534683184 / +0.5% 580304057 / 582375794 / -0.4% 0.93 / 0.92 / +0.8%
tpcds_q15/datafusion:parquet 23359367 / 24175697 / -3.4% 36749162 / 36583322 / +0.5% 0.64 / 0.66 / -3.8%
tpcds_q16/datafusion:parquet 37189438 / 37052644 / +0.4% 49252901 / 49572893 / -0.6% 0.76 / 0.75 / +1.0%
tpcds_q17/datafusion:parquet 75617996 / 75207760 / +0.5% 95832364 / 98319183 / -2.5% 0.79 / 0.76 / +3.2%
tpcds_q18/datafusion:parquet 65263098 / 67278429 / -3.0% 87895820 / 89472378 / -1.8% 0.74 / 0.75 / -1.3%
tpcds_q19/datafusion:parquet 29260580 / 29426323 / -0.6% 41519974 / 42286597 / -1.8% 0.70 / 0.70 / +1.3%
tpcds_q20/datafusion:parquet 24423570 / 24728196 / -1.2% 37843013 / 35453048 / +6.7% 0.65 / 0.70 / -7.5%
tpcds_q21/datafusion:parquet 20188534 / 19988597 / +1.0% 30766067 / 33163707 / -7.2% 0.66 / 0.60 / +8.9%
tpcds_q22/datafusion:parquet 77506134 / 77207674 / +0.4% 88619783 / 87517272 / +1.3% 0.87 / 0.88 / -0.9%
tpcds_q23/datafusion:parquet 91154203 / 91103138 / +0.1% 112563041 / 115810894 / -2.8% 0.81 / 0.79 / +2.9%
tpcds_q24/datafusion:parquet 90493627 / 90312194 / +0.2% 113959243 / 114753768 / -0.7% 0.79 / 0.79 / +0.9%
tpcds_q25/datafusion:parquet 80362818 / 82183728 / -2.2% 98971551 / 101090115 / -2.1% 0.81 / 0.81 / -0.1%
tpcds_q26/datafusion:parquet 42848250 / 43975604 / -2.6% 59632980 / 60140227 / -0.8% 0.72 / 0.73 / -1.7%
tpcds_q27/datafusion:parquet 79167590 / 75256415 / +5.2% 100584531 / 96796596 / +3.9% 0.79 / 0.78 / +1.2%
tpcds_q28/datafusion:parquet 28457353 / 28282492 / +0.6% 42639334 / 40540051 / +5.2% 0.67 / 0.70 / -4.3%
tpcds_q29/datafusion:parquet 74520270 / 76327373 / -2.4% 97341281 / 95497789 / +1.9% 0.77 / 0.80 / -4.2%
tpcds_q30/datafusion:parquet 45072710 / 44172996 / +2.0% 56249898 / 56428909 / -0.3% 0.80 / 0.78 / +2.4%
tpcds_q31/datafusion:parquet 81379388 / 81059734 / +0.4% 99807407 / 97847034 / +2.0% 0.82 / 0.83 / -1.6%
tpcds_q32/datafusion:parquet 24833062 / 26106716 / -4.9% 38916113 / 38996408 / -0.2% 0.64 / 0.67 / -4.7%
tpcds_q33/datafusion:parquet 39053004 / 36632188 / +6.6% 52099712 / 51696853 / +0.8% 0.75 / 0.71 / +5.8%
tpcds_q34/datafusion:parquet 24146041 / 24283762 / -0.6% 34661191 / 35496823 / -2.4% 0.70 / 0.68 / +1.8%
tpcds_q35/datafusion:parquet 49838874 / 51092331 / -2.5% 64464861 / 63128294 / +2.1% 0.77 / 0.81 / -4.5%
tpcds_q36/datafusion:parquet 52757192 / 52133216 / +1.2% 69701248 / 73276361 / -4.9% 0.76 / 0.71 / +6.4%
tpcds_q37/datafusion:parquet 21278994 / 21186441 / +0.4% 33338582 / 32501720 / +2.6% 0.64 / 0.65 / -2.1%
tpcds_q38/datafusion:parquet 44833310 / 44473320 / +0.8% 62053994 / 60661224 / +2.3% 0.72 / 0.73 / -1.5%
tpcds_q39/datafusion:parquet 68208318 / 67893870 / +0.5% 87222091 / 85512997 / +2.0% 0.78 / 0.79 / -1.5%
tpcds_q40/datafusion:parquet 30428154 / 30116612 / +1.0% 49874290 / 50944751 / -2.1% 0.61 / 0.59 / +3.2%
tpcds_q41/datafusion:parquet 19868602 / 19875884 / -0.0% 31586523 / 30988887 / +1.9% 0.63 / 0.64 / -1.9%
tpcds_q42/datafusion:parquet 18124405 / 18263912 / -0.8% 31934980 / 31580411 / +1.1% 0.57 / 0.58 / -1.9%
tpcds_q43/datafusion:parquet 19067726 / 19328598 / -1.3% 30549570 / 32363765 / -5.6% 0.62 / 0.60 / +4.5%
tpcds_q44/datafusion:parquet 35026382 / 34729506 / +0.9% 48380637 / 49650609 / -2.6% 0.72 / 0.70 / +3.5%
tpcds_q45/datafusion:parquet 28176464 / 27674712 / +1.8% 43812636 / 40581829 / +8.0% 0.64 / 0.68 / -5.7%
tpcds_q46/datafusion:parquet 29205304 / 28849347 / +1.2% 45294483 / 44446206 / +1.9% 0.64 / 0.65 / -0.7%
tpcds_q47/datafusion:parquet 96304137 / 97767068 / -1.5% 118902453 / 116071791 / +2.4% 0.81 / 0.84 / -3.8%
tpcds_q48/datafusion:parquet 42254911 / 42223134 / +0.1% 60239596 / 58362840 / +3.2% 0.70 / 0.72 / -3.0%
tpcds_q49/datafusion:parquet 70814100 / 71584984 / -1.1% 95281025 / 93559482 / +1.8% 0.74 / 0.77 / -2.9%
tpcds_q50/datafusion:parquet 47818448 / 47188732 / +1.3% 66265373 / 65957634 / +0.5% 0.72 / 0.72 / +0.9%
tpcds_q51/datafusion:parquet 75183832 / 75687516 / -0.7% 92911476 / 93987537 / -1.1% 0.81 / 0.81 / +0.5%
tpcds_q52/datafusion:parquet 18647757 / 18477546 / +0.9% 29434106 / 30516528 / -3.5% 0.63 / 0.61 / +4.6%
tpcds_q53/datafusion:parquet 22533970 / 22069787 / +2.1% 37819284 / 37394397 / +1.1% 0.60 / 0.59 / +1.0%
tpcds_q54/datafusion:parquet 53434608 / 53068499 / +0.7% 68613053 / 66798825 / +2.7% 0.78 / 0.79 / -2.0%
tpcds_q55/datafusion:parquet 18068240 / 18177591 / -0.6% 28582118 / 29615062 / -3.5% 0.63 / 0.61 / +3.0%
tpcds_q56/datafusion:parquet 41346386 / 40536538 / +2.0% 53689909 / 51702806 / +3.8% 0.77 / 0.78 / -1.8%
tpcds_q57/datafusion:parquet 99346254 / 100992704 / -1.6% 120906496 / 119321534 / +1.3% 0.82 / 0.85 / -2.9%
tpcds_q58/datafusion:parquet 64786075 / 65003510 / -0.3% 81820190 / 81993727 / -0.2% 0.79 / 0.79 / -0.1%
tpcds_q59/datafusion:parquet 47910255 / 47142071 / +1.6% 65570182 / 64332209 / +1.9% 0.73 / 0.73 / -0.3%
tpcds_q60/datafusion:parquet 40259652 / 41143805 / -2.1% 52537213 / 56528494 / -7.1% 0.77 / 0.73 / +5.3%
tpcds_q61/datafusion:parquet 36062214 / 37070528 / -2.7% 50795795 / 50658408 / +0.3% 0.71 / 0.73 / -3.0%
tpcds_q62/datafusion:parquet 25015620 / 25299585 / -1.1% 36150594 / 37400865 / -3.3% 0.69 / 0.68 / +2.3%
tpcds_q63/datafusion:parquet 22198230 / 22137338 / +0.3% 36813062 / 37267059 / -1.2% 0.60 / 0.59 / +1.5%
tpcds_q64/datafusion:parquet 286546712 / 283491307 / +1.1% 321614778 / 324365594 / -0.8% 0.89 / 0.87 / +1.9%
tpcds_q65/datafusion:parquet 123888436 / 121796900 / +1.7% 137460210 / 140340790 / -2.1% 0.90 / 0.87 / +3.8%
tpcds_q66/datafusion:parquet 59898114 / 60159790 / -0.4% 75977009 / 74271493 / +2.3% 0.79 / 0.81 / -2.7%
tpcds_q67/datafusion:parquet 68077487 / 69200688 / -1.6% 91674847 / 92158955 / -0.5% 0.74 / 0.75 / -1.1%
tpcds_q68/datafusion:parquet 28665664 / 28638674 / +0.1% 47386531 / 47694525 / -0.6% 0.60 / 0.60 / +0.7%
tpcds_q69/datafusion:parquet 44182833 / 43345552 / +1.9% 57819173 / 54686235 / +5.7% 0.76 / 0.79 / -3.6%
tpcds_q70/datafusion:parquet 81701260 / 80271896 / +1.8% 96678620 / 100088952 / -3.4% 0.85 / 0.80 / +5.4%
tpcds_q71/datafusion:parquet 25617359 / 24373552 / +5.1% 36712272 / 38366867 / -4.3% 0.70 / 0.64 / +9.8%
tpcds_q72/datafusion:parquet 523200048 / 527329837 / -0.8% 549365043 / 560736807 / -2.0% 0.95 / 0.94 / +1.3%
tpcds_q73/datafusion:parquet 23742450 / 23675195 / +0.3% 35198337 / 35651529 / -1.3% 0.67 / 0.66 / +1.6%
tpcds_q74/datafusion:parquet 69821379 / 69750544 / +0.1% 85064400 / 88419484 / -3.8% 0.82 / 0.79 / +4.0%
tpcds_q75/datafusion:parquet 149200688 / 154280426 / -3.3% 178367061 / 175992735 / +1.3% 0.84 / 0.88 / -4.6%
tpcds_q76/datafusion:parquet 32467908 / 32552642 / -0.3% 45942635 / 46197310 / -0.6% 0.71 / 0.70 / +0.3%
tpcds_q77/datafusion:parquet 57083841 / 55912258 / +2.1% 75176447 / 75401961 / -0.3% 0.76 / 0.74 / +2.4%
tpcds_q78/datafusion:parquet 84991054 / 86298158 / -1.5% 116707027 / 119573989 / -2.4% 0.73 / 0.72 / +0.9%
tpcds_q79/datafusion:parquet 26724346 / 26941018 / -0.8% 40947061 / 41670899 / -1.7% 0.65 / 0.65 / +0.9%
tpcds_q80/datafusion:parquet 80004150 / 79571648 / +0.5% 108897240 / 107798298 / +1.0% 0.73 / 0.74 / -0.5%
tpcds_q81/datafusion:parquet 39019804 / 37708022 / +3.5% 50167138 / 49644780 / +1.1% 0.78 / 0.76 / +2.4%
tpcds_q82/datafusion:parquet 22076840 / 22862742 / -3.4% 34289705 / 35659042 / -3.8% 0.64 / 0.64 / +0.4%
tpcds_q83/datafusion:parquet 58512437 / 58728850 / -0.4% 72428198 / 73572759 / -1.6% 0.81 / 0.80 / +1.2%
tpcds_q84/datafusion:parquet 25596541 / 27588446 / -7.2% 40140686 / 37424130 / +7.3% 0.64 / 0.74 / -13.5%
tpcds_q85/datafusion:parquet 80224220 / 80037900 / +0.2% 103794455 / 103303133 / +0.5% 0.77 / 0.77 / -0.2%
tpcds_q86/datafusion:parquet 21021890 / 20803682 / +1.0% 32482234 / 32694603 / -0.6% 0.65 / 0.64 / +1.7%
tpcds_q87/datafusion:parquet 45281336 / 44953774 / +0.7% 62697389 / 58673543 / +6.9% 0.72 / 0.77 / -5.7%
tpcds_q88/datafusion:parquet 37197965 / 37194222 / +0.0% 49294741 / 51481242 / -4.2% 0.75 / 0.72 / +4.4%
tpcds_q89/datafusion:parquet 25404354 / 25767740 / -1.4% 40819468 / 40885679 / -0.2% 0.62 / 0.63 / -1.3%
tpcds_q90/datafusion:parquet 16146532 / 15051543 / +7.3% 26695954 / 27168268 / -1.7% 0.60 / 0.55 / +9.2%
tpcds_q91/datafusion:parquet 32176678 / 32426770 / -0.8% 46485291 / 45756299 / +1.6% 0.69 / 0.71 / -2.3%
tpcds_q92/datafusion:parquet 27078396 / 26788312 / +1.1% 39544969 / 39570067 / -0.1% 0.68 / 0.68 / +1.1%
tpcds_q93/datafusion:parquet 27026614 / 26826836 / +0.7% 44245878 / 45720426 / -3.2% 0.61 / 0.59 / +4.1%
tpcds_q94/datafusion:parquet 34918663 / 35612212 / -1.9% 47272245 / 47235641 / +0.1% 0.74 / 0.75 / -2.0%
tpcds_q95/datafusion:parquet 65783133 / 64407442 / +2.1% 77161255 / 79417285 / -2.8% 0.85 / 0.81 / +5.1%
tpcds_q96/datafusion:parquet 12896282 / 13109518 / -1.6% 23199076 / 25052704 / -7.4% 0.56 / 0.52 / +6.2%
tpcds_q97/datafusion:parquet 35402724 / 35212817 / +0.5% 51964226 / 51110766 / +1.7% 0.68 / 0.69 / -1.1%
tpcds_q98/datafusion:parquet 24848479 / 24928664 / -0.3% 38107790 / 36311664 / +4.9% 0.65 / 0.69 / -5.0%
tpcds_q99/datafusion:parquet 29861598 / 29956348 / -0.3% 41686473 / 41613620 / +0.2% 0.72 / 0.72 / -0.5%
duckdb / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15956458 / 16142117 / -1.2% 24489805 / 24883739 / -1.6% 0.65 / 0.65 / +0.4%
tpcds_q02/duckdb:vortex-file-compressed 17138754 / 16709276 / +2.6% 22426562 / 22051108 / +1.7% 0.76 / 0.76 / +0.9%
tpcds_q03/duckdb:vortex-file-compressed 7127233 / 7045657 / +1.2% 15893116 / 16301596 / -2.5% 0.45 / 0.43 / +3.8%
tpcds_q04/duckdb:vortex-file-compressed 46490258 / 45758252 / +1.6% 57195591 / 56479163 / +1.3% 0.81 / 0.81 / +0.3%
tpcds_q05/duckdb:vortex-file-compressed 22889118 / 23036528 / -0.6% 33261958 / 32578849 / +2.1% 0.69 / 0.71 / -2.7%
tpcds_q06/duckdb:vortex-file-compressed 24348865 / 24423028 / -0.3% 37414368 / 38193338 / -2.0% 0.65 / 0.64 / +1.8%
tpcds_q07/duckdb:vortex-file-compressed 13498024 / 13353038 / +1.1% 23831465 / 24712568 / -3.6% 0.57 / 0.54 / +4.8%
tpcds_q08/duckdb:vortex-file-compressed 17226578 / 17520489 / -1.7% 25488607 / 25721441 / -0.9% 0.68 / 0.68 / -0.8%
tpcds_q09/duckdb:vortex-file-compressed 19249016 / 19111982 / +0.7% 30535266 / 29348465 / +4.0% 0.63 / 0.65 / -3.2%
tpcds_q10/duckdb:vortex-file-compressed 27838526 / 27612226 / +0.8% 40943966 / 40320225 / +1.5% 0.68 / 0.68 / -0.7%
tpcds_q11/duckdb:vortex-file-compressed 37545558 / 36903964 / +1.7% 46429539 / 46177346 / +0.5% 0.81 / 0.80 / +1.2%
tpcds_q12/duckdb:vortex-file-compressed 10167186 / 10200694 / -0.3% 17231348 / 17187152 / +0.3% 0.59 / 0.59 / -0.6%
tpcds_q13/duckdb:vortex-file-compressed 20830572 / 21263297 / -2.0% 34346945 / 32547269 / +5.5% 0.61 / 0.65 / -7.2%
tpcds_q14/duckdb:vortex-file-compressed 57389968 / 57809828 / -0.7% 66372736 / 68046783 / -2.5% 0.86 / 0.85 / +1.8%
tpcds_q15/duckdb:vortex-file-compressed 11167518 / 11119113 / +0.4% 18426012 / 18816176 / -2.1% 0.61 / 0.59 / +2.6%
tpcds_q16/duckdb:vortex-file-compressed 24147328 / 24266849 / -0.5% 34682582 / 34786209 / -0.3% 0.70 / 0.70 / -0.2%
tpcds_q17/duckdb:vortex-file-compressed 24390121 / 24227736 / +0.7% 36314749 / 36525117 / -0.6% 0.67 / 0.66 / +1.3%
tpcds_q18/duckdb:vortex-file-compressed 31738659 / 31509080 / +0.7% 42608667 / 41766543 / +2.0% 0.74 / 0.75 / -1.3%
tpcds_q19/duckdb:vortex-file-compressed 76830303 / 77960863 / -1.5% 89547208 / 89377861 / +0.2% 0.86 / 0.87 / -1.6%
tpcds_q20/duckdb:vortex-file-compressed 10907071 / 10971804 / -0.6% 17579928 / 17747764 / -0.9% 0.62 / 0.62 / +0.4%
tpcds_q21/duckdb:vortex-file-compressed 9822462 / 9745305 / +0.8% 21197542 / 20923879 / +1.3% 0.46 / 0.47 / -0.5%
tpcds_q22/duckdb:vortex-file-compressed 17392171 / 17585292 / -1.1% 29644257 / 29572488 / +0.2% 0.59 / 0.59 / -1.3%
tpcds_q23/duckdb:vortex-file-compressed 37675106 / 38130006 / -1.2% 50413479 / 49924896 / +1.0% 0.75 / 0.76 / -2.2%
tpcds_q24/duckdb:vortex-file-compressed 26381468 / 26574018 / -0.7% 37043402 / 36642246 / +1.1% 0.71 / 0.73 / -1.8%
tpcds_q25/duckdb:vortex-file-compressed 22954990 / 23695962 / -3.1% 36428447 / 36381968 / +0.1% 0.63 / 0.65 / -3.3%
tpcds_q26/duckdb:vortex-file-compressed 12793148 / 13100696 / -2.3% 21093707 / 21291607 / -0.9% 0.61 / 0.62 / -1.4%
tpcds_q27/duckdb:vortex-file-compressed 15937970 / 15963922 / -0.2% 26705816 / 27540444 / -3.0% 0.60 / 0.58 / +3.0%
tpcds_q28/duckdb:vortex-file-compressed 15415982 / 15588588 / -1.1% 24866058 / 26167172 / -5.0% 0.62 / 0.60 / +4.1%
tpcds_q29/duckdb:vortex-file-compressed 22810932 / 22710729 / +0.4% 33586085 / 34899355 / -3.8% 0.68 / 0.65 / +4.4%
tpcds_q30/duckdb:vortex-file-compressed 16305118 / 15872199 / +2.7% 23945851 / 24336692 / -1.6% 0.68 / 0.65 / +4.4%
tpcds_q31/duckdb:vortex-file-compressed 17746000 / 18069675 / -1.8% 27072670 / 26891648 / +0.7% 0.66 / 0.67 / -2.4%
tpcds_q32/duckdb:vortex-file-compressed 12141400 / 11623212 / +4.5% 21169948 / 20950684 / +1.0% 0.57 / 0.55 / +3.4%
tpcds_q33/duckdb:vortex-file-compressed 19314892 / 18357493 / +5.2% 28258355 / 28185569 / +0.3% 0.68 / 0.65 / +4.9%
tpcds_q34/duckdb:vortex-file-compressed 13203536 / 13014242 / +1.5% 22426560 / 23047270 / -2.7% 0.59 / 0.56 / +4.3%
tpcds_q35/duckdb:vortex-file-compressed 28100599 / 27929879 / +0.6% 38477246 / 39014716 / -1.4% 0.73 / 0.72 / +2.0%
tpcds_q36/duckdb:vortex-file-compressed 14179110 / 13908706 / +1.9% 23668229 / 23970044 / -1.3% 0.60 / 0.58 / +3.2%
tpcds_q37/duckdb:vortex-file-compressed 9614638 / 9515167 / +1.0% 24542314 / 24340830 / +0.8% 0.39 / 0.39 / +0.2%
tpcds_q38/duckdb:vortex-file-compressed 24219434 / 24300837 / -0.3% 32040872 / 32361884 / -1.0% 0.76 / 0.75 / +0.7%
tpcds_q39/duckdb:vortex-file-compressed 18933127 / 18334157 / +3.3% 31269469 / 33896858 / -7.8% 0.61 / 0.54 / +11.9%
tpcds_q40/duckdb:vortex-file-compressed 14244180 / 14107318 / +1.0% 20550320 / 20388858 / +0.8% 0.69 / 0.69 / +0.2%
tpcds_q41/duckdb:vortex-file-compressed 18743070 / 18789802 / -0.2% 25278723 / 25592058 / -1.2% 0.74 / 0.73 / +1.0%
tpcds_q42/duckdb:vortex-file-compressed 7009694 / 7115361 / -1.5% 15843370 / 16445425 / -3.7% 0.44 / 0.43 / +2.3%
tpcds_q43/duckdb:vortex-file-compressed 9845280 / 9847942 / -0.0% 18829465 / 19094789 / -1.4% 0.52 / 0.52 / +1.4%
tpcds_q44/duckdb:vortex-file-compressed 12741378 / 12546484 / +1.6% 24485162 / 24279354 / +0.8% 0.52 / 0.52 / +0.7%
tpcds_q45/duckdb:vortex-file-compressed 22958206 / 23264362 / -1.3% 30715855 / 31280867 / -1.8% 0.75 / 0.74 / +0.5%
tpcds_q46/duckdb:vortex-file-compressed 19655213 / 19680982 / -0.1% 27522166 / 27352411 / +0.6% 0.71 / 0.72 / -0.7%
tpcds_q47/duckdb:vortex-file-compressed 34468828 / 34836730 / -1.1% 44434942 / 45045037 / -1.4% 0.78 / 0.77 / +0.3%
tpcds_q48/duckdb:vortex-file-compressed 23374974 / 23197005 / +0.8% 36269526 / 36376826 / -0.3% 0.64 / 0.64 / +1.1%
tpcds_q49/duckdb:vortex-file-compressed 18775470 / 18947468 / -0.9% 30571739 / 31460092 / -2.8% 0.61 / 0.60 / +2.0%
tpcds_q50/duckdb:vortex-file-compressed 16640828 / 16868396 / -1.3% 28706109 / 27316563 / +5.1% 0.58 / 0.62 / -6.1%
tpcds_q51/duckdb:vortex-file-compressed 49487226 / 48747450 / +1.5% 76455262 / 76407317 / +0.1% 0.65 / 0.64 / +1.5%
tpcds_q52/duckdb:vortex-file-compressed 7126267 / 7223788 / -1.4% 15640960 / 16544978 / -5.5% 0.46 / 0.44 / +4.4%
tpcds_q53/duckdb:vortex-file-compressed 11465818 / 11580455 / -1.0% 21400984 / 20950001 / +2.2% 0.54 / 0.55 / -3.1%
tpcds_q54/duckdb:vortex-file-compressed 20745090 / 20288914 / +2.2% 32117644 / 30647003 / +4.8% 0.65 / 0.66 / -2.4%
tpcds_q55/duckdb:vortex-file-compressed 7010922 / 6902994 / +1.6% 15706765 / 15931120 / -1.4% 0.45 / 0.43 / +3.0%
tpcds_q56/duckdb:vortex-file-compressed 18042378 / 17960990 / +0.5% 28956411 / 27713372 / +4.5% 0.62 / 0.65 / -3.9%
tpcds_q57/duckdb:vortex-file-compressed 26088410 / 26098614 / -0.0% 34347078 / 34582639 / -0.7% 0.76 / 0.75 / +0.6%
tpcds_q58/duckdb:vortex-file-compressed 20100560 / 20331842 / -1.1% 31205212 / 30877019 / +1.1% 0.64 / 0.66 / -2.2%
tpcds_q59/duckdb:vortex-file-compressed 19358378 / 19688060 / -1.7% 26558018 / 27058532 / -1.8% 0.73 / 0.73 / +0.2%
tpcds_q60/duckdb:vortex-file-compressed 18495491 / 18617518 / -0.7% 28782162 / 29659067 / -3.0% 0.64 / 0.63 / +2.4%
tpcds_q61/duckdb:vortex-file-compressed 25466425 / 25605872 / -0.5% 34078922 / 34595872 / -1.5% 0.75 / 0.74 / +1.0%
tpcds_q62/duckdb:vortex-file-compressed 11760066 / 11685066 / +0.6% 18733614 / 18455703 / +1.5% 0.63 / 0.63 / -0.9%
tpcds_q63/duckdb:vortex-file-compressed 10977525 / 10996244 / -0.2% 20293134 / 20737428 / -2.1% 0.54 / 0.53 / +2.0%
tpcds_q64/duckdb:vortex-file-compressed 49006168 / 49381384 / -0.8% 64267637 / 66047661 / -2.7% 0.76 / 0.75 / +2.0%
tpcds_q65/duckdb:vortex-file-compressed 13098174 / 13292210 / -1.5% 23728791 / 23558633 / +0.7% 0.55 / 0.56 / -2.2%
tpcds_q66/duckdb:vortex-file-compressed 28989146 / 29707612 / -2.4% 36370903 / 35612347 / +2.1% 0.80 / 0.83 / -4.5%
tpcds_q67/duckdb:vortex-file-compressed 58283890 / 58292138 / -0.0% 67479178 / 66652555 / +1.2% 0.86 / 0.87 / -1.2%
tpcds_q68/duckdb:vortex-file-compressed 18982922 / 19064728 / -0.4% 27728379 / 27773620 / -0.2% 0.68 / 0.69 / -0.3%
tpcds_q69/duckdb:vortex-file-compressed 22339558 / 22826429 / -2.1% 37842189 / 37192445 / +1.7% 0.59 / 0.61 / -3.8%
tpcds_q70/duckdb:vortex-file-compressed 15880663 / 16314066 / -2.7% 26764638 / 27191282 / -1.6% 0.59 / 0.60 / -1.1%
tpcds_q71/duckdb:vortex-file-compressed 13134290 / 12617499 / +4.1% 23278827 / 23746617 / -2.0% 0.56 / 0.53 / +6.2%
tpcds_q72/duckdb:vortex-file-compressed 52201714 / 51945424 / +0.5% 63059943 / 62476510 / +0.9% 0.83 / 0.83 / -0.4%
tpcds_q73/duckdb:vortex-file-compressed 11938430 / 11909118 / +0.2% 21445326 / 21101470 / +1.6% 0.56 / 0.56 / -1.4%
tpcds_q74/duckdb:vortex-file-compressed 26242128 / 26041908 / +0.8% 34060763 / 34022832 / +0.1% 0.77 / 0.77 / +0.7%
tpcds_q75/duckdb:vortex-file-compressed 27690031 / 28133652 / -1.6% 38416187 / 38375865 / +0.1% 0.72 / 0.73 / -1.7%
tpcds_q76/duckdb:vortex-file-compressed 12750542 / 12764356 / -0.1% 22430544 / 22963071 / -2.3% 0.57 / 0.56 / +2.3%
tpcds_q77/duckdb:vortex-file-compressed 20759584 / 21418045 / -3.1% 31126543 / 32708962 / -4.8% 0.67 / 0.65 / +1.9%
tpcds_q78/duckdb:vortex-file-compressed 42633260 / 43337642 / -1.6% 54530909 / 53885227 / +1.2% 0.78 / 0.80 / -2.8%
tpcds_q79/duckdb:vortex-file-compressed 13062024 / 13232534 / -1.3% 22173297 / 21910779 / +1.2% 0.59 / 0.60 / -2.5%
tpcds_q80/duckdb:vortex-file-compressed 36708908 / 36847054 / -0.4% 48402823 / 49501801 / -2.2% 0.76 / 0.74 / +1.9%
tpcds_q81/duckdb:vortex-file-compressed 21426729 / 21429800 / -0.0% 29446219 / 30095533 / -2.2% 0.73 / 0.71 / +2.2%
tpcds_q82/duckdb:vortex-file-compressed 9591248 / 9708050 / -1.2% 25428089 / 25061879 / +1.5% 0.38 / 0.39 / -2.6%
tpcds_q83/duckdb:vortex-file-compressed 17494044 / 17427131 / +0.4% 24704776 / 24376519 / +1.3% 0.71 / 0.71 / -0.9%
tpcds_q84/duckdb:vortex-file-compressed 15412372 / 15770181 / -2.3% 23013392 / 23129342 / -0.5% 0.67 / 0.68 / -1.8%
tpcds_q85/duckdb:vortex-file-compressed 24373452 / 24403894 / -0.1% 36213187 / 36380296 / -0.5% 0.67 / 0.67 / +0.3%
tpcds_q86/duckdb:vortex-file-compressed 9740163 / 9717139 / +0.2% 16359989 / 15906721 / +2.8% 0.60 / 0.61 / -2.5%
tpcds_q87/duckdb:vortex-file-compressed 25886424 / 26017050 / -0.5% 34523596 / 33396290 / +3.4% 0.75 / 0.78 / -3.8%
tpcds_q88/duckdb:vortex-file-compressed 30542973 / 30324574 / +0.7% 37932683 / 38572757 / -1.7% 0.81 / 0.79 / +2.4%
tpcds_q89/duckdb:vortex-file-compressed 12031526 / 12106472 / -0.6% 21626694 / 20820791 / +3.9% 0.56 / 0.58 / -4.3%
tpcds_q90/duckdb:vortex-file-compressed 8116688 / 7989972 / +1.6% 15260761 / 15308508 / -0.3% 0.53 / 0.52 / +1.9%
tpcds_q91/duckdb:vortex-file-compressed 14771610 / 14428822 / +2.4% 22035339 / 23070665 / -4.5% 0.67 / 0.63 / +7.2%
tpcds_q92/duckdb:vortex-file-compressed 12141208 / 12093567 / +0.4% 19910309 / 20435129 / -2.6% 0.61 / 0.59 / +3.0%
tpcds_q93/duckdb:vortex-file-compressed 10551090 / 10489510 / +0.6% 22882562 / 23114016 / -1.0% 0.46 / 0.45 / +1.6%
tpcds_q94/duckdb:vortex-file-compressed 22083632 / 21924813 / +0.7% 32266887 / 32104172 / +0.5% 0.68 / 0.68 / +0.2%
tpcds_q95/duckdb:vortex-file-compressed 62499983 / 62938576 / -0.7% 71652187 / 71963612 / -0.4% 0.87 / 0.87 / -0.3%
tpcds_q96/duckdb:vortex-file-compressed 6852957 / 6838084 / +0.2% 15024506 / 14762606 / +1.8% 0.46 / 0.46 / -1.5%
tpcds_q97/duckdb:vortex-file-compressed 23080132 / 23163218 / -0.4% 32295972 / 31012754 / +4.1% 0.71 / 0.75 / -4.3%
tpcds_q98/duckdb:vortex-file-compressed 11261736 / 11360176 / -0.9% 20382083 / 19475284 / +4.7% 0.55 / 0.58 / -5.3%
tpcds_q99/duckdb:vortex-file-compressed 14670142 / 14668948 / +0.0% 23241226 / 22813440 / +1.9% 0.63 / 0.64 / -1.8%
duckdb / parquet / ns (0.998x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23799909 / 23966969 / -0.7% 30828671 / 30829019 / -0.0% 0.77 / 0.78 / -0.7%
tpcds_q02/duckdb:parquet 17791348 / 17973470 / -1.0% 23666013 / 23889142 / -0.9% 0.75 / 0.75 / -0.1%
tpcds_q03/duckdb:parquet 9772382 / 9784454 / -0.1% 16462224 / 15698965 / +4.9% 0.59 / 0.62 / -4.8%
tpcds_q04/duckdb:parquet 117145630 / 117912489 / -0.7% 127244802 / 126089418 / +0.9% 0.92 / 0.94 / -1.6%
tpcds_q05/duckdb:parquet 28193148 / 28395371 / -0.7% 32713321 / 32582262 / +0.4% 0.86 / 0.87 / -1.1%
tpcds_q06/duckdb:parquet 26041188 / 26216986 / -0.7% 35286739 / 35588221 / -0.8% 0.74 / 0.74 / +0.2%
tpcds_q07/duckdb:parquet 32028752 / 33420428 / -4.2% 38462708 / 38430436 / +0.1% 0.83 / 0.87 / -4.2%
tpcds_q08/duckdb:parquet 19622454 / 19585998 / +0.2% 26096273 / 26172260 / -0.3% 0.75 / 0.75 / +0.5%
tpcds_q09/duckdb:parquet 26914580 / 27371152 / -1.7% 30452463 / 29649948 / +2.7% 0.88 / 0.92 / -4.3%
tpcds_q10/duckdb:parquet 32758568 / 32361482 / +1.2% 40671378 / 40184705 / +1.2% 0.81 / 0.81 / +0.0%
tpcds_q11/duckdb:parquet 68165885 / 68514487 / -0.5% 75834734 / 76389272 / -0.7% 0.90 / 0.90 / +0.2%
tpcds_q12/duckdb:parquet 13952989 / 13876876 / +0.5% 19020604 / 19186188 / -0.9% 0.73 / 0.72 / +1.4%
tpcds_q13/duckdb:parquet 30174072 / 30368470 / -0.6% 39039600 / 40187836 / -2.9% 0.77 / 0.76 / +2.3%
tpcds_q14/duckdb:parquet 64229606 / 63510142 / +1.1% 68130298 / 67941108 / +0.3% 0.94 / 0.93 / +0.9%
tpcds_q15/duckdb:parquet 16553606 / 16546332 / +0.0% 22377743 / 22895550 / -2.3% 0.74 / 0.72 / +2.4%
tpcds_q16/duckdb:parquet 30161944 / 30007520 / +0.5% 37247712 / 36406547 / +2.3% 0.81 / 0.82 / -1.8%
tpcds_q17/duckdb:parquet 34158603 / 34177397 / -0.1% 40225485 / 40441172 / -0.5% 0.85 / 0.85 / +0.5%
tpcds_q18/duckdb:parquet 47077611 / 47042055 / +0.1% 54483655 / 54456240 / +0.1% 0.86 / 0.86 / +0.0%
tpcds_q19/duckdb:parquet 20108860 / 18502952 / +8.7% 25720985 / 25759438 / -0.1% 0.78 / 0.72 / +8.8%
tpcds_q20/duckdb:parquet 14933066 / 14883558 / +0.3% 19720176 / 19539428 / +0.9% 0.76 / 0.76 / -0.6%
tpcds_q21/duckdb:parquet 10306601 / 10610768 / -2.9% 17061367 / 17113867 / -0.3% 0.60 / 0.62 / -2.6%
tpcds_q22/duckdb:parquet 20780930 / 20553610 / +1.1% 26405077 / 26725059 / -1.2% 0.79 / 0.77 / +2.3%
tpcds_q23/duckdb:parquet 42599902 / 43575614 / -2.2% 48020481 / 46598579 / +3.1% 0.89 / 0.94 / -5.1%
tpcds_q24/duckdb:parquet 30118962 / 30367457 / -0.8% 36789960 / 36478211 / +0.9% 0.82 / 0.83 / -1.7%
tpcds_q25/duckdb:parquet 30602282 / 30221780 / +1.3% 37048367 / 36937818 / +0.3% 0.83 / 0.82 / +1.0%
tpcds_q26/duckdb:parquet 29109098 / 28776880 / +1.2% 35753444 / 35302112 / +1.3% 0.81 / 0.82 / -0.1%
tpcds_q27/duckdb:parquet 33677016 / 35523786 / -5.2% 44456422 / 41611405 / +6.8% 0.76 / 0.85 / -11.3%
tpcds_q28/duckdb:parquet 26512166 / 26328432 / +0.7% 38779436 / 34309155 / +13.0% 🔴 0.68 / 0.77 / -10.9%
tpcds_q29/duckdb:parquet 31837486 / 31825925 / +0.0% 39312947 / 38870785 / +1.1% 0.81 / 0.82 / -1.1%
tpcds_q30/duckdb:parquet 35174866 / 35121615 / +0.2% 44515851 / 44712118 / -0.4% 0.79 / 0.79 / +0.6%
tpcds_q31/duckdb:parquet 35621113 / 35271778 / +1.0% 42507509 / 42481930 / +0.1% 0.84 / 0.83 / +0.9%
tpcds_q32/duckdb:parquet 14182095 / 14057028 / +0.9% 20633909 / 20598153 / +0.2% 0.69 / 0.68 / +0.7%
tpcds_q33/duckdb:parquet 23808513 / 23124152 / +3.0% 28764709 / 29167207 / -1.4% 0.83 / 0.79 / +4.4%
tpcds_q34/duckdb:parquet 17723952 / 16934344 / +4.7% 24041906 / 24303526 / -1.1% 0.74 / 0.70 / +5.8%
tpcds_q35/duckdb:parquet 35102636 / 35187535 / -0.2% 43466152 / 43708254 / -0.6% 0.81 / 0.81 / +0.3%
tpcds_q36/duckdb:parquet 41545853 / 39353736 / +5.6% 47798558 / 47971471 / -0.4% 0.87 / 0.82 / +6.0%
tpcds_q37/duckdb:parquet 12634745 / 12699916 / -0.5% 19650478 / 19775516 / -0.6% 0.64 / 0.64 / +0.1%
tpcds_q38/duckdb:parquet 29558336 / 29409083 / +0.5% 33525593 / 33644782 / -0.4% 0.88 / 0.87 / +0.9%
tpcds_q39/duckdb:parquet 23009620 / 23268776 / -1.1% 30011433 / 30173448 / -0.5% 0.77 / 0.77 / -0.6%
tpcds_q40/duckdb:parquet 15724500 / 15818668 / -0.6% 21141754 / 21350935 / -1.0% 0.74 / 0.74 / +0.4%
tpcds_q41/duckdb:parquet 11940012 / 11937368 / +0.0% 18178042 / 17654837 / +3.0% 0.66 / 0.68 / -2.9%
tpcds_q42/duckdb:parquet 9487562 / 9467242 / +0.2% 15304794 / 15390992 / -0.6% 0.62 / 0.62 / +0.8%
tpcds_q43/duckdb:parquet 11950656 / 13469714 / -11.3% 🟢 18020687 / 18054883 / -0.2% 0.66 / 0.75 / -11.1%
tpcds_q44/duckdb:parquet 20255988 / 21728390 / -6.8% 26807408 / 27212840 / -1.5% 0.76 / 0.80 / -5.4%
tpcds_q45/duckdb:parquet 20733652 / 20743408 / -0.0% 27666558 / 27840154 / -0.6% 0.75 / 0.75 / +0.6%
tpcds_q46/duckdb:parquet 36027523 / 36989149 / -2.6% 43419672 / 44071441 / -1.5% 0.83 / 0.84 / -1.1%
tpcds_q47/duckdb:parquet 34191654 / 34549854 / -1.0% 41096633 / 41188971 / -0.2% 0.83 / 0.84 / -0.8%
tpcds_q48/duckdb:parquet 30988888 / 30458733 / +1.7% 36755360 / 37126578 / -1.0% 0.84 / 0.82 / +2.8%
tpcds_q49/duckdb:parquet 28765695 / 30077962 / -4.4% 35964411 / 35486466 / +1.3% 0.80 / 0.85 / -5.6%
tpcds_q50/duckdb:parquet 19284192 / 19303932 / -0.1% 25549694 / 25663854 / -0.4% 0.75 / 0.75 / +0.3%
tpcds_q51/duckdb:parquet 51639616 / 51972089 / -0.6% 60134241 / 60028308 / +0.2% 0.86 / 0.87 / -0.8%
tpcds_q52/duckdb:parquet 9694900 / 9584687 / +1.1% 15581846 / 15536302 / +0.3% 0.62 / 0.62 / +0.9%
tpcds_q53/duckdb:parquet 13688770 / 13859535 / -1.2% 20989921 / 21051270 / -0.3% 0.65 / 0.66 / -0.9%
tpcds_q54/duckdb:parquet 24735810 / 24769012 / -0.1% 31994383 / 32317507 / -1.0% 0.77 / 0.77 / +0.9%
tpcds_q55/duckdb:parquet 9463925 / 9458322 / +0.1% 15480667 / 15628508 / -0.9% 0.61 / 0.61 / +1.0%
tpcds_q56/duckdb:parquet 24867930 / 24451846 / +1.7% 30768919 / 30263945 / +1.7% 0.81 / 0.81 / +0.0%
tpcds_q57/duckdb:parquet 30252142 / 30496694 / -0.8% 36052097 / 36082806 / -0.1% 0.84 / 0.85 / -0.7%
tpcds_q58/duckdb:parquet 24100912 / 24048685 / +0.2% 29572297 / 29574418 / -0.0% 0.81 / 0.81 / +0.2%
tpcds_q59/duckdb:parquet 22687374 / 22781209 / -0.4% 28563458 / 28822798 / -0.9% 0.79 / 0.79 / +0.5%
tpcds_q60/duckdb:parquet 27409183 / 26326926 / +4.1% 32259515 / 32439784 / -0.6% 0.85 / 0.81 / +4.7%
tpcds_q61/duckdb:parquet 23886308 / 24386621 / -2.1% 28654876 / 28840820 / -0.6% 0.83 / 0.85 / -1.4%
tpcds_q62/duckdb:parquet 12631020 / 12837852 / -1.6% 17761422 / 18021543 / -1.4% 0.71 / 0.71 / -0.2%
tpcds_q63/duckdb:parquet 13939103 / 13411461 / +3.9% 20001492 / 20165946 / -0.8% 0.70 / 0.67 / +4.8%
tpcds_q64/duckdb:parquet 70243862 / 70200230 / +0.1% 79319478 / 80412181 / -1.4% 0.89 / 0.87 / +1.4%
tpcds_q65/duckdb:parquet 19614876 / 18687231 / +5.0% 25683607 / 26192155 / -1.9% 0.76 / 0.71 / +7.0%
tpcds_q66/duckdb:parquet 33113990 / 33369771 / -0.8% 38082854 / 37725314 / +0.9% 0.87 / 0.88 / -1.7%
tpcds_q67/duckdb:parquet 60660956 / 60819089 / -0.3% 67919413 / 67228661 / +1.0% 0.89 / 0.90 / -1.3%
tpcds_q68/duckdb:parquet 29343217 / 29259984 / +0.3% 36913130 / 36839271 / +0.2% 0.79 / 0.79 / +0.1%
tpcds_q69/duckdb:parquet 25814106 / 25569940 / +1.0% 34154888 / 34423942 / -0.8% 0.76 / 0.74 / +1.8%
tpcds_q70/duckdb:parquet 19109436 / 19192084 / -0.4% 27312602 / 26739741 / +2.1% 0.70 / 0.72 / -2.5%
tpcds_q71/duckdb:parquet 16749653 / 17054927 / -1.8% 24233727 / 23954836 / +1.2% 0.69 / 0.71 / -2.9%
tpcds_q72/duckdb:parquet 52146905 / 52932942 / -1.5% 58949205 / 59845214 / -1.5% 0.88 / 0.88 / +0.0%
tpcds_q73/duckdb:parquet 14693928 / 14661652 / +0.2% 21587619 / 21893138 / -1.4% 0.68 / 0.67 / +1.6%
tpcds_q74/duckdb:parquet 84011164 / 84390668 / -0.4% 90908595 / 91452584 / -0.6% 0.92 / 0.92 / +0.1%
tpcds_q75/duckdb:parquet 45120302 / 44687585 / +1.0% 50061342 / 50609140 / -1.1% 0.90 / 0.88 / +2.1%
tpcds_q76/duckdb:parquet 18716300 / 19040094 / -1.7% 23161491 / 23607159 / -1.9% 0.81 / 0.81 / +0.2%
tpcds_q77/duckdb:parquet 25260398 / 25425972 / -0.7% 31204867 / 32155175 / -3.0% 0.81 / 0.79 / +2.4%
tpcds_q78/duckdb:parquet 77466302 / 77093010 / +0.5% 85308375 / 84250182 / +1.3% 0.91 / 0.92 / -0.8%
tpcds_q79/duckdb:parquet 21117183 / 21130690 / -0.1% 28738884 / 29307556 / -1.9% 0.73 / 0.72 / +1.9%
tpcds_q80/duckdb:parquet 37052433 / 37184819 / -0.4% 43915445 / 43847529 / +0.2% 0.84 / 0.85 / -0.5%
tpcds_q81/duckdb:parquet 36348926 / 35976995 / +1.0% 44240781 / 44333291 / -0.2% 0.82 / 0.81 / +1.2%
tpcds_q82/duckdb:parquet 13458291 / 13373336 / +0.6% 20463995 / 20170460 / +1.5% 0.66 / 0.66 / -0.8%
tpcds_q83/duckdb:parquet 19860322 / 20056018 / -1.0% 25133063 / 24832676 / +1.2% 0.79 / 0.81 / -2.2%
tpcds_q84/duckdb:parquet 22821554 / 22552006 / +1.2% 28927505 / 28863502 / +0.2% 0.79 / 0.78 / +1.0%
tpcds_q85/duckdb:parquet 31844174 / 32295063 / -1.4% 38970852 / 39757757 / -2.0% 0.82 / 0.81 / +0.6%
tpcds_q86/duckdb:parquet 11619082 / 11671840 / -0.5% 17121475 / 17041774 / +0.5% 0.68 / 0.68 / -0.9%
tpcds_q87/duckdb:parquet 30886370 / 31295030 / -1.3% 34722918 / 35573309 / -2.4% 0.89 / 0.88 / +1.1%
tpcds_q88/duckdb:parquet 37943478 / 38174937 / -0.6% 42140924 / 41231775 / +2.2% 0.90 / 0.93 / -2.8%
tpcds_q89/duckdb:parquet 14150517 / 15086220 / -6.2% 21072848 / 21158011 / -0.4% 0.67 / 0.71 / -5.8%
tpcds_q90/duckdb:parquet 9962520 / 9834406 / +1.3% 14808989 / 15371268 / -3.7% 0.67 / 0.64 / +5.1%
tpcds_q91/duckdb:parquet 20788734 / 20811260 / -0.1% 28018352 / 28789486 / -2.7% 0.74 / 0.72 / +2.6%
tpcds_q92/duckdb:parquet 15484443 / 15505942 / -0.1% 22354744 / 21884251 / +2.1% 0.69 / 0.71 / -2.2%
tpcds_q93/duckdb:parquet 13998750 / 14008072 / -0.1% 20026856 / 20243382 / -1.1% 0.70 / 0.69 / +1.0%
tpcds_q94/duckdb:parquet 25476368 / 25514996 / -0.2% 32839030 / 32909651 / -0.2% 0.78 / 0.78 / +0.1%
tpcds_q95/duckdb:parquet 43556214 / 43842982 / -0.7% 49231135 / 49538887 / -0.6% 0.88 / 0.89 / -0.0%
tpcds_q96/duckdb:parquet 8101506 / 8142782 / -0.5% 13745219 / 13576831 / +1.2% 0.59 / 0.60 / -1.7%
tpcds_q97/duckdb:parquet 27356569 / 27093344 / +1.0% 34220982 / 32358898 / +5.8% 0.80 / 0.84 / -4.5%
tpcds_q98/duckdb:parquet 16255686 / 16374839 / -0.7% 22916708 / 23141567 / -1.0% 0.71 / 0.71 / +0.2%
tpcds_q99/duckdb:parquet 18703017 / 18656013 / +0.3% 24580810 / 24696138 / -0.5% 0.76 / 0.76 / +0.7%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 050a0087 vs base 246a397e
Vortex (geomean): hot 1.017x ➖ · cold 1.032x ➖


datafusion / vortex-file-compressed / ns (1.017x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44261500 / 44174877 / +0.2% 89701374 / 83381591 / +7.6% 0.49 / 0.53 / -6.9%
polarsignals_q01/datafusion:vortex-file-compressed 69790892 / 59498684 / +17.3% 🔴 111114181 / 113392846 / -2.0% 0.63 / 0.52 / +19.7%
polarsignals_q02/datafusion:vortex-file-compressed 11931178 / 11978216 / -0.4% 48988198 / 49588551 / -1.2% 0.24 / 0.24 / +0.8%
polarsignals_q03/datafusion:vortex-file-compressed 54533432 / 54233533 / +0.6% 114867157 / 112439358 / +2.2% 0.47 / 0.48 / -1.6%
polarsignals_q04/datafusion:vortex-file-compressed 9030480 / 9157702 / -1.4% 44473500 / 40279396 / +10.4% 🔴 0.20 / 0.23 / -10.7%
polarsignals_q05/datafusion:vortex-file-compressed 11433481 / 11581688 / -1.3% 44481658 / 44512288 / -0.1% 0.26 / 0.26 / -1.2%
polarsignals_q06/datafusion:vortex-file-compressed 23058036 / 23169506 / -0.5% 55561892 / 52769004 / +5.3% 0.41 / 0.44 / -5.5%
polarsignals_q07/datafusion:vortex-file-compressed 10613165 / 10570672 / +0.4% 41788976 / 41644590 / +0.3% 0.25 / 0.25 / +0.1%
polarsignals_q08/datafusion:vortex-file-compressed 98727696 / 97258934 / +1.5% 158656803 / 150877578 / +5.2% 0.62 / 0.64 / -3.5%
polarsignals_q09/datafusion:vortex-file-compressed 9940754 / 9737686 / +2.1% 41354823 / 39267571 / +5.3% 0.24 / 0.25 / -3.1%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 050a0087 vs base 246a397e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (-1.3%, low confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 0.992x ➖ · cold 0.989x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.999x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.985x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 92999880 / 92421374 / +0.6% 153962466 / 147337644 / +4.5% 0.60 / 0.63 / -3.7%
tpch_q02/datafusion:vortex-file-compressed 64455602 / 65027104 / -0.9% 93070053 / 94796662 / -1.8% 0.69 / 0.69 / +1.0%
tpch_q03/datafusion:vortex-file-compressed 64294781 / 63028520 / +2.0% 111637312 / 120349559 / -7.2% 0.58 / 0.52 / +10.0%
tpch_q04/datafusion:vortex-file-compressed 33226923 / 33815475 / -1.7% 72193161 / 69506239 / +3.9% 0.46 / 0.49 / -5.4%
tpch_q05/datafusion:vortex-file-compressed 118900388 / 117313380 / +1.4% 171100752 / 176710106 / -3.2% 0.69 / 0.66 / +4.7%
tpch_q06/datafusion:vortex-file-compressed 9994448 / 10725012 / -6.8% 58075029 / 57362676 / +1.2% 0.17 / 0.19 / -8.0%
tpch_q07/datafusion:vortex-file-compressed 135264541 / 134275774 / +0.7% 204380182 / 209952759 / -2.7% 0.66 / 0.64 / +3.5%
tpch_q08/datafusion:vortex-file-compressed 143748988 / 142650106 / +0.8% 212877249 / 221708280 / -4.0% 0.68 / 0.64 / +5.0%
tpch_q09/datafusion:vortex-file-compressed 183957951 / 184132835 / -0.1% 270060360 / 257568148 / +4.9% 0.68 / 0.71 / -4.7%
tpch_q10/datafusion:vortex-file-compressed 69651192 / 69455539 / +0.3% 134339044 / 134716861 / -0.3% 0.52 / 0.52 / +0.6%
tpch_q11/datafusion:vortex-file-compressed 43446011 / 43143661 / +0.7% 66736600 / 67640381 / -1.3% 0.65 / 0.64 / +2.1%
tpch_q12/datafusion:vortex-file-compressed 34089781 / 35061881 / -2.8% 75209715 / 85227270 / -11.8% 🟢 0.45 / 0.41 / +10.2%
tpch_q13/datafusion:vortex-file-compressed 46574301 / 48574220 / -4.1% 81718524 / 87462734 / -6.6% 0.57 / 0.56 / +2.6%
tpch_q14/datafusion:vortex-file-compressed 21558278 / 21632584 / -0.3% 85061443 / 86011756 / -1.1% 0.25 / 0.25 / +0.8%
tpch_q15/datafusion:vortex-file-compressed 33546838 / 33883815 / -1.0% 88601517 / 91939519 / -3.6% 0.38 / 0.37 / +2.7%
tpch_q16/datafusion:vortex-file-compressed 36888124 / 37360931 / -1.3% 65396005 / 67235326 / -2.7% 0.56 / 0.56 / +1.5%
tpch_q17/datafusion:vortex-file-compressed 178131319 / 179258740 / -0.6% 227366794 / 225548853 / +0.8% 0.78 / 0.79 / -1.4%
tpch_q18/datafusion:vortex-file-compressed 204712856 / 208064713 / -1.6% 270290523 / 265841334 / +1.7% 0.76 / 0.78 / -3.2%
tpch_q19/datafusion:vortex-file-compressed 26176496 / 30852811 / -15.2% 🟢 86251458 / 90459069 / -4.7% 0.30 / 0.34 / -11.0%
tpch_q20/datafusion:vortex-file-compressed 60116785 / 60119739 / -0.0% 116768228 / 116242771 / +0.5% 0.51 / 0.52 / -0.5%
tpch_q21/datafusion:vortex-file-compressed 178847515 / 179920903 / -0.6% 242306320 / 236016105 / +2.7% 0.74 / 0.76 / -3.2%
tpch_q22/datafusion:vortex-file-compressed 24749702 / 24937759 / -0.8% 51235364 / 53553354 / -4.3% 0.48 / 0.47 / +3.7%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87626483 / 87372046 / +0.3% 129211925 / 127117134 / +1.6% 0.68 / 0.69 / -1.3%
tpch_q02/datafusion:parquet 174250072 / 173541457 / +0.4% 197073324 / 200787531 / -1.8% 0.88 / 0.86 / +2.3%
tpch_q03/datafusion:parquet 134431690 / 135400852 / -0.7% 184622717 / 177515979 / +4.0% 0.73 / 0.76 / -4.5%
tpch_q04/datafusion:parquet 57676372 / 57301728 / +0.7% 89563809 / 90634805 / -1.2% 0.64 / 0.63 / +1.9%
tpch_q05/datafusion:parquet 166336024 / 167450726 / -0.7% 232405127 / 216918602 / +7.1% 0.72 / 0.77 / -7.3%
tpch_q06/datafusion:parquet 36308513 / 36759711 / -1.2% 77461055 / 73377160 / +5.6% 0.47 / 0.50 / -6.4%
tpch_q07/datafusion:parquet 215348468 / 217452485 / -1.0% 274728130 / 278757728 / -1.4% 0.78 / 0.78 / +0.5%
tpch_q08/datafusion:parquet 218580153 / 217547432 / +0.5% 289162700 / 281050041 / +2.9% 0.76 / 0.77 / -2.3%
tpch_q09/datafusion:parquet 308607837 / 309992739 / -0.4% 383872464 / 377617099 / +1.7% 0.80 / 0.82 / -2.1%
tpch_q10/datafusion:parquet 310684167 / 312607055 / -0.6% 373793403 / 374635413 / -0.2% 0.83 / 0.83 / -0.4%
tpch_q11/datafusion:parquet 126836708 / 126904955 / -0.1% 150256481 / 152092729 / -1.2% 0.84 / 0.83 / +1.2%
tpch_q12/datafusion:parquet 82775161 / 82490217 / +0.3% 120398821 / 119609598 / +0.7% 0.69 / 0.69 / -0.3%
tpch_q13/datafusion:parquet 210476714 / 210792627 / -0.1% 241793068 / 238505978 / +1.4% 0.87 / 0.88 / -1.5%
tpch_q14/datafusion:parquet 86441292 / 86178289 / +0.3% 189977313 / 190854700 / -0.5% 0.46 / 0.45 / +0.8%
tpch_q15/datafusion:parquet 105055112 / 106397081 / -1.3% 154251056 / 152062782 / +1.4% 0.68 / 0.70 / -2.7%
tpch_q16/datafusion:parquet 96150182 / 95891635 / +0.3% 117961758 / 122835240 / -4.0% 0.82 / 0.78 / +4.4%
tpch_q17/datafusion:parquet 213830222 / 215828919 / -0.9% 261121974 / 258232254 / +1.1% 0.82 / 0.84 / -2.0%
tpch_q18/datafusion:parquet 270206327 / 267911042 / +0.9% 314979345 / 315891179 / -0.3% 0.86 / 0.85 / +1.1%
tpch_q19/datafusion:parquet 108274372 / 108165843 / +0.1% 163834198 / 161949085 / +1.2% 0.66 / 0.67 / -1.1%
tpch_q20/datafusion:parquet 185846069 / 185545816 / +0.2% 243763472 / 247539770 / -1.5% 0.76 / 0.75 / +1.7%
tpch_q21/datafusion:parquet 242510055 / 244526968 / -0.8% 308101765 / 313261935 / -1.6% 0.79 / 0.78 / +0.8%
tpch_q22/datafusion:parquet 150013530 / 150249864 / -0.2% 175259617 / 175023324 / +0.1% 0.86 / 0.86 / -0.3%
duckdb / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 32834451 / 33717250 / -2.6% 71411756 / 72546071 / -1.6% 0.46 / 0.46 / -1.1%
tpch_q02/duckdb:vortex-file-compressed 28648831 / 28535483 / +0.4% 43821675 / 42812168 / +2.4% 0.65 / 0.67 / -1.9%
tpch_q03/duckdb:vortex-file-compressed 52766925 / 52395190 / +0.7% 102168662 / 107856916 / -5.3% 0.52 / 0.49 / +6.3%
tpch_q04/duckdb:vortex-file-compressed 51403572 / 51642374 / -0.5% 90697346 / 90715191 / -0.0% 0.57 / 0.57 / -0.4%
tpch_q05/duckdb:vortex-file-compressed 68742694 / 68284064 / +0.7% 113320364 / 112287453 / +0.9% 0.61 / 0.61 / -0.2%
tpch_q06/duckdb:vortex-file-compressed 15370743 / 15523980 / -1.0% 54016758 / 54001994 / +0.0% 0.28 / 0.29 / -1.0%
tpch_q07/duckdb:vortex-file-compressed 55227052 / 56289317 / -1.9% 113171652 / 109517607 / +3.3% 0.49 / 0.51 / -5.1%
tpch_q08/duckdb:vortex-file-compressed 87976334 / 87993665 / -0.0% 137585151 / 136034326 / +1.1% 0.64 / 0.65 / -1.1%
tpch_q09/duckdb:vortex-file-compressed 102632596 / 104478542 / -1.8% 155498911 / 160545830 / -3.1% 0.66 / 0.65 / +1.4%
tpch_q10/duckdb:vortex-file-compressed 95529020 / 96530974 / -1.0% 149213029 / 149480239 / -0.2% 0.64 / 0.65 / -0.9%
tpch_q11/duckdb:vortex-file-compressed 13262273 / 13271624 / -0.1% 29996071 / 28437282 / +5.5% 0.44 / 0.47 / -5.3%
tpch_q12/duckdb:vortex-file-compressed 45028087 / 44829286 / +0.4% 81346755 / 82101250 / -0.9% 0.55 / 0.55 / +1.4%
tpch_q13/duckdb:vortex-file-compressed 71346077 / 73482635 / -2.9% 99154886 / 100644151 / -1.5% 0.72 / 0.73 / -1.4%
tpch_q14/duckdb:vortex-file-compressed 28570262 / 28597524 / -0.1% 74292001 / 75301257 / -1.3% 0.38 / 0.38 / +1.3%
tpch_q15/duckdb:vortex-file-compressed 24816224 / 24850425 / -0.1% 62289855 / 64680737 / -3.7% 0.40 / 0.38 / +3.7%
tpch_q16/duckdb:vortex-file-compressed 49276824 / 48665139 / +1.3% 56917532 / 57917111 / -1.7% 0.87 / 0.84 / +3.0%
tpch_q17/duckdb:vortex-file-compressed 34641469 / 35017407 / -1.1% 67501527 / 68787564 / -1.9% 0.51 / 0.51 / +0.8%
tpch_q18/duckdb:vortex-file-compressed 104809630 / 101349193 / +3.4% 125944840 / 121104468 / +4.0% 0.83 / 0.84 / -0.6%
tpch_q19/duckdb:vortex-file-compressed 27808989 / 27586274 / +0.8% 75754494 / 75468750 / +0.4% 0.37 / 0.37 / +0.4%
tpch_q20/duckdb:vortex-file-compressed 42553971 / 42028653 / +1.2% 92851719 / 94143242 / -1.4% 0.46 / 0.45 / +2.7%
tpch_q21/duckdb:vortex-file-compressed 94959136 / 92926669 / +2.2% 147230009 / 149459387 / -1.5% 0.64 / 0.62 / +3.7%
tpch_q22/duckdb:vortex-file-compressed 32716330 / 32967821 / -0.8% 48181497 / 50673568 / -4.9% 0.68 / 0.65 / +4.4%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67526390 / 68059780 / -0.8% 90910077 / 89550266 / +1.5% 0.74 / 0.76 / -2.3%
tpch_q02/duckdb:parquet 86863943 / 87335480 / -0.5% 97464958 / 97718209 / -0.3% 0.89 / 0.89 / -0.3%
tpch_q03/duckdb:parquet 108461677 / 110511015 / -1.9% 142718168 / 142463897 / +0.2% 0.76 / 0.78 / -2.0%
tpch_q04/duckdb:parquet 76388537 / 76502436 / -0.1% 101098582 / 99440715 / +1.7% 0.76 / 0.77 / -1.8%
tpch_q05/duckdb:parquet 122654277 / 124172926 / -1.2% 161351096 / 157124433 / +2.7% 0.76 / 0.79 / -3.8%
tpch_q06/duckdb:parquet 34975520 / 35619223 / -1.8% 58633695 / 66005123 / -11.2% 🟢 0.60 / 0.54 / +10.5%
tpch_q07/duckdb:parquet 117834355 / 117398526 / +0.4% 153433273 / 154106673 / -0.4% 0.77 / 0.76 / +0.8%
tpch_q08/duckdb:parquet 146257249 / 147136506 / -0.6% 190466136 / 191273949 / -0.4% 0.77 / 0.77 / -0.2%
tpch_q09/duckdb:parquet 236813587 / 236712079 / +0.0% 277806938 / 283406742 / -2.0% 0.85 / 0.84 / +2.1%
tpch_q10/duckdb:parquet 313016888 / 314185931 / -0.4% 337558571 / 343372079 / -1.7% 0.93 / 0.92 / +1.3%
tpch_q11/duckdb:parquet 43518565 / 43742423 / -0.5% 50331991 / 50965528 / -1.2% 0.86 / 0.86 / +0.7%
tpch_q12/duckdb:parquet 70221210 / 71137236 / -1.3% 91370487 / 91779500 / -0.4% 0.77 / 0.78 / -0.8%
tpch_q13/duckdb:parquet 292381392 / 293366910 / -0.3% 308082342 / 308621731 / -0.2% 0.95 / 0.95 / -0.2%
tpch_q14/duckdb:parquet 101077383 / 102273386 / -1.2% 138652236 / 141851063 / -2.3% 0.73 / 0.72 / +1.1%
tpch_q15/duckdb:parquet 57892382 / 57070305 / +1.4% 85395946 / 86533692 / -1.3% 0.68 / 0.66 / +2.8%
tpch_q16/duckdb:parquet 100673896 / 100916878 / -0.2% 107006931 / 107993358 / -0.9% 0.94 / 0.93 / +0.7%
tpch_q17/duckdb:parquet 80555213 / 82884448 / -2.8% 120837535 / 124989202 / -3.3% 0.67 / 0.66 / +0.5%
tpch_q18/duckdb:parquet 160229566 / 157350187 / +1.8% 176191524 / 174516370 / +1.0% 0.91 / 0.90 / +0.9%
tpch_q19/duckdb:parquet 100550745 / 98221882 / +2.4% 136793808 / 134004453 / +2.1% 0.74 / 0.73 / +0.3%
tpch_q20/duckdb:parquet 146527445 / 147378796 / -0.6% 188562627 / 187264562 / +0.7% 0.78 / 0.79 / -1.3%
tpch_q21/duckdb:parquet 252569457 / 251811968 / +0.3% 274623683 / 275521800 / -0.3% 0.92 / 0.91 / +0.6%
tpch_q22/duckdb:parquet 168399924 / 168385842 / +0.0% 180677539 / 180610188 / +0.0% 0.93 / 0.93 / -0.0%

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 050a0087 vs base 246a397e
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.3%
Engines: DataFusion No clear signal (-4.5%, environment too noisy confidence) · DuckDB No clear signal (-2.1%, environment too noisy confidence)
Vortex (geomean): hot 1.017x ➖ · cold 1.035x ➖
Parquet (geomean): hot 1.052x ➖ · cold 1.050x ➖
Shifts: Parquet (control) +5.2% · Median polish +4.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.011x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 215773853 / 220831264 / -2.3% 749573379 / 576458480 / +30.0% 🔴 0.29 / 0.38 / -24.9%
tpch_q02/datafusion:vortex-file-compressed 324755482 / 308669932 / +5.2% 653257277 / 674528013 / -3.2% 0.50 / 0.46 / +8.6%
tpch_q03/datafusion:vortex-file-compressed 369822733 / 347086704 / +6.6% 1308873439 / 871608881 / +50.2% 🔴 0.28 / 0.40 / -29.0%
tpch_q04/datafusion:vortex-file-compressed 206459665 / 207021749 / -0.3% 393857428 / 422384755 / -6.8% 0.52 / 0.49 / +7.0%
tpch_q05/datafusion:vortex-file-compressed 461608373 / 425586511 / +8.5% 733315725 / 613441206 / +19.5% 0.63 / 0.69 / -9.3%
tpch_q06/datafusion:vortex-file-compressed 142825323 / 141424151 / +1.0% 292447977 / 371254228 / -21.2% 0.49 / 0.38 / +28.2%
tpch_q07/datafusion:vortex-file-compressed 461301953 / 462415225 / -0.2% 609509429 / 582547518 / +4.6% 0.76 / 0.79 / -4.7%
tpch_q08/datafusion:vortex-file-compressed 740049144 / 427390773 / +73.2% 🔴 932997081 / 601931393 / +55.0% 🔴 0.79 / 0.71 / +11.7%
tpch_q09/datafusion:vortex-file-compressed 287333263 / 268529658 / +7.0% 633065283 / 473357724 / +33.7% 🔴 0.45 / 0.57 / -20.0%
tpch_q10/datafusion:vortex-file-compressed 369611621 / 348508035 / +6.1% 600690609 / 528499094 / +13.7% 0.62 / 0.66 / -6.7%
tpch_q11/datafusion:vortex-file-compressed 269479319 / 257327413 / +4.7% 413833838 / 420659524 / -1.6% 0.65 / 0.61 / +6.4%
tpch_q12/datafusion:vortex-file-compressed 280896980 / 210715328 / +33.3% 🔴 418786280 / 429074710 / -2.4% 0.67 / 0.49 / +36.6%
tpch_q13/datafusion:vortex-file-compressed 136090336 / 131309055 / +3.6% 327359692 / 370354402 / -11.6% 0.42 / 0.35 / +17.3%
tpch_q14/datafusion:vortex-file-compressed 164994197 / 211521200 / -22.0% 314970289 / 383637559 / -17.9% 0.52 / 0.55 / -5.0%
tpch_q15/datafusion:vortex-file-compressed 300347761 / 292649172 / +2.6% 522704725 / 520914480 / +0.3% 0.57 / 0.56 / +2.3%
tpch_q16/datafusion:vortex-file-compressed 132317524 / 158770515 / -16.7% 270696687 / 318188188 / -14.9% 0.49 / 0.50 / -2.0%
tpch_q17/datafusion:vortex-file-compressed 239338546 / 307709054 / -22.2% 468187631 / 454845057 / +2.9% 0.51 / 0.68 / -24.4%
tpch_q18/datafusion:vortex-file-compressed 251096240 / 590427775 / -57.5% 🟢 544821500 / 723635830 / -24.7% 0.46 / 0.82 / -43.5%
tpch_q19/datafusion:vortex-file-compressed 299620952 / 216120746 / +38.6% 🔴 482557322 / 356996489 / +35.2% 🔴 0.62 / 0.61 / +2.6%
tpch_q20/datafusion:vortex-file-compressed 296086871 / 292443661 / +1.2% 432730451 / 509890552 / -15.1% 0.68 / 0.57 / +19.3%
tpch_q21/datafusion:vortex-file-compressed 500493803 / 456400316 / +9.7% 648706760 / 730212380 / -11.2% 0.77 / 0.63 / +23.4%
tpch_q22/datafusion:vortex-file-compressed 182581661 / 167024301 / +9.3% 448794521 / 388209621 / +15.6% 0.41 / 0.43 / -5.4%
datafusion / parquet / ns (1.058x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 160851107 / 150351198 / +7.0% 544129878 / 460460005 / +18.2% 0.30 / 0.33 / -9.5%
tpch_q02/datafusion:parquet 295098517 / 284014916 / +3.9% 509376442 / 458008198 / +11.2% 0.58 / 0.62 / -6.6%
tpch_q03/datafusion:parquet 283915446 / 271007543 / +4.8% 610156954 / 753951884 / -19.1% 0.47 / 0.36 / +29.5%
tpch_q04/datafusion:parquet 127429352 / 133714329 / -4.7% 302849967 / 322406865 / -6.1% 0.42 / 0.41 / +1.5%
tpch_q05/datafusion:parquet 340119949 / 342356608 / -0.7% 462408051 / 468240904 / -1.2% 0.74 / 0.73 / +0.6%
tpch_q06/datafusion:parquet 153689926 / 112055911 / +37.2% 🔴 240814887 / 226141107 / +6.5% 0.64 / 0.50 / +28.8%
tpch_q07/datafusion:parquet 418208617 / 329957349 / +26.7% 872367617 / 516179984 / +69.0% 🔴 0.48 / 0.64 / -25.0%
tpch_q08/datafusion:parquet 412245910 / 432763020 / -4.7% 561826225 / 536690978 / +4.7% 0.73 / 0.81 / -9.0%
tpch_q09/datafusion:parquet 382179739 / 373806384 / +2.2% 742261375 / 539014441 / +37.7% 🔴 0.51 / 0.69 / -25.8%
tpch_q10/datafusion:parquet 312974148 / 309340609 / +1.2% 508661455 / 417479206 / +21.8% 0.62 / 0.74 / -17.0%
tpch_q11/datafusion:parquet 259220025 / 261901027 / -1.0% 398469464 / 373704730 / +6.6% 0.65 / 0.70 / -7.2%
tpch_q12/datafusion:parquet 172398329 / 162342440 / +6.2% 309472933 / 309500458 / -0.0% 0.56 / 0.52 / +6.2%
tpch_q13/datafusion:parquet 274118997 / 276376623 / -0.8% 401229559 / 436081873 / -8.0% 0.68 / 0.63 / +7.8%
tpch_q14/datafusion:parquet 151803245 / 157906152 / -3.9% 333042651 / 273555838 / +21.7% 0.46 / 0.58 / -21.0%
tpch_q15/datafusion:parquet 373282757 / 317865748 / +17.4% 506901524 / 523121657 / -3.1% 0.74 / 0.61 / +21.2%
tpch_q16/datafusion:parquet 112160083 / 111322386 / +0.8% 187433105 / 231410953 / -19.0% 0.60 / 0.48 / +24.4%
tpch_q17/datafusion:parquet 279873523 / 272274209 / +2.8% 414600719 / 526187695 / -21.2% 0.68 / 0.52 / +30.5%
tpch_q18/datafusion:parquet 327041321 / 341966792 / -4.4% 505883634 / 503106611 / +0.6% 0.65 / 0.68 / -4.9%
tpch_q19/datafusion:parquet 190489605 / 157601017 / +20.9% 318732695 / 273426259 / +16.6% 0.60 / 0.58 / +3.7%
tpch_q20/datafusion:parquet 236730401 / 235515300 / +0.5% 377046216 / 397076072 / -5.0% 0.63 / 0.59 / +5.9%
tpch_q21/datafusion:parquet 332809407 / 292874917 / +13.6% 511793415 / 463033836 / +10.5% 0.65 / 0.63 / +2.8%
tpch_q22/datafusion:parquet 182609653 / 160199804 / +14.0% 335711173 / 388871374 / -13.7% 0.54 / 0.41 / +32.0%
duckdb / vortex-file-compressed / ns (1.024x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 259003474 / 247509334 / +4.6% 308204607 / 267181463 / +15.4% 0.84 / 0.93 / -9.3%
tpch_q02/duckdb:vortex-file-compressed 445606882 / 408988212 / +9.0% 453477146 / 495524216 / -8.5% 0.98 / 0.83 / +19.1%
tpch_q03/duckdb:vortex-file-compressed 417993406 / 416179552 / +0.4% 472222628 / 484765981 / -2.6% 0.89 / 0.86 / +3.1%
tpch_q04/duckdb:vortex-file-compressed 805768156 / 273734107 / +194.4% 🔴 463166968 / 309747374 / +49.5% 🔴 1.74 / 0.88 / +96.9%
tpch_q05/duckdb:vortex-file-compressed 708837897 / 585375507 / +21.1% 590170732 / 657952067 / -10.3% 1.20 / 0.89 / +35.0%
tpch_q06/duckdb:vortex-file-compressed 173641986 / 203012163 / -14.5% 236818397 / 217053599 / +9.1% 0.73 / 0.94 / -21.6%
tpch_q07/duckdb:vortex-file-compressed 443215262 / 433499388 / +2.2% 547799445 / 491006362 / +11.6% 0.81 / 0.88 / -8.4%
tpch_q08/duckdb:vortex-file-compressed 610532181 / 856662362 / -28.7% 1075206259 / 924712147 / +16.3% 0.57 / 0.93 / -38.7%
tpch_q09/duckdb:vortex-file-compressed 488833660 / 430063376 / +13.7% 458248973 / 472261724 / -3.0% 1.07 / 0.91 / +17.1%
tpch_q10/duckdb:vortex-file-compressed 521681291 / 562615415 / -7.3% 585894169 / 577179328 / +1.5% 0.89 / 0.97 / -8.7%
tpch_q11/duckdb:vortex-file-compressed 280394305 / 295453825 / -5.1% 546530241 / 295294530 / +85.1% 🔴 0.51 / 1.00 / -48.7%
tpch_q12/duckdb:vortex-file-compressed 239436810 / 281391065 / -14.9% 294381435 / 342314564 / -14.0% 0.81 / 0.82 / -1.1%
tpch_q13/duckdb:vortex-file-compressed 253761002 / 257839733 / -1.6% 265264484 / 337095202 / -21.3% 0.96 / 0.76 / +25.1%
tpch_q14/duckdb:vortex-file-compressed 221048940 / 215999117 / +2.3% 357301066 / 312373489 / +14.4% 0.62 / 0.69 / -10.5%
tpch_q15/duckdb:vortex-file-compressed 256461704 / 339636073 / -24.5% 289153184 / 292926502 / -1.3% 0.89 / 1.16 / -23.5%
tpch_q16/duckdb:vortex-file-compressed 190390301 / 210376153 / -9.5% 257426611 / 230946559 / +11.5% 0.74 / 0.91 / -18.8%
tpch_q17/duckdb:vortex-file-compressed 326822358 / 324970756 / +0.6% 360946251 / 357086182 / +1.1% 0.91 / 0.91 / -0.5%
tpch_q18/duckdb:vortex-file-compressed 374497025 / 431733303 / -13.3% 311833876 / 402106068 / -22.4% 1.20 / 1.07 / +11.9%
tpch_q19/duckdb:vortex-file-compressed 312461746 / 303395982 / +3.0% 372738226 / 339697179 / +9.7% 0.84 / 0.89 / -6.1%
tpch_q20/duckdb:vortex-file-compressed 346216690 / 385636006 / -10.2% 441248549 / 483758671 / -8.8% 0.78 / 0.80 / -1.6%
tpch_q21/duckdb:vortex-file-compressed 715219599 / 656583605 / +8.9% 660570778 / 782358666 / -15.6% 1.08 / 0.84 / +29.0%
tpch_q22/duckdb:vortex-file-compressed 325050634 / 251855732 / +29.1% 345012977 / 334512025 / +3.1% 0.94 / 0.75 / +25.1%
duckdb / parquet / ns (1.046x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 173154870 / 152166910 / +13.8% 225328793 / 211204649 / +6.7% 0.77 / 0.72 / +6.7%
tpch_q02/duckdb:parquet 519223020 / 453471368 / +14.5% 530167949 / 426327264 / +24.4% 0.98 / 1.06 / -7.9%
tpch_q03/duckdb:parquet 377268218 / 358243434 / +5.3% 429580885 / 423368603 / +1.5% 0.88 / 0.85 / +3.8%
tpch_q04/duckdb:parquet 235829281 / 281717280 / -16.3% 313064451 / 332953926 / -6.0% 0.75 / 0.85 / -11.0%
tpch_q05/duckdb:parquet 569173115 / 536493872 / +6.1% 629218432 / 570606274 / +10.3% 0.90 / 0.94 / -3.8%
tpch_q06/duckdb:parquet 151701504 / 161239284 / -5.9% 162974647 / 206658661 / -21.1% 0.93 / 0.78 / +19.3%
tpch_q07/duckdb:parquet 497690342 / 436361603 / +14.1% 666933828 / 493434333 / +35.2% 🔴 0.75 / 0.88 / -15.6%
tpch_q08/duckdb:parquet 626365649 / 631844333 / -0.9% 658356763 / 652757052 / +0.9% 0.95 / 0.97 / -1.7%
tpch_q09/duckdb:parquet 578256640 / 564743109 / +2.4% 574228368 / 620443574 / -7.4% 1.01 / 0.91 / +10.6%
tpch_q10/duckdb:parquet 651436292 / 581110821 / +12.1% 777283807 / 636456873 / +22.1% 0.84 / 0.91 / -8.2%
tpch_q11/duckdb:parquet 292741702 / 285994921 / +2.4% 297126496 / 263711609 / +12.7% 0.99 / 1.08 / -9.2%
tpch_q12/duckdb:parquet 270880986 / 252866750 / +7.1% 337380154 / 291902719 / +15.6% 0.80 / 0.87 / -7.3%
tpch_q13/duckdb:parquet 425191355 / 369355879 / +15.1% 490899087 / 429176067 / +14.4% 0.87 / 0.86 / +0.6%
tpch_q14/duckdb:parquet 263864892 / 269935408 / -2.2% 274398025 / 344984516 / -20.5% 0.96 / 0.78 / +22.9%
tpch_q15/duckdb:parquet 236483199 / 212505719 / +11.3% 243489954 / 228893439 / +6.4% 0.97 / 0.93 / +4.6%
tpch_q16/duckdb:parquet 294464241 / 275747511 / +6.8% 328638503 / 327100698 / +0.5% 0.90 / 0.84 / +6.3%
tpch_q17/duckdb:parquet 260432559 / 263952606 / -1.3% 305476642 / 331901361 / -8.0% 0.85 / 0.80 / +7.2%
tpch_q18/duckdb:parquet 337988432 / 382490629 / -11.6% 384754173 / 393794532 / -2.3% 0.88 / 0.97 / -9.6%
tpch_q19/duckdb:parquet 259245000 / 266061746 / -2.6% 364318815 / 345007366 / +5.6% 0.71 / 0.77 / -7.7%
tpch_q20/duckdb:parquet 498061469 / 448150426 / +11.1% 648563732 / 480087501 / +35.1% 🔴 0.77 / 0.93 / -17.7%
tpch_q21/duckdb:parquet 442114886 / 418893862 / +5.5% 551190977 / 454759125 / +21.2% 0.80 / 0.92 / -12.9%
tpch_q22/duckdb:parquet 400225946 / 323115195 / +23.9% 355477128 / 335134028 / +6.1% 1.13 / 0.96 / +16.8%

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant