Skip to content

perf(layout): compact referenced values in sparse dictionary projections - #11339

Draft
joseph-isaacs wants to merge 1 commit into
ji/clickbench-v2-20261109-01-io-wakeupsfrom
ji/clickbench-v2-20261109-03-sparse-dictionaries
Draft

joseph-isaacs wants to merge 1 commit into
ji/clickbench-v2-20261109-01-io-wakeupsfrom
ji/clickbench-v2-20261109-03-sparse-dictionaries

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Draft with unresolved full-suite landing concerns. The focused Q38 gains remain scoped as measured.

Stack dependency: #11334. This PR targets that branch so its diff contains only this change.

Summary

Sparse string and binary projections can materialize the same dictionary entry repeatedly when row codes repeat. Gather each referenced entry once and remap row codes to a compact dictionary, preserving repeated values and null semantics.

Stack base: ji/clickbench-v2-20261109-01-io-wakeups (da10665e5b0f) (s01). The change is in the shared V2 physical pipeline used by DataFusion and DuckDB.

Changes

  • Build a dictionary from distinct valid referenced codes, canonicalize that subset, and retain dictionary output instead of expanding repeated row values.
  • Use this path for dictionaries with at least 1,024 values when the code count is less than one quarter of the dictionary length; retain the shared dictionary path for small or dense projections.
  • Preserve null code payload handling and reject invalid integer codes. Tests cover repeated codes, null values, null payloads, out-of-range and negative codes, and non-integer codes.
  • Validation: all 63 physical-pipeline tests passed on this branch.

Benchmark evidence

Warm ClickBench timings against this branch's exact dependency parent. Query IDs are zero-based; these are individual query gains, not whole-suite or additive gains.

Engine Query Parent median (ms) Candidate median (ms) Paired latency reduction 99% interval
DataFusion Q38 7.4305 5.6268 24.26% 24.17–24.36%
DuckDB Q38 7.2392 6.5117 10.16% 9.89–10.42%

24 fresh adjacent process pairs in balanced order; 100 executions/query, first 20 discarded; 8 interspersed identical-binary A/A pairs. Effects use mean paired log ratios of process warm medians. Displayed times are medians across processes, so their ratio need not exactly equal the paired estimate. Intervals are pointwise 99% bootstrap intervals. Each listed gain passes both the >1% interval rule and the exact paired sign test with Holm 1% correction across all 76 planned latency directions. Both execution orders and chronological sensitivity were reviewed; no post-warmup observations were excluded or controls subtracted. The sign test concerns how often a paired improvement exceeds 1%; the displayed interval estimates the mean log effect.

Whole-process user+system CPU reductions on the same focused query set: DataFusion 20.61% (99% interval 20.50–20.72%); DuckDB 17.63% (99% interval 17.20–18.08%). These pass the separately corrected CPU family and include setup and warmups; they are not measurements of isolated Vortex CPU.

32-core aarch64 host, full 100-file partitioned ClickBench fixture, Vortex V2, ordinary local reads with no mmap, 32 workers/partitions/threads, DuckDB --reuse. DataFusion 55.2 retains enable_topk_aggregation=true. Compiler, Cargo feature union, profile and runtime environment are fixed across parent/candidate. Executable and library hashes, canonical SQL and fixture identities are recorded.

Full43 screening

The complete series screen finished 168/168 processes, with no failures or overlaps and successful source/SQL/binary/fixture checks. Each source/engine comparison used four balanced exact-parent process pairs and two matching identical-binary A/A pairs, with 10 executions/query and the first 3 discarded. This screen is descriptive: no new gain, equivalence, or regression-free claim is inferred, and no observations or controls were subtracted.

Focused Q38 gains remain strong, while all43 CPU is approximately flat rather than showing the focused workload's large CPU savings. Small coherent concerns are DataFusion Q39 (1.01% median, 1.24% mean slower) and DuckDB Q25 (1.29%/1.46%). DuckDB Q36 means rise 14.76%, with one favorable pair then three adverse pairs and noisy controls. Sparse string projections plausibly reach these queries, but causation is unproven. Preserve these landing concerns without adding new gain claims.

Validation

  • 63 targeted test executions passed on this exact source tree: plan::physical::pipeline::tests.
  • All 43 ClickBench query results match fresh-develop Parquet results in each engine (86 comparisons for this candidate); strict types, floating tolerance, tied-row membership and independent oracles included.
  • Both benchmark packages built together with --locked, the release_debug profile, profile.release_debug.debug=1, and RUSTFLAGS="-C target-cpu=native -C force-frame-pointers=yes". Rust changes were formatted with pinned nightly; patch whitespace checks passed. Workspace-wide clippy was not run; CI status is separate.

Measured local source commit: 4f7ab30da3ad7301ed89744be8edf2afc7cc4869; full source tree: fb5a43594c5d65101653d6f1092f591b63005430. Measured parent: a2765d42438062db73d431ef6d296930e69f5b28.

PR source commit: 62adb044358035958ddc41314db0549240eba661; mapped parent: da10665e5b0fad748a1e0e6550cc19880edd0317. The complete source tree and mapped parent graph match the measured source. GitHub regenerated commit metadata/timestamps, so the measured local commit and executable hashes remain the benchmark identities. The complete remote Git object, original message and author/committer signoffs were verified.

Measurements use the develop snapshot b2f8d0f946e003d3e463d1447ed357ed88990686. Develop advanced during the campaign; these results retain the recorded source and binary identities.

Repository SQL benchmark

The SQL workflow completed 8/8 suites on this exact PR head. The ClickBench bot verdict is No clear signal (low confidence).

The preset covers V2 ClickBench, TPC-H, TPC-DS and FineWeb, plus a legacy PolarSignals control. These cloud runs use suite-specific historical develop baselines and FLAT_LAYOUT_INLINE_ARRAY_NODE=1; they are separate from the local exact-parent comparisons and cannot isolate this stack's incremental effect. Ordinary draft CI was skipped; SQL benchmark success is not an overall CI pass.

For sparse string and binary projections, gather each referenced dictionary entry once and remap repeated row codes. Use the measured one-quarter density threshold while preserving the shared dense path. Cover repeated codes, null dictionary values, null code payloads, and out-of-range codes.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
joseph-isaacs changed the base branch from ji/clickbench-v2-20261109-01-io-wakeups to develop November 9, 2026 11:56
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026 — with ChatGPT Codex Connector
@joseph-isaacs
joseph-isaacs changed the base branch from develop to ji/clickbench-v2-20261109-01-io-wakeups November 9, 2026 11:56
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026
@github-actions

github-actions Bot commented Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 62adb04 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 62adb04 fineweb 1 Explore Profiling Data
🟢 Done 62adb04 clickbench-nvme 1 Explore Profiling Data
🟢 Done 62adb04 tpcds-nvme-10 1 Explore Profiling Data
🟢 Done 62adb04 polarsignals 1 Explore Profiling Data
🟢 Done 62adb04 tpch-s3 1 Explore Profiling Data
🟢 Done 62adb04 tpch-nvme 1 Explore Profiling Data
🟢 Done 62adb04 tpcds-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 62adb044 vs base b2f8d0f9
Vortex (geomean): hot 0.999x ➖ · cold 1.001x ➖


datafusion / vortex-file-compressed / ns (0.999x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44311186 / 44247398 / +0.1% 88997268 / 86756764 / +2.6% 0.50 / 0.51 / -2.4%
polarsignals_q01/datafusion:vortex-file-compressed 53385952 / 53190033 / +0.4% 118552303 / 111620562 / +6.2% 0.45 / 0.48 / -5.5%
polarsignals_q02/datafusion:vortex-file-compressed 11992938 / 14308001 / -16.2% 🟢 48086870 / 50938846 / -5.6% 0.25 / 0.28 / -11.2%
polarsignals_q03/datafusion:vortex-file-compressed 80271741 / 69231543 / +15.9% 🔴 117642091 / 116022576 / +1.4% 0.68 / 0.60 / +14.4%
polarsignals_q04/datafusion:vortex-file-compressed 9289716 / 9324230 / -0.4% 41790740 / 43390473 / -3.7% 0.22 / 0.21 / +3.4%
polarsignals_q05/datafusion:vortex-file-compressed 11599574 / 11645938 / -0.4% 47719306 / 46740242 / +2.1% 0.24 / 0.25 / -2.4%
polarsignals_q06/datafusion:vortex-file-compressed 22880310 / 22759316 / +0.5% 56338577 / 56616878 / -0.5% 0.41 / 0.40 / +1.0%
polarsignals_q07/datafusion:vortex-file-compressed 10569038 / 10826504 / -2.4% 45651238 / 45422058 / +0.5% 0.23 / 0.24 / -2.9%
polarsignals_q08/datafusion:vortex-file-compressed 99213019 / 96763190 / +2.5% 163792999 / 161828007 / +1.2% 0.61 / 0.60 / +1.3%
polarsignals_q09/datafusion:vortex-file-compressed 10192513 / 9924556 / +2.7% 40487735 / 41195204 / -1.7% 0.25 / 0.24 / +4.5%
polarsignals_q10/datafusion:vortex-file-compressed 54703680 / 55401320 / -1.3% 115792634 / 116674031 / -0.8% 0.47 / 0.47 / -0.5%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 62adb044 vs base b8f511d0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): hot 1.003x ➖ · cold 0.966x ➖
Parquet (geomean): hot 0.999x ➖ · cold 0.983x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15507331 / 15688950 / -1.2% 39591594 / 42044683 / -5.8% 0.39 / 0.37 / +5.0%
tpch_q02/datafusion:vortex-file-compressed 17798947 / 17642963 / +0.9% 36660874 / 38300817 / -4.3% 0.49 / 0.46 / +5.4%
tpch_q03/datafusion:vortex-file-compressed 19340634 / 19065844 / +1.4% 42303207 / 48397388 / -12.6% 🟢 0.46 / 0.39 / +16.1%
tpch_q04/datafusion:vortex-file-compressed 10386480 / 11164861 / -7.0% 34659074 / 35072742 / -1.2% 0.30 / 0.32 / -5.9%
tpch_q05/datafusion:vortex-file-compressed 37409755 / 37464731 / -0.1% 65350213 / 67783021 / -3.6% 0.57 / 0.55 / +3.6%
tpch_q06/datafusion:vortex-file-compressed 4367470 / 4339682 / +0.6% 25554778 / 24863986 / +2.8% 0.17 / 0.17 / -2.1%
tpch_q07/datafusion:vortex-file-compressed 52648211 / 52692511 / -0.1% 78544234 / 85054942 / -7.7% 0.67 / 0.62 / +8.2%
tpch_q08/datafusion:vortex-file-compressed 53447651 / 52605829 / +1.6% 80889511 / 84709539 / -4.5% 0.66 / 0.62 / +6.4%
tpch_q09/datafusion:vortex-file-compressed 48968020 / 48498381 / +1.0% 79425463 / 84507228 / -6.0% 0.62 / 0.57 / +7.4%
tpch_q10/datafusion:vortex-file-compressed 17744166 / 17830636 / -0.5% 48954105 / 50418361 / -2.9% 0.36 / 0.35 / +2.5%
tpch_q11/datafusion:vortex-file-compressed 14799518 / 14797088 / +0.0% 33412825 / 34636066 / -3.5% 0.44 / 0.43 / +3.7%
tpch_q12/datafusion:vortex-file-compressed 18850296 / 18367682 / +2.6% 42493049 / 44324157 / -4.1% 0.44 / 0.41 / +7.0%
tpch_q13/datafusion:vortex-file-compressed 19892552 / 19445378 / +2.3% 40356563 / 43547559 / -7.3% 0.49 / 0.45 / +10.4%
tpch_q14/datafusion:vortex-file-compressed 14353658 / 14501344 / -1.0% 39222661 / 38502171 / +1.9% 0.37 / 0.38 / -2.8%
tpch_q15/datafusion:vortex-file-compressed 18998927 / 18611040 / +2.1% 43280893 / 47147954 / -8.2% 0.44 / 0.39 / +11.2%
tpch_q16/datafusion:vortex-file-compressed 18338902 / 18720655 / -2.0% 37682895 / 39847079 / -5.4% 0.49 / 0.47 / +3.6%
tpch_q17/datafusion:vortex-file-compressed 28910483 / 28917794 / -0.0% 57244732 / 58954760 / -2.9% 0.51 / 0.49 / +3.0%
tpch_q18/datafusion:vortex-file-compressed 36749813 / 36473671 / +0.8% 58541962 / 59803246 / -2.1% 0.63 / 0.61 / +2.9%
tpch_q19/datafusion:vortex-file-compressed 9801631 / 9988295 / -1.9% 36217799 / 36396214 / -0.5% 0.27 / 0.27 / -1.4%
tpch_q20/datafusion:vortex-file-compressed 21066051 / 21253874 / -0.9% 45640520 / 52124094 / -12.4% 🟢 0.46 / 0.41 / +13.2%
tpch_q21/datafusion:vortex-file-compressed 35328721 / 35502918 / -0.5% 63858016 / 66036777 / -3.3% 0.55 / 0.54 / +2.9%
tpch_q22/datafusion:vortex-file-compressed 10953450 / 10854425 / +0.9% 29592339 / 31535557 / -6.2% 0.37 / 0.34 / +7.5%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71337168 / 71385078 / -0.1% 84893534 / 87261585 / -2.7% 0.84 / 0.82 / +2.7%
tpch_q02/datafusion:parquet 75591577 / 76624116 / -1.3% 91315995 / 91913452 / -0.7% 0.83 / 0.83 / -0.7%
tpch_q03/datafusion:parquet 81690652 / 82108255 / -0.5% 98658396 / 104243587 / -5.4% 0.83 / 0.79 / +5.1%
tpch_q04/datafusion:parquet 39373398 / 39117802 / +0.7% 56976276 / 58381793 / -2.4% 0.69 / 0.67 / +3.1%
tpch_q05/datafusion:parquet 109654805 / 110097915 / -0.4% 134857791 / 137152327 / -1.7% 0.81 / 0.80 / +1.3%
tpch_q06/datafusion:parquet 31354018 / 31364851 / -0.0% 45408844 / 46559945 / -2.5% 0.69 / 0.67 / +2.5%
tpch_q07/datafusion:parquet 112934246 / 113603354 / -0.6% 133593764 / 139063930 / -3.9% 0.85 / 0.82 / +3.5%
tpch_q08/datafusion:parquet 116975137 / 118351864 / -1.2% 139662937 / 143663582 / -2.8% 0.84 / 0.82 / +1.7%
tpch_q09/datafusion:parquet 136915277 / 137262432 / -0.3% 161542266 / 166772416 / -3.1% 0.85 / 0.82 / +3.0%
tpch_q10/datafusion:parquet 103038509 / 103456749 / -0.4% 124832033 / 126729504 / -1.5% 0.83 / 0.82 / +1.1%
tpch_q11/datafusion:parquet 61615323 / 62363006 / -1.2% 78191942 / 82069278 / -4.7% 0.79 / 0.76 / +3.7%
tpch_q12/datafusion:parquet 63603173 / 63533745 / +0.1% 78113282 / 85351184 / -8.5% 0.81 / 0.74 / +9.4%
tpch_q13/datafusion:parquet 143605180 / 142477870 / +0.8% 159825831 / 161849930 / -1.3% 0.90 / 0.88 / +2.1%
tpch_q14/datafusion:parquet 47482936 / 47624060 / -0.3% 65109294 / 68804881 / -5.4% 0.73 / 0.69 / +5.4%
tpch_q15/datafusion:parquet 73877386 / 74880432 / -1.3% 91328106 / 92266259 / -1.0% 0.81 / 0.81 / -0.3%
tpch_q16/datafusion:parquet 43370149 / 43181694 / +0.4% 58037325 / 59549382 / -2.5% 0.75 / 0.73 / +3.1%
tpch_q17/datafusion:parquet 124035667 / 123682757 / +0.3% 144656742 / 147020505 / -1.6% 0.86 / 0.84 / +1.9%
tpch_q18/datafusion:parquet 120758522 / 121104227 / -0.3% 140504477 / 142447395 / -1.4% 0.86 / 0.85 / +1.1%
tpch_q19/datafusion:parquet 56320605 / 57774413 / -2.5% 81140624 / 82236501 / -1.3% 0.69 / 0.70 / -1.2%
tpch_q20/datafusion:parquet 78454098 / 78510463 / -0.1% 99907955 / 101516128 / -1.6% 0.79 / 0.77 / +1.5%
tpch_q21/datafusion:parquet 113574199 / 113088915 / +0.4% 138475490 / 139363438 / -0.6% 0.82 / 0.81 / +1.1%
tpch_q22/datafusion:parquet 52074092 / 51831048 / +0.5% 65444074 / 67131696 / -2.5% 0.80 / 0.77 / +3.1%
duckdb / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9002649 / 9046497 / -0.5% 18686857 / 20027987 / -6.7% 0.48 / 0.45 / +6.7%
tpch_q02/duckdb:vortex-file-compressed 15078224 / 15124900 / -0.3% 25449598 / 25341316 / +0.4% 0.59 / 0.60 / -0.7%
tpch_q03/duckdb:vortex-file-compressed 18698351 / 18447734 / +1.4% 33246613 / 34750008 / -4.3% 0.56 / 0.53 / +5.9%
tpch_q04/duckdb:vortex-file-compressed 12182940 / 12448707 / -2.1% 26886642 / 26846587 / +0.1% 0.45 / 0.46 / -2.3%
tpch_q05/duckdb:vortex-file-compressed 20257801 / 20254666 / +0.0% 36253141 / 35776065 / +1.3% 0.56 / 0.57 / -1.3%
tpch_q06/duckdb:vortex-file-compressed 4602121 / 4488820 / +2.5% 15384960 / 15022696 / +2.4% 0.30 / 0.30 / +0.1%
tpch_q07/duckdb:vortex-file-compressed 24162851 / 23909987 / +1.1% 40800633 / 41780280 / -2.3% 0.59 / 0.57 / +3.5%
tpch_q08/duckdb:vortex-file-compressed 21177807 / 20744171 / +2.1% 35954350 / 37318055 / -3.7% 0.59 / 0.56 / +6.0%
tpch_q09/duckdb:vortex-file-compressed 22448632 / 23055861 / -2.6% 38302517 / 38487753 / -0.5% 0.59 / 0.60 / -2.2%
tpch_q10/duckdb:vortex-file-compressed 26995774 / 26815462 / +0.7% 42949231 / 45530635 / -5.7% 0.63 / 0.59 / +6.7%
tpch_q11/duckdb:vortex-file-compressed 8133011 / 7968318 / +2.1% 16770138 / 18104165 / -7.4% 0.48 / 0.44 / +10.2%
tpch_q12/duckdb:vortex-file-compressed 14597645 / 14764927 / -1.1% 27019396 / 27095283 / -0.3% 0.54 / 0.54 / -0.9%
tpch_q13/duckdb:vortex-file-compressed 19597350 / 19378947 / +1.1% 32034272 / 31743144 / +0.9% 0.61 / 0.61 / +0.2%
tpch_q14/duckdb:vortex-file-compressed 11288495 / 11181264 / +1.0% 23903495 / 25354587 / -5.7% 0.47 / 0.44 / +7.1%
tpch_q15/duckdb:vortex-file-compressed 8702220 / 8381204 / +3.8% 19435610 / 20995174 / -7.4% 0.45 / 0.40 / +12.2%
tpch_q16/duckdb:vortex-file-compressed 16619196 / 16413233 / +1.3% 23430118 / 23979720 / -2.3% 0.71 / 0.68 / +3.6%
tpch_q17/duckdb:vortex-file-compressed 12806482 / 12592677 / +1.7% 27334034 / 28445363 / -3.9% 0.47 / 0.44 / +5.8%
tpch_q18/duckdb:vortex-file-compressed 24479983 / 24316808 / +0.7% 34753906 / 34951044 / -0.6% 0.70 / 0.70 / +1.2%
tpch_q19/duckdb:vortex-file-compressed 11275089 / 11426195 / -1.3% 25991057 / 25766839 / +0.9% 0.43 / 0.44 / -2.2%
tpch_q20/duckdb:vortex-file-compressed 14197366 / 14325643 / -0.9% 30497428 / 30552986 / -0.2% 0.47 / 0.47 / -0.7%
tpch_q21/duckdb:vortex-file-compressed 49119392 / 48281048 / +1.7% 64799583 / 66017908 / -1.8% 0.76 / 0.73 / +3.6%
tpch_q22/duckdb:vortex-file-compressed 16984842 / 16702790 / +1.7% 26366728 / 26800262 / -1.6% 0.64 / 0.62 / +3.4%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47680226 / 47547581 / +0.3% 53255448 / 54112740 / -1.6% 0.90 / 0.88 / +1.9%
tpch_q02/duckdb:parquet 48270394 / 48312217 / -0.1% 55155579 / 55151190 / +0.0% 0.88 / 0.88 / -0.1%
tpch_q03/duckdb:parquet 60176263 / 60217500 / -0.1% 68199348 / 69288935 / -1.6% 0.88 / 0.87 / +1.5%
tpch_q04/duckdb:parquet 34653442 / 34656547 / -0.0% 43130781 / 43053263 / +0.2% 0.80 / 0.80 / -0.2%
tpch_q05/duckdb:parquet 67007643 / 67091722 / -0.1% 76323146 / 77316587 / -1.3% 0.88 / 0.87 / +1.2%
tpch_q06/duckdb:parquet 21562880 / 21601570 / -0.2% 26888783 / 27249425 / -1.3% 0.80 / 0.79 / +1.2%
tpch_q07/duckdb:parquet 63790469 / 63799205 / -0.0% 73084190 / 72405251 / +0.9% 0.87 / 0.88 / -0.9%
tpch_q08/duckdb:parquet 75716642 / 75667269 / +0.1% 85716184 / 86769393 / -1.2% 0.88 / 0.87 / +1.3%
tpch_q09/duckdb:parquet 107847658 / 107847179 / +0.0% 119310566 / 118570948 / +0.6% 0.90 / 0.91 / -0.6%
tpch_q10/duckdb:parquet 105843959 / 105720936 / +0.1% 115914322 / 117200993 / -1.1% 0.91 / 0.90 / +1.2%
tpch_q11/duckdb:parquet 29472343 / 29439572 / +0.1% 34935694 / 34922812 / +0.0% 0.84 / 0.84 / +0.1%
tpch_q12/duckdb:parquet 37140948 / 37121505 / +0.1% 43342047 / 43764563 / -1.0% 0.86 / 0.85 / +1.0%
tpch_q13/duckdb:parquet 174688469 / 174812670 / -0.1% 181974134 / 184970583 / -1.6% 0.96 / 0.95 / +1.6%
tpch_q14/duckdb:parquet 42328891 / 42356235 / -0.1% 50682600 / 51063051 / -0.7% 0.84 / 0.83 / +0.7%
tpch_q15/duckdb:parquet 32561653 / 32503990 / +0.2% 40874013 / 41334737 / -1.1% 0.80 / 0.79 / +1.3%
tpch_q16/duckdb:parquet 47345626 / 47147798 / +0.4% 52535108 / 52668299 / -0.3% 0.90 / 0.90 / +0.7%
tpch_q17/duckdb:parquet 47837679 / 47964459 / -0.3% 56665039 / 56795941 / -0.2% 0.84 / 0.84 / -0.0%
tpch_q18/duckdb:parquet 74083626 / 73982405 / +0.1% 78735773 / 80482798 / -2.2% 0.94 / 0.92 / +2.4%
tpch_q19/duckdb:parquet 49803274 / 49071842 / +1.5% 54231851 / 55601512 / -2.5% 0.92 / 0.88 / +4.1%
tpch_q20/duckdb:parquet 63488784 / 63412118 / +0.1% 72732481 / 73364368 / -0.9% 0.87 / 0.86 / +1.0%
tpch_q21/duckdb:parquet 106575158 / 106560704 / +0.0% 116305860 / 116038695 / +0.2% 0.92 / 0.92 / -0.2%
tpch_q22/duckdb:parquet 50621417 / 50470913 / +0.3% 58693156 / 59155611 / -0.8% 0.86 / 0.85 / +1.1%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 62adb044 vs base 1cdc8cf9
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.9%
Engines: DataFusion No clear signal (+0.9%, low confidence) · DuckDB No clear signal (+0.9%, low confidence)
Vortex (geomean): hot 1.009x ➖ · cold 1.025x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.022x ➖
Shifts: Parquet (control) -0.0% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 5976505 / 6250168 / -4.4% 20284936 / 19751173 / +2.7% 0.29 / 0.32 / -6.9%
fineweb_q01/datafusion:vortex-file-compressed 8573322 / 9285400 / -7.7% 40687660 / 35575139 / +14.4% 🔴 0.21 / 0.26 / -19.3%
fineweb_q02/datafusion:vortex-file-compressed 10500786 / 10567512 / -0.6% 45333969 / 40643432 / +11.5% 🔴 0.23 / 0.26 / -10.9%
fineweb_q03/datafusion:vortex-file-compressed 16926309 / 17539240 / -3.5% 116266112 / 102692107 / +13.2% 🔴 0.15 / 0.17 / -14.8%
fineweb_q04/datafusion:vortex-file-compressed 66177366 / 64090120 / +3.3% 152611532 / 144508483 / +5.6% 0.43 / 0.44 / -2.2%
fineweb_q05/datafusion:vortex-file-compressed 61023292 / 63203121 / -3.4% 144839790 / 139485427 / +3.8% 0.42 / 0.45 / -7.0%
fineweb_q06/datafusion:vortex-file-compressed 16833902 / 17269226 / -2.5% 111193580 / 106346388 / +4.6% 0.15 / 0.16 / -6.8%
fineweb_q07/datafusion:vortex-file-compressed 17145105 / 16748794 / +2.4% 108389558 / 103498538 / +4.7% 0.16 / 0.16 / -2.3%
fineweb_q08/datafusion:vortex-file-compressed 10348392 / 8455804 / +22.4% 🔴 30103821 / 26524896 / +13.5% 🔴 0.34 / 0.32 / +7.8%
datafusion / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9370518 / 9321344 / +0.5% 33374454 / 32543553 / +2.6% 0.28 / 0.29 / -2.0%
fineweb_q01/datafusion:parquet 74728768 / 75943192 / -1.6% 166934339 / 168115168 / -0.7% 0.45 / 0.45 / -0.9%
fineweb_q02/datafusion:parquet 74016201 / 75797688 / -2.4% 167126507 / 156430678 / +6.8% 0.44 / 0.48 / -8.6%
fineweb_q03/datafusion:parquet 73803198 / 73828035 / -0.0% 167671884 / 151042261 / +11.0% 🔴 0.44 / 0.49 / -9.9%
fineweb_q04/datafusion:parquet 82179894 / 82454360 / -0.3% 161635621 / 161665686 / -0.0% 0.51 / 0.51 / -0.3%
fineweb_q05/datafusion:parquet 80346262 / 81339953 / -1.2% 156192262 / 155427779 / +0.5% 0.51 / 0.52 / -1.7%
fineweb_q06/datafusion:parquet 75389366 / 76823475 / -1.9% 158312453 / 164720545 / -3.9% 0.48 / 0.47 / +2.1%
fineweb_q07/datafusion:parquet 74219083 / 73784924 / +0.6% 150852740 / 154776922 / -2.5% 0.49 / 0.48 / +3.2%
fineweb_q08/datafusion:parquet 74586528 / 73667172 / +1.2% 164997496 / 153339658 / +7.6% 0.45 / 0.48 / -5.9%
duckdb / vortex-file-compressed / ns (1.014x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2148636 / 2129396 / +0.9% 7134197 / 8430467 / -15.4% 🟢 0.30 / 0.25 / +19.2%
fineweb_q01/duckdb:vortex-file-compressed 7822072 / 7609840 / +2.8% 25768444 / 27699884 / -7.0% 0.30 / 0.27 / +10.5%
fineweb_q02/duckdb:vortex-file-compressed 9059666 / 8999654 / +0.7% 27911453 / 32238453 / -13.4% 🟢 0.32 / 0.28 / +16.3%
fineweb_q03/duckdb:vortex-file-compressed 18433802 / 17999961 / +2.4% 92652992 / 89729159 / +3.3% 0.20 / 0.20 / -0.8%
fineweb_q04/duckdb:vortex-file-compressed 65906029 / 64895256 / +1.6% 106713558 / 105319449 / +1.3% 0.62 / 0.62 / +0.2%
fineweb_q05/duckdb:vortex-file-compressed 65122648 / 64576607 / +0.8% 102738683 / 100642505 / +2.1% 0.63 / 0.64 / -1.2%
fineweb_q06/duckdb:vortex-file-compressed 18356610 / 17451004 / +5.2% 92016001 / 90997772 / +1.1% 0.20 / 0.19 / +4.0%
fineweb_q07/duckdb:vortex-file-compressed 17506916 / 17567882 / -0.3% 94477751 / 90262327 / +4.7% 0.19 / 0.19 / -4.8%
fineweb_q08/duckdb:vortex-file-compressed 4437762 / 4479276 / -0.9% 12732219 / 12680631 / +0.4% 0.35 / 0.35 / -1.3%
duckdb / parquet / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 24121288 / 23575786 / +2.3% 27943271 / 27901054 / +0.2% 0.86 / 0.84 / +2.2%
fineweb_q01/duckdb:parquet 54783129 / 53435612 / +2.5% 74628097 / 71035947 / +5.1% 0.73 / 0.75 / -2.4%
fineweb_q02/duckdb:parquet 57780602 / 58133262 / -0.6% 77883085 / 71614459 / +8.8% 0.74 / 0.81 / -8.6%
fineweb_q03/duckdb:parquet 118731986 / 119431288 / -0.6% 177241456 / 174813976 / +1.4% 0.67 / 0.68 / -1.9%
fineweb_q04/duckdb:parquet 161291946 / 160054805 / +0.8% 206751538 / 201506963 / +2.6% 0.78 / 0.79 / -1.8%
fineweb_q05/duckdb:parquet 156780706 / 159362006 / -1.6% 200281116 / 199292933 / +0.5% 0.78 / 0.80 / -2.1%
fineweb_q06/duckdb:parquet 88795208 / 88786282 / +0.0% 151208451 / 152544283 / -0.9% 0.59 / 0.58 / +0.9%
fineweb_q07/duckdb:parquet 91328394 / 90890989 / +0.5% 143549543 / 143350764 / +0.1% 0.64 / 0.63 / +0.3%
fineweb_q08/duckdb:parquet 29345662 / 28981936 / +1.3% 30724573 / 30002232 / +2.4% 0.96 / 0.97 / -1.1%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 62adb044 vs base ab5a0046
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Engines: DataFusion No clear signal (+0.0%, low confidence) · DuckDB No clear signal (+0.0%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.030x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.015x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21963658 / 21999911 / -0.2% 42359025 / 39946370 / +6.0% 0.52 / 0.55 / -5.9%
tpcds_q02/datafusion:vortex-file-compressed 43166732 / 42893253 / +0.6% 64840726 / 62914880 / +3.1% 0.67 / 0.68 / -2.4%
tpcds_q03/datafusion:vortex-file-compressed 11760750 / 11605178 / +1.3% 29088295 / 26609156 / +9.3% 0.40 / 0.44 / -7.3%
tpcds_q04/datafusion:vortex-file-compressed 79944197 / 78951654 / +1.3% 111062404 / 104564818 / +6.2% 0.72 / 0.76 / -4.7%
tpcds_q05/datafusion:vortex-file-compressed 57047330 / 55941465 / +2.0% 81172358 / 74124262 / +9.5% 0.70 / 0.75 / -6.9%
tpcds_q06/datafusion:vortex-file-compressed 21499203 / 21333720 / +0.8% 43665528 / 41069841 / +6.3% 0.49 / 0.52 / -5.2%
tpcds_q07/datafusion:vortex-file-compressed 26142678 / 26386390 / -0.9% 49438479 / 48176326 / +2.6% 0.53 / 0.55 / -3.5%
tpcds_q08/datafusion:vortex-file-compressed 25802650 / 25587712 / +0.8% 46831236 / 43682364 / +7.2% 0.55 / 0.59 / -5.9%
tpcds_q09/datafusion:vortex-file-compressed 20126092 / 19896226 / +1.2% 38125063 / 37474977 / +1.7% 0.53 / 0.53 / -0.6%
tpcds_q10/datafusion:vortex-file-compressed 29553425 / 29546889 / +0.0% 53454151 / 51180613 / +4.4% 0.55 / 0.58 / -4.2%
tpcds_q11/datafusion:vortex-file-compressed 48518840 / 49121194 / -1.2% 77019495 / 75394766 / +2.2% 0.63 / 0.65 / -3.3%
tpcds_q12/datafusion:vortex-file-compressed 15144614 / 14946749 / +1.3% 34375975 / 31749886 / +8.3% 0.44 / 0.47 / -6.4%
tpcds_q13/datafusion:vortex-file-compressed 30620898 / 31860550 / -3.9% 56907972 / 53865238 / +5.6% 0.54 / 0.59 / -9.0%
tpcds_q14/datafusion:vortex-file-compressed 489421598 / 487421370 / +0.4% 546943358 / 542474028 / +0.8% 0.89 / 0.90 / -0.4%
tpcds_q15/datafusion:vortex-file-compressed 12375401 / 12586756 / -1.7% 32982457 / 29869991 / +10.4% 🔴 0.38 / 0.42 / -11.0%
tpcds_q16/datafusion:vortex-file-compressed 19568550 / 18761618 / +4.3% 39669278 / 37089591 / +7.0% 0.49 / 0.51 / -2.5%
tpcds_q17/datafusion:vortex-file-compressed 52690822 / 53607682 / -1.7% 73965030 / 70072689 / +5.6% 0.71 / 0.77 / -6.9%
tpcds_q18/datafusion:vortex-file-compressed 62839646 / 62349632 / +0.8% 69601593 / 88633124 / -21.5% 🟢 0.90 / 0.70 / +28.3%
tpcds_q19/datafusion:vortex-file-compressed 17219782 / 17064877 / +0.9% 39758783 / 38137570 / +4.3% 0.43 / 0.45 / -3.2%
tpcds_q20/datafusion:vortex-file-compressed 16962633 / 16875604 / +0.5% 36710858 / 33398462 / +9.9% 0.46 / 0.51 / -8.6%
tpcds_q21/datafusion:vortex-file-compressed 15322316 / 14801170 / +3.5% 34649876 / 32973615 / +5.1% 0.44 / 0.45 / -1.5%
tpcds_q22/datafusion:vortex-file-compressed 49188524 / 49325762 / -0.3% 69710529 / 67699156 / +3.0% 0.71 / 0.73 / -3.2%
tpcds_q23/datafusion:vortex-file-compressed 71645238 / 72276124 / -0.9% 98363072 / 97272882 / +1.1% 0.73 / 0.74 / -2.0%
tpcds_q24/datafusion:vortex-file-compressed 64110707 / 63926868 / +0.3% 88757256 / 83129432 / +6.8% 0.72 / 0.77 / -6.1%
tpcds_q25/datafusion:vortex-file-compressed 45734870 / 44475855 / +2.8% 71028275 / 66779639 / +6.4% 0.64 / 0.67 / -3.3%
tpcds_q26/datafusion:vortex-file-compressed 25972516 / 26101808 / -0.5% 47465172 / 45977400 / +3.2% 0.55 / 0.57 / -3.6%
tpcds_q27/datafusion:vortex-file-compressed 51843318 / 53289153 / -2.7% 75259167 / 76338183 / -1.4% 0.69 / 0.70 / -1.3%
tpcds_q28/datafusion:vortex-file-compressed 19476756 / 19381416 / +0.5% 37842358 / 39922526 / -5.2% 0.51 / 0.49 / +6.0%
tpcds_q29/datafusion:vortex-file-compressed 51989143 / 52347589 / -0.7% 73315179 / 73566264 / -0.3% 0.71 / 0.71 / -0.3%
tpcds_q30/datafusion:vortex-file-compressed 27309878 / 27661427 / -1.3% 46876854 / 45075272 / +4.0% 0.58 / 0.61 / -5.1%
tpcds_q31/datafusion:vortex-file-compressed 63050418 / 62516696 / +0.9% 90023010 / 87634339 / +2.7% 0.70 / 0.71 / -1.8%
tpcds_q32/datafusion:vortex-file-compressed 13037894 / 13025350 / +0.1% 30638734 / 30062663 / +1.9% 0.43 / 0.43 / -1.8%
tpcds_q33/datafusion:vortex-file-compressed 28275384 / 27991706 / +1.0% 51084900 / 50078992 / +2.0% 0.55 / 0.56 / -1.0%
tpcds_q34/datafusion:vortex-file-compressed 17724376 / 17855906 / -0.7% 39846309 / 36650085 / +8.7% 0.44 / 0.49 / -8.7%
tpcds_q35/datafusion:vortex-file-compressed 30186336 / 31075584 / -2.9% 55310753 / 54010849 / +2.4% 0.55 / 0.58 / -5.1%
tpcds_q36/datafusion:vortex-file-compressed 47089383 / 46691248 / +0.9% 69990651 / 69134076 / +1.2% 0.67 / 0.68 / -0.4%
tpcds_q37/datafusion:vortex-file-compressed 12646433 / 12935278 / -2.2% 35601703 / 33965509 / +4.8% 0.36 / 0.38 / -6.7%
tpcds_q38/datafusion:vortex-file-compressed 26314964 / 26436550 / -0.5% 48115945 / 46500479 / +3.5% 0.55 / 0.57 / -3.8%
tpcds_q39/datafusion:vortex-file-compressed 64482982 / 64408856 / +0.1% 88976399 / 87056639 / +2.2% 0.72 / 0.74 / -2.0%
tpcds_q40/datafusion:vortex-file-compressed 22227002 / 22195258 / +0.1% 42106114 / 39059042 / +7.8% 0.53 / 0.57 / -7.1%
tpcds_q41/datafusion:vortex-file-compressed 20201528 / 20181415 / +0.1% 32799503 / 32305841 / +1.5% 0.62 / 0.62 / -1.4%
tpcds_q42/datafusion:vortex-file-compressed 11355911 / 11610268 / -2.2% 31046428 / 27549864 / +12.7% 🔴 0.37 / 0.42 / -13.2%
tpcds_q43/datafusion:vortex-file-compressed 13101562 / 13251107 / -1.1% 33234691 / 31511768 / +5.5% 0.39 / 0.42 / -6.3%
tpcds_q44/datafusion:vortex-file-compressed 27668356 / 27407222 / +1.0% 51809902 / 49901538 / +3.8% 0.53 / 0.55 / -2.8%
tpcds_q45/datafusion:vortex-file-compressed 16733062 / 17168016 / -2.5% 36248975 / 34200247 / +6.0% 0.46 / 0.50 / -8.0%
tpcds_q46/datafusion:vortex-file-compressed 24014988 / 23558210 / +1.9% 48814873 / 45525195 / +7.2% 0.49 / 0.52 / -4.9%
tpcds_q47/datafusion:vortex-file-compressed 74286078 / 75593490 / -1.7% 107920835 / 103395942 / +4.4% 0.69 / 0.73 / -5.8%
tpcds_q48/datafusion:vortex-file-compressed 28197530 / 28579330 / -1.3% 52167182 / 51250463 / +1.8% 0.54 / 0.56 / -3.1%
tpcds_q49/datafusion:vortex-file-compressed 57067180 / 57212074 / -0.3% 79895187 / 74563681 / +7.2% 0.71 / 0.77 / -6.9%
tpcds_q50/datafusion:vortex-file-compressed 30774619 / 31077502 / -1.0% 55159068 / 51768133 / +6.6% 0.56 / 0.60 / -7.1%
tpcds_q51/datafusion:vortex-file-compressed 66191920 / 67219460 / -1.5% 91609983 / 89984116 / +1.8% 0.72 / 0.75 / -3.3%
tpcds_q52/datafusion:vortex-file-compressed 12090224 / 11829058 / +2.2% 29684963 / 28624926 / +3.7% 0.41 / 0.41 / -1.4%
tpcds_q53/datafusion:vortex-file-compressed 18442244 / 18240894 / +1.1% 40735613 / 37934996 / +7.4% 0.45 / 0.48 / -5.8%
tpcds_q54/datafusion:vortex-file-compressed 31622600 / 32073801 / -1.4% 55809791 / 53625583 / +4.1% 0.57 / 0.60 / -5.3%
tpcds_q55/datafusion:vortex-file-compressed 11448981 / 11528832 / -0.7% 28712247 / 27437884 / +4.6% 0.40 / 0.42 / -5.1%
tpcds_q56/datafusion:vortex-file-compressed 28014824 / 26666916 / +5.1% 49412674 / 47448670 / +4.1% 0.57 / 0.56 / +0.9%
tpcds_q57/datafusion:vortex-file-compressed 61881076 / 62012122 / -0.2% 87872563 / 87267119 / +0.7% 0.70 / 0.71 / -0.9%
tpcds_q58/datafusion:vortex-file-compressed 40235657 / 40818922 / -1.4% 70017767 / 64518211 / +8.5% 0.57 / 0.63 / -9.2%
tpcds_q59/datafusion:vortex-file-compressed 27414666 / 27906409 / -1.8% 54201876 / 53781464 / +0.8% 0.51 / 0.52 / -2.5%
tpcds_q60/datafusion:vortex-file-compressed 27051608 / 27726237 / -2.4% 48671513 / 47532249 / +2.4% 0.56 / 0.58 / -4.7%
tpcds_q61/datafusion:vortex-file-compressed 20329376 / 20214066 / +0.6% 42376079 / 39682747 / +6.8% 0.48 / 0.51 / -5.8%
tpcds_q62/datafusion:vortex-file-compressed 16466548 / 16850174 / -2.3% 35947771 / 34396629 / +4.5% 0.46 / 0.49 / -6.5%
tpcds_q63/datafusion:vortex-file-compressed 18162894 / 18192128 / -0.2% 41941685 / 37641254 / +11.4% 🔴 0.43 / 0.48 / -10.4%
tpcds_q64/datafusion:vortex-file-compressed 190456543 / 188561892 / +1.0% 221579641 / 229680212 / -3.5% 0.86 / 0.82 / +4.7%
tpcds_q65/datafusion:vortex-file-compressed 74053036 / 73066724 / +1.3% 97302595 / 96562612 / +0.8% 0.76 / 0.76 / +0.6%
tpcds_q66/datafusion:vortex-file-compressed 50374191 / 50096568 / +0.6% 71603019 / 69306342 / +3.3% 0.70 / 0.72 / -2.7%
tpcds_q67/datafusion:vortex-file-compressed 50881520 / 51663640 / -1.5% 87417652 / 83492505 / +4.7% 0.58 / 0.62 / -5.9%
tpcds_q68/datafusion:vortex-file-compressed 23016429 / 22888054 / +0.6% 45604082 / 44101071 / +3.4% 0.50 / 0.52 / -2.8%
tpcds_q69/datafusion:vortex-file-compressed 26138196 / 27546142 / -5.1% 49351335 / 47372016 / +4.2% 0.53 / 0.58 / -8.9%
tpcds_q70/datafusion:vortex-file-compressed 73221908 / 73486667 / -0.4% 97170470 / 97916702 / -0.8% 0.75 / 0.75 / +0.4%
tpcds_q71/datafusion:vortex-file-compressed 19335835 / 19173117 / +0.8% 42357094 / 37641700 / +12.5% 🔴 0.46 / 0.51 / -10.4%
tpcds_q72/datafusion:vortex-file-compressed 246699211 / 247376824 / -0.3% 286340081 / 279389691 / +2.5% 0.86 / 0.89 / -2.7%
tpcds_q73/datafusion:vortex-file-compressed 16388910 / 16283788 / +0.6% 37769676 / 37287301 / +1.3% 0.43 / 0.44 / -0.6%
tpcds_q74/datafusion:vortex-file-compressed 40180262 / 40826743 / -1.6% 67005560 / 66742487 / +0.4% 0.60 / 0.61 / -2.0%
tpcds_q75/datafusion:vortex-file-compressed 137070471 / 133968630 / +2.3% 157394440 / 162666038 / -3.2% 0.87 / 0.82 / +5.7%
tpcds_q76/datafusion:vortex-file-compressed 29534810 / 28638050 / +3.1% 50230650 / 48545831 / +3.5% 0.59 / 0.59 / -0.3%
tpcds_q77/datafusion:vortex-file-compressed 45634876 / 44422120 / +2.7% 69293357 / 65708594 / +5.5% 0.66 / 0.68 / -2.6%
tpcds_q78/datafusion:vortex-file-compressed 60603566 / 60965657 / -0.6% 89921375 / 86015972 / +4.5% 0.67 / 0.71 / -4.9%
tpcds_q79/datafusion:vortex-file-compressed 20058448 / 20279438 / -1.1% 41873367 / 42110377 / -0.6% 0.48 / 0.48 / -0.5%
tpcds_q80/datafusion:vortex-file-compressed 69023034 / 68766030 / +0.4% 97424029 / 93570722 / +4.1% 0.71 / 0.73 / -3.6%
tpcds_q81/datafusion:vortex-file-compressed 28096566 / 28260648 / -0.6% 47081603 / 45300560 / +3.9% 0.60 / 0.62 / -4.3%
tpcds_q82/datafusion:vortex-file-compressed 12347216 / 12807434 / -3.6% 35859060 / 35626130 / +0.7% 0.34 / 0.36 / -4.2%
tpcds_q83/datafusion:vortex-file-compressed 35251548 / 35376074 / -0.4% 56216912 / 52093141 / +7.9% 0.63 / 0.68 / -7.7%
tpcds_q84/datafusion:vortex-file-compressed 10809224 / 10461540 / +3.3% 27520107 / 25885722 / +6.3% 0.39 / 0.40 / -2.8%
tpcds_q85/datafusion:vortex-file-compressed 52006494 / 51809666 / +0.4% 79337321 / 75574697 / +5.0% 0.66 / 0.69 / -4.4%
tpcds_q86/datafusion:vortex-file-compressed 16124166 / 16113415 / +0.1% 35307772 / 34409002 / +2.6% 0.46 / 0.47 / -2.5%
tpcds_q87/datafusion:vortex-file-compressed 26253570 / 26499568 / -0.9% 49814218 / 48598250 / +2.5% 0.53 / 0.55 / -3.3%
tpcds_q88/datafusion:vortex-file-compressed 32356156 / 32357568 / -0.0% 53195674 / 50858837 / +4.6% 0.61 / 0.64 / -4.4%
tpcds_q89/datafusion:vortex-file-compressed 21835409 / 21807304 / +0.1% 43777517 / 42407282 / +3.2% 0.50 / 0.51 / -3.0%
tpcds_q90/datafusion:vortex-file-compressed 10381453 / 10365216 / +0.2% 26099726 / 24066050 / +8.5% 0.40 / 0.43 / -7.6%
tpcds_q91/datafusion:vortex-file-compressed 16158580 / 16048840 / +0.7% 37823248 / 36604324 / +3.3% 0.43 / 0.44 / -2.6%
tpcds_q92/datafusion:vortex-file-compressed 13168715 / 13198902 / -0.2% 30509307 / 29685220 / +2.8% 0.43 / 0.44 / -2.9%
tpcds_q93/datafusion:vortex-file-compressed 20141792 / 20150414 / -0.0% 42300066 / 40148939 / +5.4% 0.48 / 0.50 / -5.1%
tpcds_q94/datafusion:vortex-file-compressed 18417987 / 18552985 / -0.7% 39036423 / 37927246 / +2.9% 0.47 / 0.49 / -3.5%
tpcds_q95/datafusion:vortex-file-compressed 42045300 / 41763500 / +0.7% 63137011 / 60866535 / +3.7% 0.67 / 0.69 / -2.9%
tpcds_q96/datafusion:vortex-file-compressed 7592900 / 7859994 / -3.4% 25294176 / 23576532 / +7.3% 0.30 / 0.33 / -10.0%
tpcds_q97/datafusion:vortex-file-compressed 17603538 / 17259486 / +2.0% 40873900 / 37350276 / +9.4% 0.43 / 0.46 / -6.8%
tpcds_q98/datafusion:vortex-file-compressed 16144707 / 16185816 / -0.3% 36348037 / 32671739 / +11.3% 🔴 0.44 / 0.50 / -10.3%
tpcds_q99/datafusion:vortex-file-compressed 16487854 / 16384194 / +0.6% 34503802 / 33993322 / +1.5% 0.48 / 0.48 / -0.9%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 43666615 / 43046149 / +1.4% 58867132 / 59333915 / -0.8% 0.74 / 0.73 / +2.2%
tpcds_q02/datafusion:parquet 55207258 / 55017496 / +0.3% 70261257 / 69006470 / +1.8% 0.79 / 0.80 / -1.4%
tpcds_q03/datafusion:parquet 18926370 / 19078092 / -0.8% 32729182 / 32968281 / -0.7% 0.58 / 0.58 / -0.1%
tpcds_q04/datafusion:parquet 179756974 / 179731768 / +0.0% 207763253 / 199226926 / +4.3% 0.87 / 0.90 / -4.1%
tpcds_q05/datafusion:parquet 68113466 / 68363662 / -0.4% 90694451 / 88310082 / +2.7% 0.75 / 0.77 / -3.0%
tpcds_q06/datafusion:parquet 35029926 / 35133400 / -0.3% 48001087 / 44032369 / +9.0% 0.73 / 0.80 / -8.5%
tpcds_q07/datafusion:parquet 46837630 / 47015244 / -0.4% 63852290 / 63060866 / +1.3% 0.73 / 0.75 / -1.6%
tpcds_q08/datafusion:parquet 31263082 / 31108916 / +0.5% 44280383 / 46407336 / -4.6% 0.71 / 0.67 / +5.3%
tpcds_q09/datafusion:parquet 34627362 / 32235404 / +7.4% 47788144 / 38162448 / +25.2% 🔴 0.72 / 0.84 / -14.2%
tpcds_q10/datafusion:parquet 44122386 / 45810956 / -3.7% 61015251 / 55821116 / +9.3% 0.72 / 0.82 / -11.9%
tpcds_q11/datafusion:parquet 96047572 / 97324552 / -1.3% 119297613 / 116986930 / +2.0% 0.81 / 0.83 / -3.2%
tpcds_q12/datafusion:parquet 23787260 / 23829389 / -0.2% 36112381 / 34561700 / +4.5% 0.66 / 0.69 / -4.5%
tpcds_q13/datafusion:parquet 46289468 / 47205746 / -1.9% 67293136 / 66519722 / +1.2% 0.69 / 0.71 / -3.1%
tpcds_q14/datafusion:parquet 534359778 / 536062596 / -0.3% 588019448 / 573875357 / +2.5% 0.91 / 0.93 / -2.7%
tpcds_q15/datafusion:parquet 23455688 / 23467316 / -0.0% 38529478 / 36912696 / +4.4% 0.61 / 0.64 / -4.2%
tpcds_q16/datafusion:parquet 37166269 / 36797934 / +1.0% 49717023 / 49093338 / +1.3% 0.75 / 0.75 / -0.3%
tpcds_q17/datafusion:parquet 73880380 / 77417738 / -4.6% 97007475 / 94152957 / +3.0% 0.76 / 0.82 / -7.4%
tpcds_q18/datafusion:parquet 67887107 / 67730459 / +0.2% 90339057 / 89015478 / +1.5% 0.75 / 0.76 / -1.2%
tpcds_q19/datafusion:parquet 29650068 / 29767255 / -0.4% 43504557 / 40859608 / +6.5% 0.68 / 0.73 / -6.4%
tpcds_q20/datafusion:parquet 25405286 / 24985466 / +1.7% 38701339 / 37149008 / +4.2% 0.66 / 0.67 / -2.4%
tpcds_q21/datafusion:parquet 20203558 / 20098942 / +0.5% 31997609 / 31199048 / +2.6% 0.63 / 0.64 / -2.0%
tpcds_q22/datafusion:parquet 77041054 / 78225004 / -1.5% 88750347 / 88011450 / +0.8% 0.87 / 0.89 / -2.3%
tpcds_q23/datafusion:parquet 91577511 / 93465786 / -2.0% 113398404 / 115763272 / -2.0% 0.81 / 0.81 / +0.0%
tpcds_q24/datafusion:parquet 89974302 / 90530880 / -0.6% 115505158 / 112774834 / +2.4% 0.78 / 0.80 / -3.0%
tpcds_q25/datafusion:parquet 80638606 / 78942378 / +2.1% 100715339 / 100286343 / +0.4% 0.80 / 0.79 / +1.7%
tpcds_q26/datafusion:parquet 44098962 / 42985690 / +2.6% 59020764 / 59286646 / -0.4% 0.75 / 0.73 / +3.1%
tpcds_q27/datafusion:parquet 74401788 / 78387144 / -5.1% 99172649 / 99975873 / -0.8% 0.75 / 0.78 / -4.3%
tpcds_q28/datafusion:parquet 28611553 / 28355490 / +0.9% 42602959 / 41055918 / +3.8% 0.67 / 0.69 / -2.8%
tpcds_q29/datafusion:parquet 74695960 / 74275574 / +0.6% 97864882 / 99075419 / -1.2% 0.76 / 0.75 / +1.8%
tpcds_q30/datafusion:parquet 42285354 / 44266542 / -4.5% 57779400 / 55134805 / +4.8% 0.73 / 0.80 / -8.8%
tpcds_q31/datafusion:parquet 78948580 / 80991932 / -2.5% 98294974 / 100088488 / -1.8% 0.80 / 0.81 / -0.7%
tpcds_q32/datafusion:parquet 26303850 / 27160338 / -3.2% 39904350 / 37888363 / +5.3% 0.66 / 0.72 / -8.0%
tpcds_q33/datafusion:parquet 38242104 / 37472210 / +2.1% 56813160 / 52784833 / +7.6% 0.67 / 0.71 / -5.2%
tpcds_q34/datafusion:parquet 24165994 / 24223199 / -0.2% 35587665 / 34925847 / +1.9% 0.68 / 0.69 / -2.1%
tpcds_q35/datafusion:parquet 51251735 / 50061658 / +2.4% 62087932 / 66186392 / -6.2% 0.83 / 0.76 / +9.1%
tpcds_q36/datafusion:parquet 52612630 / 53863620 / -2.3% 73278011 / 72008538 / +1.8% 0.72 / 0.75 / -4.0%
tpcds_q37/datafusion:parquet 21760424 / 21492292 / +1.2% 34415117 / 33965178 / +1.3% 0.63 / 0.63 / -0.1%
tpcds_q38/datafusion:parquet 45128598 / 43738358 / +3.2% 58906596 / 58984516 / -0.1% 0.77 / 0.74 / +3.3%
tpcds_q39/datafusion:parquet 68796571 / 68451454 / +0.5% 85345480 / 84694449 / +0.8% 0.81 / 0.81 / -0.3%
tpcds_q40/datafusion:parquet 30841592 / 29898065 / +3.2% 49971528 / 49416081 / +1.1% 0.62 / 0.61 / +2.0%
tpcds_q41/datafusion:parquet 20029440 / 19725044 / +1.5% 31857739 / 31567276 / +0.9% 0.63 / 0.62 / +0.6%
tpcds_q42/datafusion:parquet 18252498 / 18410036 / -0.9% 30530177 / 29096386 / +4.9% 0.60 / 0.63 / -5.5%
tpcds_q43/datafusion:parquet 19510479 / 19482850 / +0.1% 31982438 / 30496940 / +4.9% 0.61 / 0.64 / -4.5%
tpcds_q44/datafusion:parquet 35408728 / 35289568 / +0.3% 49089309 / 48402674 / +1.4% 0.72 / 0.73 / -1.1%
tpcds_q45/datafusion:parquet 28222758 / 28034722 / +0.7% 41473400 / 38421721 / +7.9% 0.68 / 0.73 / -6.7%
tpcds_q46/datafusion:parquet 29120700 / 29018574 / +0.4% 45587502 / 44678861 / +2.0% 0.64 / 0.65 / -1.6%
tpcds_q47/datafusion:parquet 98419272 / 96614053 / +1.9% 118900948 / 119575121 / -0.6% 0.83 / 0.81 / +2.4%
tpcds_q48/datafusion:parquet 42039110 / 42307228 / -0.6% 59556150 / 57749935 / +3.1% 0.71 / 0.73 / -3.6%
tpcds_q49/datafusion:parquet 72007050 / 72427164 / -0.6% 97069071 / 91585118 / +6.0% 0.74 / 0.79 / -6.2%
tpcds_q50/datafusion:parquet 46797345 / 47500422 / -1.5% 68670987 / 68227695 / +0.6% 0.68 / 0.70 / -2.1%
tpcds_q51/datafusion:parquet 76299539 / 74856850 / +1.9% 94501757 / 94480088 / +0.0% 0.81 / 0.79 / +1.9%
tpcds_q52/datafusion:parquet 18610614 / 18570137 / +0.2% 30335945 / 28281276 / +7.3% 0.61 / 0.66 / -6.6%
tpcds_q53/datafusion:parquet 22249788 / 21996628 / +1.2% 38711051 / 37632392 / +2.9% 0.57 / 0.58 / -1.7%
tpcds_q54/datafusion:parquet 53729146 / 53403201 / +0.6% 67587058 / 65412957 / +3.3% 0.79 / 0.82 / -2.6%
tpcds_q55/datafusion:parquet 18505680 / 18094322 / +2.3% 29313263 / 28452535 / +3.0% 0.63 / 0.64 / -0.7%
tpcds_q56/datafusion:parquet 41218368 / 42064521 / -2.0% 53812647 / 52494093 / +2.5% 0.77 / 0.80 / -4.4%
tpcds_q57/datafusion:parquet 102387162 / 98531152 / +3.9% 116235839 / 115051750 / +1.0% 0.88 / 0.86 / +2.9%
tpcds_q58/datafusion:parquet 65659542 / 66028114 / -0.6% 82385471 / 80484923 / +2.4% 0.80 / 0.82 / -2.9%
tpcds_q59/datafusion:parquet 47252441 / 48124550 / -1.8% 65629817 / 63375622 / +3.6% 0.72 / 0.76 / -5.2%
tpcds_q60/datafusion:parquet 40097945 / 41774428 / -4.0% 56919740 / 52913053 / +7.6% 0.70 / 0.79 / -10.8%
tpcds_q61/datafusion:parquet 37235206 / 36568854 / +1.8% 51096286 / 53842276 / -5.1% 0.73 / 0.68 / +7.3%
tpcds_q62/datafusion:parquet 25135707 / 25168784 / -0.1% 37398027 / 38657488 / -3.3% 0.67 / 0.65 / +3.2%
tpcds_q63/datafusion:parquet 22219352 / 22467320 / -1.1% 37972176 / 36224907 / +4.8% 0.59 / 0.62 / -5.7%
tpcds_q64/datafusion:parquet 286461032 / 285654170 / +0.3% 320332447 / 321241476 / -0.3% 0.89 / 0.89 / +0.6%
tpcds_q65/datafusion:parquet 120444471 / 119227688 / +1.0% 134833787 / 139579808 / -3.4% 0.89 / 0.85 / +4.6%
tpcds_q66/datafusion:parquet 60322195 / 61287888 / -1.6% 79663120 / 75163315 / +6.0% 0.76 / 0.82 / -7.1%
tpcds_q67/datafusion:parquet 68878574 / 69044428 / -0.2% 92650326 / 91696967 / +1.0% 0.74 / 0.75 / -1.3%
tpcds_q68/datafusion:parquet 28786172 / 29075160 / -1.0% 48547076 / 47405672 / +2.4% 0.59 / 0.61 / -3.3%
tpcds_q69/datafusion:parquet 43969384 / 43304174 / +1.5% 58560070 / 58652073 / -0.2% 0.75 / 0.74 / +1.7%
tpcds_q70/datafusion:parquet 80747607 / 80027439 / +0.9% 98933948 / 97604918 / +1.4% 0.82 / 0.82 / -0.5%
tpcds_q71/datafusion:parquet 24308702 / 25732466 / -5.5% 36168227 / 40528677 / -10.8% 🟢 0.67 / 0.63 / +5.9%
tpcds_q72/datafusion:parquet 526800597 / 527634840 / -0.2% 560347775 / 554349016 / +1.1% 0.94 / 0.95 / -1.2%
tpcds_q73/datafusion:parquet 23825188 / 23762050 / +0.3% 36776044 / 35077300 / +4.8% 0.65 / 0.68 / -4.4%
tpcds_q74/datafusion:parquet 68688442 / 69999536 / -1.9% 88624184 / 88289509 / +0.4% 0.78 / 0.79 / -2.2%
tpcds_q75/datafusion:parquet 152814686 / 152662930 / +0.1% 176104692 / 180450074 / -2.4% 0.87 / 0.85 / +2.6%
tpcds_q76/datafusion:parquet 32949866 / 33132911 / -0.6% 46984438 / 44935481 / +4.6% 0.70 / 0.74 / -4.9%
tpcds_q77/datafusion:parquet 56276361 / 56979256 / -1.2% 77214366 / 72969812 / +5.8% 0.73 / 0.78 / -6.7%
tpcds_q78/datafusion:parquet 84354182 / 85272162 / -1.1% 119839829 / 115614404 / +3.7% 0.70 / 0.74 / -4.6%
tpcds_q79/datafusion:parquet 26797817 / 26735792 / +0.2% 42010148 / 39769716 / +5.6% 0.64 / 0.67 / -5.1%
tpcds_q80/datafusion:parquet 81217184 / 78680880 / +3.2% 110450728 / 107863155 / +2.4% 0.74 / 0.73 / +0.8%
tpcds_q81/datafusion:parquet 37102106 / 39558134 / -6.2% 50990186 / 51081109 / -0.2% 0.73 / 0.77 / -6.0%
tpcds_q82/datafusion:parquet 22727861 / 22190428 / +2.4% 34045704 / 34291795 / -0.7% 0.67 / 0.65 / +3.2%
tpcds_q83/datafusion:parquet 59983326 / 58307740 / +2.9% 75878201 / 73002134 / +3.9% 0.79 / 0.80 / -1.0%
tpcds_q84/datafusion:parquet 26756578 / 27313596 / -2.0% 40602144 / 40041516 / +1.4% 0.66 / 0.68 / -3.4%
tpcds_q85/datafusion:parquet 79945298 / 79983598 / -0.0% 103899991 / 102306985 / +1.6% 0.77 / 0.78 / -1.6%
tpcds_q86/datafusion:parquet 21143000 / 21058438 / +0.4% 33383454 / 32574181 / +2.5% 0.63 / 0.65 / -2.0%
tpcds_q87/datafusion:parquet 45388319 / 45280914 / +0.2% 61103535 / 62384128 / -2.1% 0.74 / 0.73 / +2.3%
tpcds_q88/datafusion:parquet 38037806 / 37757294 / +0.7% 52315797 / 51820809 / +1.0% 0.73 / 0.73 / -0.2%
tpcds_q89/datafusion:parquet 25593550 / 26318301 / -2.8% 41866120 / 39991728 / +4.7% 0.61 / 0.66 / -7.1%
tpcds_q90/datafusion:parquet 15302084 / 15087966 / +1.4% 25852249 / 26597960 / -2.8% 0.59 / 0.57 / +4.3%
tpcds_q91/datafusion:parquet 32351828 / 32625398 / -0.8% 45636853 / 45196471 / +1.0% 0.71 / 0.72 / -1.8%
tpcds_q92/datafusion:parquet 26910448 / 26834922 / +0.3% 41362935 / 38063167 / +8.7% 0.65 / 0.71 / -7.7%
tpcds_q93/datafusion:parquet 26985040 / 26735974 / +0.9% 47143415 / 42486273 / +11.0% 🔴 0.57 / 0.63 / -9.0%
tpcds_q94/datafusion:parquet 35250281 / 35393988 / -0.4% 48999440 / 47118664 / +4.0% 0.72 / 0.75 / -4.2%
tpcds_q95/datafusion:parquet 64134368 / 64212454 / -0.1% 79435950 / 79492966 / -0.1% 0.81 / 0.81 / -0.0%
tpcds_q96/datafusion:parquet 12873242 / 12723054 / +1.2% 23807810 / 23429883 / +1.6% 0.54 / 0.54 / -0.4%
tpcds_q97/datafusion:parquet 35378415 / 35098156 / +0.8% 50270673 / 49335860 / +1.9% 0.70 / 0.71 / -1.1%
tpcds_q98/datafusion:parquet 24628101 / 25139323 / -2.0% 38112258 / 36349537 / +4.8% 0.65 / 0.69 / -6.6%
tpcds_q99/datafusion:parquet 29795824 / 29673968 / +0.4% 42164287 / 41366470 / +1.9% 0.71 / 0.72 / -1.5%
duckdb / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 16313022 / 15890239 / +2.7% 24817901 / 24196641 / +2.6% 0.66 / 0.66 / +0.1%
tpcds_q02/duckdb:vortex-file-compressed 18606154 / 18657920 / -0.3% 22593969 / 22422968 / +0.8% 0.82 / 0.83 / -1.0%
tpcds_q03/duckdb:vortex-file-compressed 6979471 / 7149274 / -2.4% 15964623 / 16220757 / -1.6% 0.44 / 0.44 / -0.8%
tpcds_q04/duckdb:vortex-file-compressed 58812480 / 58862208 / -0.1% 71429375 / 71856038 / -0.6% 0.82 / 0.82 / +0.5%
tpcds_q05/duckdb:vortex-file-compressed 22780984 / 23117854 / -1.5% 32486604 / 32942130 / -1.4% 0.70 / 0.70 / -0.1%
tpcds_q06/duckdb:vortex-file-compressed 24101674 / 24164680 / -0.3% 39906229 / 37874428 / +5.4% 0.60 / 0.64 / -5.3%
tpcds_q07/duckdb:vortex-file-compressed 22090080 / 22109802 / -0.1% 34969295 / 32504438 / +7.6% 0.63 / 0.68 / -7.1%
tpcds_q08/duckdb:vortex-file-compressed 17222552 / 17492722 / -1.5% 25857676 / 25089879 / +3.1% 0.67 / 0.70 / -4.5%
tpcds_q09/duckdb:vortex-file-compressed 19059952 / 19005454 / +0.3% 29292904 / 29541405 / -0.8% 0.65 / 0.64 / +1.1%
tpcds_q10/duckdb:vortex-file-compressed 27395408 / 27533383 / -0.5% 41732506 / 41135181 / +1.5% 0.66 / 0.67 / -1.9%
tpcds_q11/duckdb:vortex-file-compressed 36417475 / 36618646 / -0.5% 44214295 / 44343100 / -0.3% 0.82 / 0.83 / -0.3%
tpcds_q12/duckdb:vortex-file-compressed 9800600 / 9679752 / +1.2% 17123468 / 17229625 / -0.6% 0.57 / 0.56 / +1.9%
tpcds_q13/duckdb:vortex-file-compressed 19754730 / 19843352 / -0.4% 33988364 / 31995768 / +6.2% 0.58 / 0.62 / -6.3%
tpcds_q14/duckdb:vortex-file-compressed 55679464 / 55297112 / +0.7% 65668660 / 64955646 / +1.1% 0.85 / 0.85 / -0.4%
tpcds_q15/duckdb:vortex-file-compressed 11078450 / 11325009 / -2.2% 18412147 / 18325444 / +0.5% 0.60 / 0.62 / -2.6%
tpcds_q16/duckdb:vortex-file-compressed 24578682 / 24731064 / -0.6% 36269326 / 34853379 / +4.1% 0.68 / 0.71 / -4.5%
tpcds_q17/duckdb:vortex-file-compressed 20301940 / 20396798 / -0.5% 32028749 / 32338231 / -1.0% 0.63 / 0.63 / +0.5%
tpcds_q18/duckdb:vortex-file-compressed 32172778 / 32346349 / -0.5% 43850275 / 43278488 / +1.3% 0.73 / 0.75 / -1.8%
tpcds_q19/duckdb:vortex-file-compressed 20472306 / 20786617 / -1.5% 29504005 / 29101806 / +1.4% 0.69 / 0.71 / -2.9%
tpcds_q20/duckdb:vortex-file-compressed 10797618 / 10704608 / +0.9% 17843941 / 17476285 / +2.1% 0.61 / 0.61 / -1.2%
tpcds_q21/duckdb:vortex-file-compressed 9209999 / 9371898 / -1.7% 23200978 / 21703364 / +6.9% 0.40 / 0.43 / -8.1%
tpcds_q22/duckdb:vortex-file-compressed 17451317 / 17643249 / -1.1% 30112516 / 29161310 / +3.3% 0.58 / 0.61 / -4.2%
tpcds_q23/duckdb:vortex-file-compressed 37303898 / 37431455 / -0.3% 48611136 / 48459168 / +0.3% 0.77 / 0.77 / -0.7%
tpcds_q24/duckdb:vortex-file-compressed 26522300 / 26441519 / +0.3% 36858605 / 36595428 / +0.7% 0.72 / 0.72 / -0.4%
tpcds_q25/duckdb:vortex-file-compressed 19345002 / 19221668 / +0.6% 31425136 / 30221864 / +4.0% 0.62 / 0.64 / -3.2%
tpcds_q26/duckdb:vortex-file-compressed 21724836 / 21300105 / +2.0% 31437926 / 31212707 / +0.7% 0.69 / 0.68 / +1.3%
tpcds_q27/duckdb:vortex-file-compressed 24806695 / 24807916 / -0.0% 37284979 / 35637087 / +4.6% 0.67 / 0.70 / -4.4%
tpcds_q28/duckdb:vortex-file-compressed 15010995 / 15090790 / -0.5% 25250051 / 25912108 / -2.6% 0.59 / 0.58 / +2.1%
tpcds_q29/duckdb:vortex-file-compressed 18756860 / 18678136 / +0.4% 30335739 / 29174081 / +4.0% 0.62 / 0.64 / -3.4%
tpcds_q30/duckdb:vortex-file-compressed 18290905 / 18682425 / -2.1% 27623906 / 27172488 / +1.7% 0.66 / 0.69 / -3.7%
tpcds_q31/duckdb:vortex-file-compressed 18042402 / 17961668 / +0.4% 25932265 / 26844104 / -3.4% 0.70 / 0.67 / +4.0%
tpcds_q32/duckdb:vortex-file-compressed 10223176 / 10237077 / -0.1% 18503477 / 18081369 / +2.3% 0.55 / 0.57 / -2.4%
tpcds_q33/duckdb:vortex-file-compressed 17334971 / 17651904 / -1.8% 27634760 / 27599437 / +0.1% 0.63 / 0.64 / -1.9%
tpcds_q34/duckdb:vortex-file-compressed 13013028 / 12881700 / +1.0% 22962628 / 21645185 / +6.1% 0.57 / 0.60 / -4.8%
tpcds_q35/duckdb:vortex-file-compressed 30893634 / 31119364 / -0.7% 44683998 / 42566508 / +5.0% 0.69 / 0.73 / -5.4%
tpcds_q36/duckdb:vortex-file-compressed 13981760 / 14037150 / -0.4% 24669895 / 23560362 / +4.7% 0.57 / 0.60 / -4.9%
tpcds_q37/duckdb:vortex-file-compressed 9161630 / 9278629 / -1.3% 24100308 / 24238961 / -0.6% 0.38 / 0.38 / -0.7%
tpcds_q38/duckdb:vortex-file-compressed 24463780 / 24606434 / -0.6% 32030025 / 31179343 / +2.7% 0.76 / 0.79 / -3.2%
tpcds_q39/duckdb:vortex-file-compressed 18473323 / 18495272 / -0.1% 33094149 / 30737214 / +7.7% 0.56 / 0.60 / -7.2%
tpcds_q40/duckdb:vortex-file-compressed 10905316 / 11167876 / -2.4% 20416376 / 19316090 / +5.7% 0.53 / 0.58 / -7.6%
tpcds_q41/duckdb:vortex-file-compressed 17314106 / 17305600 / +0.0% 23598625 / 24395246 / -3.3% 0.73 / 0.71 / +3.4%
tpcds_q42/duckdb:vortex-file-compressed 6861147 / 6914912 / -0.8% 16683193 / 15064464 / +10.7% 🔴 0.41 / 0.46 / -10.4%
tpcds_q43/duckdb:vortex-file-compressed 9535009 / 9643249 / -1.1% 19540061 / 18160250 / +7.6% 0.49 / 0.53 / -8.1%
tpcds_q44/duckdb:vortex-file-compressed 12420201 / 12476409 / -0.5% 26400925 / 23821756 / +10.8% 🔴 0.47 / 0.52 / -10.2%
tpcds_q45/duckdb:vortex-file-compressed 23444737 / 23587638 / -0.6% 31663407 / 30430270 / +4.1% 0.74 / 0.78 / -4.5%
tpcds_q46/duckdb:vortex-file-compressed 31538972 / 31418024 / +0.4% 43751027 / 43171545 / +1.3% 0.72 / 0.73 / -0.9%
tpcds_q47/duckdb:vortex-file-compressed 31074724 / 31264494 / -0.6% 41765867 / 41141020 / +1.5% 0.74 / 0.76 / -2.1%
tpcds_q48/duckdb:vortex-file-compressed 22418678 / 22472531 / -0.2% 35709038 / 35469142 / +0.7% 0.63 / 0.63 / -0.9%
tpcds_q49/duckdb:vortex-file-compressed 18955586 / 18985566 / -0.2% 31342619 / 29722088 / +5.5% 0.60 / 0.64 / -5.3%
tpcds_q50/duckdb:vortex-file-compressed 14912560 / 14896845 / +0.1% 26784697 / 25687406 / +4.3% 0.56 / 0.58 / -4.0%
tpcds_q51/duckdb:vortex-file-compressed 48729484 / 48063878 / +1.4% 76931497 / 76334322 / +0.8% 0.63 / 0.63 / +0.6%
tpcds_q52/duckdb:vortex-file-compressed 7168807 / 7171716 / -0.0% 16259092 / 15978547 / +1.8% 0.44 / 0.45 / -1.8%
tpcds_q53/duckdb:vortex-file-compressed 11363918 / 11319189 / +0.4% 20398204 / 21681207 / -5.9% 0.56 / 0.52 / +6.7%
tpcds_q54/duckdb:vortex-file-compressed 19739714 / 19748759 / -0.0% 30142288 / 29438540 / +2.4% 0.65 / 0.67 / -2.4%
tpcds_q55/duckdb:vortex-file-compressed 6853188 / 6847788 / +0.1% 16383748 / 15285422 / +7.2% 0.42 / 0.45 / -6.6%
tpcds_q56/duckdb:vortex-file-compressed 17872498 / 17817582 / +0.3% 29727577 / 28613711 / +3.9% 0.60 / 0.62 / -3.5%
tpcds_q57/duckdb:vortex-file-compressed 25744754 / 25308086 / +1.7% 33655672 / 33487780 / +0.5% 0.76 / 0.76 / +1.2%
tpcds_q58/duckdb:vortex-file-compressed 20284584 / 20359384 / -0.4% 30734562 / 29241349 / +5.1% 0.66 / 0.70 / -5.2%
tpcds_q59/duckdb:vortex-file-compressed 19579294 / 19485481 / +0.5% 26845328 / 26442217 / +1.5% 0.73 / 0.74 / -1.0%
tpcds_q60/duckdb:vortex-file-compressed 18574313 / 18504610 / +0.4% 29284127 / 28842068 / +1.5% 0.63 / 0.64 / -1.1%
tpcds_q61/duckdb:vortex-file-compressed 19776489 / 19922872 / -0.7% 30919981 / 30039600 / +2.9% 0.64 / 0.66 / -3.6%
tpcds_q62/duckdb:vortex-file-compressed 11032803 / 10937722 / +0.9% 17372740 / 17144486 / +1.3% 0.64 / 0.64 / -0.5%
tpcds_q63/duckdb:vortex-file-compressed 10851040 / 10809960 / +0.4% 19325670 / 20560158 / -6.0% 0.56 / 0.53 / +6.8%
tpcds_q64/duckdb:vortex-file-compressed 52769636 / 52513062 / +0.5% 67985359 / 68406502 / -0.6% 0.78 / 0.77 / +1.1%
tpcds_q65/duckdb:vortex-file-compressed 13123820 / 13060742 / +0.5% 24390531 / 23236608 / +5.0% 0.54 / 0.56 / -4.3%
tpcds_q66/duckdb:vortex-file-compressed 30870554 / 31272590 / -1.3% 38891761 / 39351988 / -1.2% 0.79 / 0.79 / -0.1%
tpcds_q67/duckdb:vortex-file-compressed 55306138 / 55266268 / +0.1% 64788379 / 64683896 / +0.2% 0.85 / 0.85 / -0.1%
tpcds_q68/duckdb:vortex-file-compressed 22830812 / 23009998 / -0.8% 36377040 / 35296552 / +3.1% 0.63 / 0.65 / -3.7%
tpcds_q69/duckdb:vortex-file-compressed 21854867 / 22017648 / -0.7% 37226047 / 36691775 / +1.5% 0.59 / 0.60 / -2.2%
tpcds_q70/duckdb:vortex-file-compressed 14865541 / 14724129 / +1.0% 25665994 / 25052861 / +2.4% 0.58 / 0.59 / -1.5%
tpcds_q71/duckdb:vortex-file-compressed 13147688 / 13347567 / -1.5% 23731764 / 23409485 / +1.4% 0.55 / 0.57 / -2.8%
tpcds_q72/duckdb:vortex-file-compressed 42789744 / 43060600 / -0.6% 56394268 / 56269909 / +0.2% 0.76 / 0.77 / -0.8%
tpcds_q73/duckdb:vortex-file-compressed 12022347 / 11829364 / +1.6% 21761974 / 21106781 / +3.1% 0.55 / 0.56 / -1.4%
tpcds_q74/duckdb:vortex-file-compressed 30610642 / 30874616 / -0.9% 40056522 / 39304395 / +1.9% 0.76 / 0.79 / -2.7%
tpcds_q75/duckdb:vortex-file-compressed 37062369 / 37067086 / -0.0% 49628503 / 48402666 / +2.5% 0.75 / 0.77 / -2.5%
tpcds_q76/duckdb:vortex-file-compressed 12665474 / 12879005 / -1.7% 23013473 / 22058251 / +4.3% 0.55 / 0.58 / -5.7%
tpcds_q77/duckdb:vortex-file-compressed 20801930 / 20386666 / +2.0% 31931080 / 31298903 / +2.0% 0.65 / 0.65 / +0.0%
tpcds_q78/duckdb:vortex-file-compressed 42920106 / 42921238 / -0.0% 56006099 / 52920959 / +5.8% 0.77 / 0.81 / -5.5%
tpcds_q79/duckdb:vortex-file-compressed 16942777 / 17204298 / -1.5% 28846542 / 26915068 / +7.2% 0.59 / 0.64 / -8.1%
tpcds_q80/duckdb:vortex-file-compressed 29480530 / 29835128 / -1.2% 44827686 / 43751968 / +2.5% 0.66 / 0.68 / -3.6%
tpcds_q81/duckdb:vortex-file-compressed 21276890 / 21403570 / -0.6% 30407827 / 30302750 / +0.3% 0.70 / 0.71 / -0.9%
tpcds_q82/duckdb:vortex-file-compressed 9579542 / 9601288 / -0.2% 23862204 / 23700733 / +0.7% 0.40 / 0.41 / -0.9%
tpcds_q83/duckdb:vortex-file-compressed 17420060 / 17487681 / -0.4% 24365949 / 24391032 / -0.1% 0.71 / 0.72 / -0.3%
tpcds_q84/duckdb:vortex-file-compressed 15732497 / 15474432 / +1.7% 22662297 / 23926919 / -5.3% 0.69 / 0.65 / +7.3%
tpcds_q85/duckdb:vortex-file-compressed 24991403 / 25015558 / -0.1% 38250921 / 36358715 / +5.2% 0.65 / 0.69 / -5.0%
tpcds_q86/duckdb:vortex-file-compressed 9745794 / 9625184 / +1.3% 15768969 / 16115124 / -2.1% 0.62 / 0.60 / +3.5%
tpcds_q87/duckdb:vortex-file-compressed 25857830 / 26050646 / -0.7% 33102800 / 33749194 / -1.9% 0.78 / 0.77 / +1.2%
tpcds_q88/duckdb:vortex-file-compressed 30000764 / 30341066 / -1.1% 40779078 / 40666123 / +0.3% 0.74 / 0.75 / -1.4%
tpcds_q89/duckdb:vortex-file-compressed 11890805 / 11880278 / +0.1% 21972787 / 21020275 / +4.5% 0.54 / 0.57 / -4.3%
tpcds_q90/duckdb:vortex-file-compressed 7841371 / 7873380 / -0.4% 14704414 / 15793821 / -6.9% 0.53 / 0.50 / +7.0%
tpcds_q91/duckdb:vortex-file-compressed 14745042 / 14680431 / +0.4% 23398691 / 23432754 / -0.1% 0.63 / 0.63 / +0.6%
tpcds_q92/duckdb:vortex-file-compressed 10453978 / 10362186 / +0.9% 17757876 / 17798675 / -0.2% 0.59 / 0.58 / +1.1%
tpcds_q93/duckdb:vortex-file-compressed 10150519 / 10321070 / -1.7% 23745126 / 22416155 / +5.9% 0.43 / 0.46 / -7.2%
tpcds_q94/duckdb:vortex-file-compressed 21850609 / 22085020 / -1.1% 32198646 / 31715817 / +1.5% 0.68 / 0.70 / -2.5%
tpcds_q95/duckdb:vortex-file-compressed 60882998 / 60520896 / +0.6% 69554460 / 67458992 / +3.1% 0.88 / 0.90 / -2.4%
tpcds_q96/duckdb:vortex-file-compressed 6695374 / 6497133 / +3.1% 17108684 / 15310655 / +11.7% 🔴 0.39 / 0.42 / -7.8%
tpcds_q97/duckdb:vortex-file-compressed 23300742 / 22917520 / +1.7% 32559240 / 31822045 / +2.3% 0.72 / 0.72 / -0.6%
tpcds_q98/duckdb:vortex-file-compressed 10775416 / 10919490 / -1.3% 19310428 / 19425955 / -0.6% 0.56 / 0.56 / -0.7%
tpcds_q99/duckdb:vortex-file-compressed 14853753 / 14421880 / +3.0% 23075693 / 22012689 / +4.8% 0.64 / 0.66 / -1.7%
duckdb / parquet / ns (0.998x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24016592 / 24093628 / -0.3% 31085789 / 30609636 / +1.6% 0.77 / 0.79 / -1.8%
tpcds_q02/duckdb:parquet 17849289 / 17984803 / -0.8% 23963778 / 24025915 / -0.3% 0.74 / 0.75 / -0.5%
tpcds_q03/duckdb:parquet 9702806 / 9812261 / -1.1% 15561473 / 15610845 / -0.3% 0.62 / 0.63 / -0.8%
tpcds_q04/duckdb:parquet 118323762 / 118053322 / +0.2% 127762638 / 125451786 / +1.8% 0.93 / 0.94 / -1.6%
tpcds_q05/duckdb:parquet 28346089 / 28431532 / -0.3% 33225295 / 33184023 / +0.1% 0.85 / 0.86 / -0.4%
tpcds_q06/duckdb:parquet 27047894 / 26561266 / +1.8% 35785692 / 34919227 / +2.5% 0.76 / 0.76 / -0.6%
tpcds_q07/duckdb:parquet 31426412 / 31458600 / -0.1% 38822572 / 38910397 / -0.2% 0.81 / 0.81 / +0.1%
tpcds_q08/duckdb:parquet 19655338 / 19835614 / -0.9% 26274302 / 26315778 / -0.2% 0.75 / 0.75 / -0.8%
tpcds_q09/duckdb:parquet 26801702 / 27590826 / -2.9% 29225061 / 29561025 / -1.1% 0.92 / 0.93 / -1.7%
tpcds_q10/duckdb:parquet 32368559 / 32550451 / -0.6% 40097558 / 40051128 / +0.1% 0.81 / 0.81 / -0.7%
tpcds_q11/duckdb:parquet 68560995 / 68928280 / -0.5% 74720865 / 76188001 / -1.9% 0.92 / 0.90 / +1.4%
tpcds_q12/duckdb:parquet 13940334 / 13995176 / -0.4% 19122838 / 19053083 / +0.4% 0.73 / 0.73 / -0.8%
tpcds_q13/duckdb:parquet 31612954 / 33308439 / -5.1% 40101979 / 39541391 / +1.4% 0.79 / 0.84 / -6.4%
tpcds_q14/duckdb:parquet 65420967 / 64769091 / +1.0% 67030777 / 68114003 / -1.6% 0.98 / 0.95 / +2.6%
tpcds_q15/duckdb:parquet 16657411 / 16637540 / +0.1% 22638595 / 22243900 / +1.8% 0.74 / 0.75 / -1.6%
tpcds_q16/duckdb:parquet 30145876 / 30104670 / +0.1% 37345525 / 37135181 / +0.6% 0.81 / 0.81 / -0.4%
tpcds_q17/duckdb:parquet 34536322 / 34477460 / +0.2% 40338144 / 40356696 / -0.0% 0.86 / 0.85 / +0.2%
tpcds_q18/duckdb:parquet 47225454 / 47148372 / +0.2% 54473539 / 54249081 / +0.4% 0.87 / 0.87 / -0.2%
tpcds_q19/duckdb:parquet 18631319 / 19018304 / -2.0% 25324946 / 25382414 / -0.2% 0.74 / 0.75 / -1.8%
tpcds_q20/duckdb:parquet 14932614 / 14902117 / +0.2% 19695443 / 19412123 / +1.5% 0.76 / 0.77 / -1.2%
tpcds_q21/duckdb:parquet 10407578 / 10731116 / -3.0% 16705562 / 17030686 / -1.9% 0.62 / 0.63 / -1.1%
tpcds_q22/duckdb:parquet 20799570 / 20507718 / +1.4% 26237300 / 26762155 / -2.0% 0.79 / 0.77 / +3.5%
tpcds_q23/duckdb:parquet 43667574 / 42833082 / +1.9% 50109834 / 49424056 / +1.4% 0.87 / 0.87 / +0.6%
tpcds_q24/duckdb:parquet 30846620 / 29943294 / +3.0% 36844472 / 36464447 / +1.0% 0.84 / 0.82 / +2.0%
tpcds_q25/duckdb:parquet 30359894 / 30514354 / -0.5% 37345909 / 37025273 / +0.9% 0.81 / 0.82 / -1.4%
tpcds_q26/duckdb:parquet 29114710 / 29252328 / -0.5% 35065613 / 35038512 / +0.1% 0.83 / 0.83 / -0.5%
tpcds_q27/duckdb:parquet 34447338 / 34872377 / -1.2% 41045180 / 41229992 / -0.4% 0.84 / 0.85 / -0.8%
tpcds_q28/duckdb:parquet 26862596 / 25185258 / +6.7% 30988816 / 31104212 / -0.4% 0.87 / 0.81 / +7.1%
tpcds_q29/duckdb:parquet 33500930 / 32150195 / +4.2% 39660174 / 38969206 / +1.8% 0.84 / 0.83 / +2.4%
tpcds_q30/duckdb:parquet 35523332 / 35528874 / -0.0% 45084393 / 44172843 / +2.1% 0.79 / 0.80 / -2.0%
tpcds_q31/duckdb:parquet 35956976 / 35529000 / +1.2% 42935984 / 42639874 / +0.7% 0.84 / 0.83 / +0.5%
tpcds_q32/duckdb:parquet 14264308 / 14179243 / +0.6% 20540193 / 21025962 / -2.3% 0.69 / 0.67 / +3.0%
tpcds_q33/duckdb:parquet 23626297 / 23095442 / +2.3% 29261666 / 28549004 / +2.5% 0.81 / 0.81 / -0.2%
tpcds_q34/duckdb:parquet 18976989 / 16952271 / +11.9% 🔴 25407202 / 24176719 / +5.1% 0.75 / 0.70 / +6.5%
tpcds_q35/duckdb:parquet 34913653 / 34975734 / -0.2% 44363004 / 43207543 / +2.7% 0.79 / 0.81 / -2.8%
tpcds_q36/duckdb:parquet 41296502 / 39485050 / +4.6% 47242979 / 47479406 / -0.5% 0.87 / 0.83 / +5.1%
tpcds_q37/duckdb:parquet 12715622 / 12797622 / -0.6% 19428040 / 19277008 / +0.8% 0.65 / 0.66 / -1.4%
tpcds_q38/duckdb:parquet 29993152 / 29621006 / +1.3% 33346605 / 33433489 / -0.3% 0.90 / 0.89 / +1.5%
tpcds_q39/duckdb:parquet 23238790 / 23128167 / +0.5% 29791714 / 29595365 / +0.7% 0.78 / 0.78 / -0.2%
tpcds_q40/duckdb:parquet 15889726 / 16054940 / -1.0% 21216240 / 21235777 / -0.1% 0.75 / 0.76 / -0.9%
tpcds_q41/duckdb:parquet 11988726 / 11966633 / +0.2% 18001811 / 18065700 / -0.4% 0.67 / 0.66 / +0.5%
tpcds_q42/duckdb:parquet 9556674 / 9626178 / -0.7% 15737181 / 15525610 / +1.4% 0.61 / 0.62 / -2.1%
tpcds_q43/duckdb:parquet 11992000 / 12048868 / -0.5% 18227802 / 18128038 / +0.6% 0.66 / 0.66 / -1.0%
tpcds_q44/duckdb:parquet 20979534 / 21607511 / -2.9% 27681367 / 26196804 / +5.7% 0.76 / 0.82 / -8.1%
tpcds_q45/duckdb:parquet 20887464 / 20908743 / -0.1% 27797066 / 27486675 / +1.1% 0.75 / 0.76 / -1.2%
tpcds_q46/duckdb:parquet 36832800 / 35288508 / +4.4% 44346743 / 43320711 / +2.4% 0.83 / 0.81 / +2.0%
tpcds_q47/duckdb:parquet 34324993 / 34531498 / -0.6% 41423264 / 41336316 / +0.2% 0.83 / 0.84 / -0.8%
tpcds_q48/duckdb:parquet 30136286 / 29103170 / +3.5% 36474210 / 36426435 / +0.1% 0.83 / 0.80 / +3.4%
tpcds_q49/duckdb:parquet 31458454 / 30233053 / +4.1% 36190717 / 36303817 / -0.3% 0.87 / 0.83 / +4.4%
tpcds_q50/duckdb:parquet 19468873 / 20388898 / -4.5% 25788652 / 25331399 / +1.8% 0.75 / 0.80 / -6.2%
tpcds_q51/duckdb:parquet 52442370 / 52104356 / +0.6% 59319666 / 61245199 / -3.1% 0.88 / 0.85 / +3.9%
tpcds_q52/duckdb:parquet 9904903 / 9659180 / +2.5% 15854394 / 15499988 / +2.3% 0.62 / 0.62 / +0.3%
tpcds_q53/duckdb:parquet 14289308 / 14537118 / -1.7% 20864830 / 20752143 / +0.5% 0.68 / 0.70 / -2.2%
tpcds_q54/duckdb:parquet 24826580 / 24733616 / +0.4% 31752808 / 31908376 / -0.5% 0.78 / 0.78 / +0.9%
tpcds_q55/duckdb:parquet 9416404 / 9489484 / -0.8% 15350140 / 15341981 / +0.1% 0.61 / 0.62 / -0.8%
tpcds_q56/duckdb:parquet 25987064 / 27141406 / -4.3% 30586529 / 30419221 / +0.6% 0.85 / 0.89 / -4.8%
tpcds_q57/duckdb:parquet 30714972 / 30693180 / +0.1% 36247728 / 36167354 / +0.2% 0.85 / 0.85 / -0.2%
tpcds_q58/duckdb:parquet 23714358 / 23919381 / -0.9% 29837508 / 29814453 / +0.1% 0.79 / 0.80 / -0.9%
tpcds_q59/duckdb:parquet 22582826 / 22867650 / -1.2% 28701018 / 28707391 / -0.0% 0.79 / 0.80 / -1.2%
tpcds_q60/duckdb:parquet 26362238 / 26316208 / +0.2% 32185282 / 31957179 / +0.7% 0.82 / 0.82 / -0.5%
tpcds_q61/duckdb:parquet 25002512 / 24749493 / +1.0% 30081465 / 29026258 / +3.6% 0.83 / 0.85 / -2.5%
tpcds_q62/duckdb:parquet 12773188 / 12721642 / +0.4% 18067957 / 17771445 / +1.7% 0.71 / 0.72 / -1.2%
tpcds_q63/duckdb:parquet 13239282 / 14341675 / -7.7% 19732637 / 20011856 / -1.4% 0.67 / 0.72 / -6.4%
tpcds_q64/duckdb:parquet 70395340 / 70307914 / +0.1% 81452161 / 79575965 / +2.4% 0.86 / 0.88 / -2.2%
tpcds_q65/duckdb:parquet 20182596 / 20569484 / -1.9% 27391329 / 25477560 / +7.5% 0.74 / 0.81 / -8.7%
tpcds_q66/duckdb:parquet 33149293 / 33045765 / +0.3% 38276711 / 38019443 / +0.7% 0.87 / 0.87 / -0.4%
tpcds_q67/duckdb:parquet 61211928 / 61027914 / +0.3% 67318160 / 66818321 / +0.7% 0.91 / 0.91 / -0.4%
tpcds_q68/duckdb:parquet 28184011 / 30834914 / -8.6% 36448208 / 35993030 / +1.3% 0.77 / 0.86 / -9.7%
tpcds_q69/duckdb:parquet 25756686 / 25794512 / -0.1% 34477440 / 33964184 / +1.5% 0.75 / 0.76 / -1.6%
tpcds_q70/duckdb:parquet 19279938 / 19255869 / +0.1% 27026489 / 26582665 / +1.7% 0.71 / 0.72 / -1.5%
tpcds_q71/duckdb:parquet 16748446 / 16803522 / -0.3% 23599031 / 23382022 / +0.9% 0.71 / 0.72 / -1.2%
tpcds_q72/duckdb:parquet 52961144 / 53014220 / -0.1% 59979641 / 59449489 / +0.9% 0.88 / 0.89 / -1.0%
tpcds_q73/duckdb:parquet 14851772 / 15895421 / -6.6% 21838253 / 21585777 / +1.2% 0.68 / 0.74 / -7.6%
tpcds_q74/duckdb:parquet 84161043 / 85004257 / -1.0% 91341894 / 89575448 / +2.0% 0.92 / 0.95 / -2.9%
tpcds_q75/duckdb:parquet 44013751 / 44183878 / -0.4% 50380773 / 49282250 / +2.2% 0.87 / 0.90 / -2.6%
tpcds_q76/duckdb:parquet 19078982 / 18510097 / +3.1% 22912267 / 22802776 / +0.5% 0.83 / 0.81 / +2.6%
tpcds_q77/duckdb:parquet 26279846 / 25530442 / +2.9% 32011829 / 31441226 / +1.8% 0.82 / 0.81 / +1.1%
tpcds_q78/duckdb:parquet 77939148 / 78229121 / -0.4% 84263142 / 85641462 / -1.6% 0.92 / 0.91 / +1.3%
tpcds_q79/duckdb:parquet 22185316 / 24067906 / -7.8% 28772753 / 28358044 / +1.5% 0.77 / 0.85 / -9.2%
tpcds_q80/duckdb:parquet 35497195 / 38479893 / -7.8% 44457577 / 43843592 / +1.4% 0.80 / 0.88 / -9.0%
tpcds_q81/duckdb:parquet 36419206 / 36125748 / +0.8% 45100840 / 44907713 / +0.4% 0.81 / 0.80 / +0.4%
tpcds_q82/duckdb:parquet 13621467 / 13496682 / +0.9% 20527676 / 20103202 / +2.1% 0.66 / 0.67 / -1.2%
tpcds_q83/duckdb:parquet 20154928 / 19941274 / +1.1% 25271611 / 24813592 / +1.8% 0.80 / 0.80 / -0.8%
tpcds_q84/duckdb:parquet 22917616 / 23090262 / -0.7% 28663847 / 28462809 / +0.7% 0.80 / 0.81 / -1.4%
tpcds_q85/duckdb:parquet 32025759 / 32217004 / -0.6% 39302621 / 38985194 / +0.8% 0.81 / 0.83 / -1.4%
tpcds_q86/duckdb:parquet 11805102 / 11811458 / -0.1% 16936147 / 16496302 / +2.7% 0.70 / 0.72 / -2.6%
tpcds_q87/duckdb:parquet 31338874 / 31436775 / -0.3% 35174159 / 35185024 / -0.0% 0.89 / 0.89 / -0.3%
tpcds_q88/duckdb:parquet 38658249 / 38059442 / +1.6% 41816751 / 41928306 / -0.3% 0.92 / 0.91 / +1.8%
tpcds_q89/duckdb:parquet 14105591 / 14206404 / -0.7% 21180368 / 21172421 / +0.0% 0.67 / 0.67 / -0.7%
tpcds_q90/duckdb:parquet 10099561 / 10080660 / +0.2% 14979686 / 15448563 / -3.0% 0.67 / 0.65 / +3.3%
tpcds_q91/duckdb:parquet 21107934 / 21048574 / +0.3% 28644719 / 28220317 / +1.5% 0.74 / 0.75 / -1.2%
tpcds_q92/duckdb:parquet 15598340 / 15572126 / +0.2% 21981150 / 22096515 / -0.5% 0.71 / 0.70 / +0.7%
tpcds_q93/duckdb:parquet 14042930 / 14091483 / -0.3% 20513768 / 20175447 / +1.7% 0.68 / 0.70 / -2.0%
tpcds_q94/duckdb:parquet 25291056 / 25392360 / -0.4% 32744243 / 32388339 / +1.1% 0.77 / 0.78 / -1.5%
tpcds_q95/duckdb:parquet 43904436 / 43748374 / +0.4% 49398295 / 49895274 / -1.0% 0.89 / 0.88 / +1.4%
tpcds_q96/duckdb:parquet 8343656 / 8272491 / +0.9% 13899345 / 13988491 / -0.6% 0.60 / 0.59 / +1.5%
tpcds_q97/duckdb:parquet 27846428 / 27667050 / +0.6% 33916659 / 32852985 / +3.2% 0.82 / 0.84 / -2.5%
tpcds_q98/duckdb:parquet 16477028 / 16378365 / +0.6% 23263689 / 22777602 / +2.1% 0.71 / 0.72 / -1.5%
tpcds_q99/duckdb:parquet 18703402 / 18807829 / -0.6% 24792610 / 24915617 / -0.5% 0.75 / 0.75 / -0.1%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 62adb044 vs base 1cdc8cf9
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (-0.8%, low confidence) · DuckDB No clear signal (-0.3%, low confidence)
Vortex (geomean): hot 0.989x ➖ · cold 0.989x ➖
Parquet (geomean): hot 0.995x ➖ · cold 0.997x ➖
Shifts: Parquet (control) -0.5% · Median polish -0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.987x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1268006 / 1277762 / -0.8% 22937416 / 22701905 / +1.0% 0.06 / 0.06 / -1.8%
clickbench_q01/datafusion:vortex-file-compressed 5698924 / 5701054 / -0.0% 34229586 / 34133473 / +0.3% 0.17 / 0.17 / -0.3%
clickbench_q02/datafusion:vortex-file-compressed 10683033 / 11059978 / -3.4% 46894903 / 45727346 / +2.6% 0.23 / 0.24 / -5.8%
clickbench_q03/datafusion:vortex-file-compressed 12362390 / 12962152 / -4.6% 56929180 / 59966511 / -5.1% 0.22 / 0.22 / +0.5%
clickbench_q04/datafusion:vortex-file-compressed 58811674 / 58491492 / +0.5% 102607935 / 107265399 / -4.3% 0.57 / 0.55 / +5.1%
clickbench_q05/datafusion:vortex-file-compressed 74758182 / 75324188 / -0.8% 127055157 / 127176489 / -0.1% 0.59 / 0.59 / -0.7%
clickbench_q06/datafusion:vortex-file-compressed 1256115 / 1281209 / -2.0% 23523696 / 22762946 / +3.3% 0.05 / 0.06 / -5.1%
clickbench_q07/datafusion:vortex-file-compressed 9139395 / 9121962 / +0.2% 34761875 / 36679638 / -5.2% 0.26 / 0.25 / +5.7%
clickbench_q08/datafusion:vortex-file-compressed 77717202 / 79202689 / -1.9% 122420644 / 130034036 / -5.9% 0.63 / 0.61 / +4.2%
clickbench_q09/datafusion:vortex-file-compressed 167783890 / 169891930 / -1.2% 213852729 / 215849640 / -0.9% 0.78 / 0.79 / -0.3%
clickbench_q10/datafusion:vortex-file-compressed 23054252 / 23576041 / -2.2% 72337875 / 71620517 / +1.0% 0.32 / 0.33 / -3.2%
clickbench_q11/datafusion:vortex-file-compressed 24432106 / 25595211 / -4.5% 72905069 / 73456297 / -0.8% 0.34 / 0.35 / -3.8%
clickbench_q12/datafusion:vortex-file-compressed 71179672 / 72340317 / -1.6% 121780510 / 126525748 / -3.8% 0.58 / 0.57 / +2.2%
clickbench_q13/datafusion:vortex-file-compressed 116740193 / 114454353 / +2.0% 183969647 / 187159194 / -1.7% 0.63 / 0.61 / +3.8%
clickbench_q14/datafusion:vortex-file-compressed 74997504 / 75015054 / -0.0% 127196627 / 128127094 / -0.7% 0.59 / 0.59 / +0.7%
clickbench_q15/datafusion:vortex-file-compressed 63489674 / 63035252 / +0.7% 101735976 / 102527113 / -0.8% 0.62 / 0.61 / +1.5%
clickbench_q16/datafusion:vortex-file-compressed 156295941 / 154339830 / +1.3% 216747520 / 220216995 / -1.6% 0.72 / 0.70 / +2.9%
clickbench_q17/datafusion:vortex-file-compressed 151322974 / 153975190 / -1.7% 218358790 / 221571282 / -1.4% 0.69 / 0.69 / -0.3%
clickbench_q18/datafusion:vortex-file-compressed 295808379 / 297646745 / -0.6% 381722351 / 388335753 / -1.7% 0.77 / 0.77 / +1.1%
clickbench_q19/datafusion:vortex-file-compressed 7402701 / 7750414 / -4.5% 47309683 / 48721099 / -2.9% 0.16 / 0.16 / -1.6%
clickbench_q20/datafusion:vortex-file-compressed 69759362 / 68136855 / +2.4% 249824209 / 256425057 / -2.6% 0.28 / 0.27 / +5.1%
clickbench_q21/datafusion:vortex-file-compressed 79002890 / 80037805 / -1.3% 292265076 / 300737630 / -2.8% 0.27 / 0.27 / +1.6%
clickbench_q22/datafusion:vortex-file-compressed 91924484 / 95054287 / -3.3% 395714514 / 395336147 / +0.1% 0.23 / 0.24 / -3.4%
clickbench_q23/datafusion:vortex-file-compressed 77076347 / 80171206 / -3.9% 404524668 / 416246090 / -2.8% 0.19 / 0.19 / -1.1%
clickbench_q24/datafusion:vortex-file-compressed 8240989 / 8409700 / -2.0% 61143131 / 57093319 / +7.1% 0.13 / 0.15 / -8.5%
clickbench_q25/datafusion:vortex-file-compressed 18417703 / 18152158 / +1.5% 65294122 / 63410099 / +3.0% 0.28 / 0.29 / -1.5%
clickbench_q26/datafusion:vortex-file-compressed 14491984 / 15624998 / -7.3% 66211789 / 69615012 / -4.9% 0.22 / 0.22 / -2.5%
clickbench_q27/datafusion:vortex-file-compressed 97730870 / 100553100 / -2.8% 257290497 / 266070098 / -3.3% 0.38 / 0.38 / +0.5%
clickbench_q28/datafusion:vortex-file-compressed 555436640 / 561882003 / -1.1% 649572783 / 634483917 / +2.4% 0.86 / 0.89 / -3.4%
clickbench_q29/datafusion:vortex-file-compressed 24347795 / 24813306 / -1.9% 57933858 / 53938850 / +7.4% 0.42 / 0.46 / -8.6%
clickbench_q30/datafusion:vortex-file-compressed 56945040 / 54469824 / +4.5% 109199116 / 110322321 / -1.0% 0.52 / 0.49 / +5.6%
clickbench_q31/datafusion:vortex-file-compressed 66144868 / 63713036 / +3.8% 158484291 / 165094546 / -4.0% 0.42 / 0.39 / +8.1%
clickbench_q32/datafusion:vortex-file-compressed 284405453 / 287471359 / -1.1% 385161272 / 395194655 / -2.5% 0.74 / 0.73 / +1.5%
clickbench_q33/datafusion:vortex-file-compressed 319629270 / 318812426 / +0.3% 432492553 / 434359824 / -0.4% 0.74 / 0.73 / +0.7%
clickbench_q34/datafusion:vortex-file-compressed 318113765 / 319825400 / -0.5% 434161683 / 438643717 / -1.0% 0.73 / 0.73 / +0.5%
clickbench_q35/datafusion:vortex-file-compressed 57052128 / 56594294 / +0.8% 94294674 / 89838837 / +5.0% 0.61 / 0.63 / -4.0%
clickbench_q36/datafusion:vortex-file-compressed 37496258 / 37371240 / +0.3% 67153293 / 69504069 / -3.4% 0.56 / 0.54 / +3.8%
clickbench_q37/datafusion:vortex-file-compressed 20546634 / 20731798 / -0.9% 49019736 / 48713358 / +0.6% 0.42 / 0.43 / -1.5%
clickbench_q38/datafusion:vortex-file-compressed 10826891 / 12866674 / -15.9% 🟢 40542921 / 41261053 / -1.7% 0.27 / 0.31 / -14.4%
clickbench_q39/datafusion:vortex-file-compressed 78720164 / 78717482 / +0.0% 110785665 / 110822448 / -0.0% 0.71 / 0.71 / +0.0%
clickbench_q40/datafusion:vortex-file-compressed 10081499 / 10368860 / -2.8% 36758552 / 36576948 / +0.5% 0.27 / 0.28 / -3.3%
clickbench_q41/datafusion:vortex-file-compressed 9689400 / 9655634 / +0.3% 35770090 / 35212183 / +1.6% 0.27 / 0.27 / -1.2%
clickbench_q42/datafusion:vortex-file-compressed 9684003 / 9562990 / +1.3% 36250672 / 37134881 / -2.4% 0.27 / 0.26 / +3.7%
datafusion / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1246703 / 1245508 / +0.1% 49372700 / 49111389 / +0.5% 0.03 / 0.03 / -0.4%
clickbench_q01/datafusion:parquet 15957274 / 16128558 / -1.1% 66859145 / 65974016 / +1.3% 0.24 / 0.24 / -2.4%
clickbench_q02/datafusion:parquet 18562791 / 18679866 / -0.6% 80437521 / 81045048 / -0.7% 0.23 / 0.23 / +0.1%
clickbench_q03/datafusion:parquet 17254040 / 17636144 / -2.2% 81064347 / 78906984 / +2.7% 0.21 / 0.22 / -4.8%
clickbench_q04/datafusion:parquet 64931799 / 63147200 / +2.8% 127240806 / 123651426 / +2.9% 0.51 / 0.51 / -0.1%
clickbench_q05/datafusion:parquet 88423399 / 89173734 / -0.8% 158323302 / 155684349 / +1.7% 0.56 / 0.57 / -2.5%
clickbench_q06/datafusion:parquet 1280750 / 1267736 / +1.0% 49844938 / 49808656 / +0.1% 0.03 / 0.03 / +1.0%
clickbench_q07/datafusion:parquet 16828668 / 16815682 / +0.1% 67918768 / 68530680 / -0.9% 0.25 / 0.25 / +1.0%
clickbench_q08/datafusion:parquet 86153654 / 84420552 / +2.1% 166545816 / 159615748 / +4.3% 0.52 / 0.53 / -2.2%
clickbench_q09/datafusion:parquet 185892754 / 189340200 / -1.8% 269222460 / 270568486 / -0.5% 0.69 / 0.70 / -1.3%
clickbench_q10/datafusion:parquet 36681164 / 35838825 / +2.4% 102395315 / 101351871 / +1.0% 0.36 / 0.35 / +1.3%
clickbench_q11/datafusion:parquet 42987810 / 43388606 / -0.9% 111627843 / 110234963 / +1.3% 0.39 / 0.39 / -2.2%
clickbench_q12/datafusion:parquet 94361563 / 96400254 / -2.1% 159548756 / 164380304 / -2.9% 0.59 / 0.59 / +0.8%
clickbench_q13/datafusion:parquet 149220726 / 149050407 / +0.1% 230587594 / 229020286 / +0.7% 0.65 / 0.65 / -0.6%
clickbench_q14/datafusion:parquet 100350960 / 101751008 / -1.4% 171279883 / 173752765 / -1.4% 0.59 / 0.59 / +0.0%
clickbench_q15/datafusion:parquet 72362292 / 74751018 / -3.2% 131458855 / 132562825 / -0.8% 0.55 / 0.56 / -2.4%
clickbench_q16/datafusion:parquet 155380277 / 157130106 / -1.1% 237301329 / 235404102 / +0.8% 0.65 / 0.67 / -1.9%
clickbench_q17/datafusion:parquet 156437995 / 158408130 / -1.2% 235775662 / 232535206 / +1.4% 0.66 / 0.68 / -2.6%
clickbench_q18/datafusion:parquet 307602696 / 311659828 / -1.3% 417697380 / 428769037 / -2.6% 0.74 / 0.73 / +1.3%
clickbench_q19/datafusion:parquet 19254948 / 18808941 / +2.4% 77935122 / 76943382 / +1.3% 0.25 / 0.24 / +1.1%
clickbench_q20/datafusion:parquet 178908616 / 178190524 / +0.4% 282925641 / 283067790 / -0.1% 0.63 / 0.63 / +0.5%
clickbench_q21/datafusion:parquet 173180644 / 174542982 / -0.8% 299053821 / 303338278 / -1.4% 0.58 / 0.58 / +0.6%
clickbench_q22/datafusion:parquet 259495634 / 260781561 / -0.5% 424414741 / 433914101 / -2.2% 0.61 / 0.60 / +1.7%
clickbench_q23/datafusion:parquet 1007969362 / 1007396844 / +0.1% 1187920010 / 1196675958 / -0.7% 0.85 / 0.84 / +0.8%
clickbench_q24/datafusion:parquet 29826922 / 30726530 / -2.9% 89536908 / 88445505 / +1.2% 0.33 / 0.35 / -4.1%
clickbench_q25/datafusion:parquet 36435490 / 37097776 / -1.8% 103489908 / 103458997 / +0.0% 0.35 / 0.36 / -1.8%
clickbench_q26/datafusion:parquet 30226059 / 30667637 / -1.4% 89721848 / 89958756 / -0.3% 0.34 / 0.34 / -1.2%
clickbench_q27/datafusion:parquet 193320817 / 193541858 / -0.1% 295333234 / 294014301 / +0.4% 0.65 / 0.66 / -0.6%
clickbench_q28/datafusion:parquet 619139722 / 622381386 / -0.5% 707007302 / 709605194 / -0.4% 0.88 / 0.88 / -0.2%
clickbench_q29/datafusion:parquet 28644508 / 28382270 / +0.9% 90927314 / 89726118 / +1.3% 0.32 / 0.32 / -0.4%
clickbench_q30/datafusion:parquet 89450875 / 90292652 / -0.9% 173244649 / 173921114 / -0.4% 0.52 / 0.52 / -0.5%
clickbench_q31/datafusion:parquet 102651671 / 103509501 / -0.8% 199118499 / 200971596 / -0.9% 0.52 / 0.52 / +0.1%
clickbench_q32/datafusion:parquet 302950399 / 311115870 / -2.6% 429697937 / 428727602 / +0.2% 0.71 / 0.73 / -2.8%
clickbench_q33/datafusion:parquet 377544924 / 380048496 / -0.7% 476995236 / 479600127 / -0.5% 0.79 / 0.79 / -0.1%
clickbench_q34/datafusion:parquet 375085586 / 378557524 / -0.9% 476020372 / 477936899 / -0.4% 0.79 / 0.79 / -0.5%
clickbench_q35/datafusion:parquet 65472816 / 64249088 / +1.9% 123458876 / 123443405 / +0.0% 0.53 / 0.52 / +1.9%
clickbench_q36/datafusion:parquet 73348254 / 73977852 / -0.9% 136744628 / 136178878 / +0.4% 0.54 / 0.54 / -1.3%
clickbench_q37/datafusion:parquet 35766634 / 35633496 / +0.4% 91967927 / 91419997 / +0.6% 0.39 / 0.39 / -0.2%
clickbench_q38/datafusion:parquet 47776608 / 47903072 / -0.3% 107563031 / 108411604 / -0.8% 0.44 / 0.44 / +0.5%
clickbench_q39/datafusion:parquet 145115412 / 144526362 / +0.4% 209285921 / 212015185 / -1.3% 0.69 / 0.68 / +1.7%
clickbench_q40/datafusion:parquet 19939320 / 20349552 / -2.0% 77086386 / 77770096 / -0.9% 0.26 / 0.26 / -1.1%
clickbench_q41/datafusion:parquet 18901254 / 18824178 / +0.4% 76586259 / 74972994 / +2.2% 0.25 / 0.25 / -1.7%
clickbench_q42/datafusion:parquet 18930082 / 19068224 / -0.7% 75338954 / 75207188 / +0.2% 0.25 / 0.25 / -0.9%
duckdb / vortex-file-compressed / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2159215 / 2239520 / -3.6% 25807174 / 25410828 / +1.6% 0.08 / 0.09 / -5.1%
clickbench_q01/duckdb:vortex-file-compressed 7336692 / 7612362 / -3.6% 26887298 / 27570446 / -2.5% 0.27 / 0.28 / -1.2%
clickbench_q02/duckdb:vortex-file-compressed 9343110 / 8955066 / +4.3% 37128430 / 35286118 / +5.2% 0.25 / 0.25 / -0.8%
clickbench_q03/duckdb:vortex-file-compressed 14048370 / 14248936 / -1.4% 52707746 / 52216942 / +0.9% 0.27 / 0.27 / -2.3%
clickbench_q04/duckdb:vortex-file-compressed 56481843 / 58104275 / -2.8% 89993942 / 92470080 / -2.7% 0.63 / 0.63 / -0.1%
clickbench_q05/duckdb:vortex-file-compressed 63825908 / 64657906 / -1.3% 94259855 / 95177701 / -1.0% 0.68 / 0.68 / -0.3%
clickbench_q06/duckdb:vortex-file-compressed 2650230 / 2703474 / -2.0% 31152104 / 31007170 / +0.5% 0.09 / 0.09 / -2.4%
clickbench_q07/duckdb:vortex-file-compressed 9329989 / 9579114 / -2.6% 27430942 / 31815161 / -13.8% 🟢 0.34 / 0.30 / +13.0%
clickbench_q08/duckdb:vortex-file-compressed 69673381 / 69709164 / -0.1% 104216756 / 106513332 / -2.2% 0.67 / 0.65 / +2.2%
clickbench_q09/duckdb:vortex-file-compressed 95058213 / 91790526 / +3.6% 131603327 / 128038059 / +2.8% 0.72 / 0.72 / +0.8%
clickbench_q10/duckdb:vortex-file-compressed 27213252 / 27449552 / -0.9% 71393167 / 70633742 / +1.1% 0.38 / 0.39 / -1.9%
clickbench_q11/duckdb:vortex-file-compressed 29364421 / 29742802 / -1.3% 68304395 / 74580099 / -8.4% 0.43 / 0.40 / +7.8%
clickbench_q12/duckdb:vortex-file-compressed 69151864 / 68314645 / +1.2% 98933723 / 101588585 / -2.6% 0.70 / 0.67 / +3.9%
clickbench_q13/duckdb:vortex-file-compressed 119401942 / 117681350 / +1.5% 162219136 / 167304335 / -3.0% 0.74 / 0.70 / +4.6%
clickbench_q14/duckdb:vortex-file-compressed 71795898 / 71707574 / +0.1% 102474371 / 104097981 / -1.6% 0.70 / 0.69 / +1.7%
clickbench_q15/duckdb:vortex-file-compressed 76678479 / 76256368 / +0.6% 109465842 / 109430960 / +0.0% 0.70 / 0.70 / +0.5%
clickbench_q16/duckdb:vortex-file-compressed 135649001 / 136865666 / -0.9% 174433264 / 173157180 / +0.7% 0.78 / 0.79 / -1.6%
clickbench_q17/duckdb:vortex-file-compressed 136097815 / 136309250 / -0.2% 169745412 / 167679771 / +1.2% 0.80 / 0.81 / -1.4%
clickbench_q18/duckdb:vortex-file-compressed 256678528 / 253680418 / +1.2% 302163855 / 304490936 / -0.8% 0.85 / 0.83 / +2.0%
clickbench_q19/duckdb:vortex-file-compressed 8945878 / 9195282 / -2.7% 37714311 / 41073291 / -8.2% 0.24 / 0.22 / +6.0%
clickbench_q20/duckdb:vortex-file-compressed 67129349 / 68396690 / -1.9% 167850568 / 175446093 / -4.3% 0.40 / 0.39 / +2.6%
clickbench_q21/duckdb:vortex-file-compressed 78888077 / 78139710 / +1.0% 194042134 / 193510866 / +0.3% 0.41 / 0.40 / +0.7%
clickbench_q22/duckdb:vortex-file-compressed 132962840 / 130674448 / +1.8% 337643185 / 331574805 / +1.8% 0.39 / 0.39 / -0.1%
clickbench_q23/duckdb:vortex-file-compressed 62225867 / 59653655 / +4.3% 182853974 / 184899542 / -1.1% 0.34 / 0.32 / +5.5%
clickbench_q24/duckdb:vortex-file-compressed 16411516 / 17394194 / -5.6% 44832524 / 48703041 / -7.9% 0.37 / 0.36 / +2.5%
clickbench_q25/duckdb:vortex-file-compressed 18281547 / 18446944 / -0.9% 54856089 / 54178597 / +1.3% 0.33 / 0.34 / -2.1%
clickbench_q26/duckdb:vortex-file-compressed 14336201 / 14287748 / +0.3% 40711637 / 49047912 / -17.0% 🟢 0.35 / 0.29 / +20.9%
clickbench_q27/duckdb:vortex-file-compressed 54326815 / 53905176 / +0.8% 173756320 / 177354906 / -2.0% 0.31 / 0.30 / +2.9%
clickbench_q28/duckdb:vortex-file-compressed 507919690 / 514093187 / -1.2% 559858021 / 559504615 / +0.1% 0.91 / 0.92 / -1.3%
clickbench_q29/duckdb:vortex-file-compressed 17046650 / 17208508 / -0.9% 44727818 / 42958313 / +4.1% 0.38 / 0.40 / -4.9%
clickbench_q30/duckdb:vortex-file-compressed 59832930 / 59435691 / +0.7% 111312026 / 108956696 / +2.2% 0.54 / 0.55 / -1.5%
clickbench_q31/duckdb:vortex-file-compressed 109059580 / 109401092 / -0.3% 178280732 / 174239306 / +2.3% 0.61 / 0.63 / -2.6%
clickbench_q32/duckdb:vortex-file-compressed 358727668 / 385910546 / -7.0% 390153914 / 410231765 / -4.9% 0.92 / 0.94 / -2.3%
clickbench_q33/duckdb:vortex-file-compressed 343083618 / 342599656 / +0.1% 402634263 / 396100171 / +1.6% 0.85 / 0.86 / -1.5%
clickbench_q34/duckdb:vortex-file-compressed 358013933 / 353396204 / +1.3% 423102128 / 412222797 / +2.6% 0.85 / 0.86 / -1.3%
clickbench_q35/duckdb:vortex-file-compressed 56751690 / 57161666 / -0.7% 86829412 / 88929172 / -2.4% 0.65 / 0.64 / +1.7%
clickbench_q36/duckdb:vortex-file-compressed 10782518 / 11640787 / -7.4% 32945822 / 33117280 / -0.5% 0.33 / 0.35 / -6.9%
clickbench_q37/duckdb:vortex-file-compressed 7617718 / 7579217 / +0.5% 29540549 / 29023829 / +1.8% 0.26 / 0.26 / -1.3%
clickbench_q38/duckdb:vortex-file-compressed 7883667 / 8249762 / -4.4% 29215546 / 27872473 / +4.8% 0.27 / 0.30 / -8.8%
clickbench_q39/duckdb:vortex-file-compressed 18328636 / 18512246 / -1.0% 40388267 / 39648155 / +1.9% 0.45 / 0.47 / -2.8%
clickbench_q40/duckdb:vortex-file-compressed 6784752 / 6788686 / -0.1% 29053906 / 29122522 / -0.2% 0.23 / 0.23 / +0.2%
clickbench_q41/duckdb:vortex-file-compressed 7825279 / 7935220 / -1.4% 27648887 / 31671742 / -12.7% 🟢 0.28 / 0.25 / +13.0%
clickbench_q42/duckdb:vortex-file-compressed 6996766 / 7022668 / -0.4% 29148856 / 27458837 / +6.2% 0.24 / 0.26 / -6.1%
duckdb / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9296768 / 9394832 / -1.0% 15074225 / 14721122 / +2.4% 0.62 / 0.64 / -3.4%
clickbench_q01/duckdb:parquet 15269532 / 15255306 / +0.1% 20489853 / 20612271 / -0.6% 0.75 / 0.74 / +0.7%
clickbench_q02/duckdb:parquet 21686293 / 23202924 / -6.5% 32649409 / 34409503 / -5.1% 0.66 / 0.67 / -1.5%
clickbench_q03/duckdb:parquet 22981418 / 22805660 / +0.8% 37702966 / 37416814 / +0.8% 0.61 / 0.61 / +0.0%
clickbench_q04/duckdb:parquet 60985124 / 62729622 / -2.8% 71988384 / 74237821 / -3.0% 0.85 / 0.84 / +0.3%
clickbench_q05/duckdb:parquet 82905000 / 82553121 / +0.4% 97781883 / 95555827 / +2.3% 0.85 / 0.86 / -1.9%
clickbench_q06/duckdb:parquet 20401064 / 20223452 / +0.9% 29341891 / 27478087 / +6.8% 0.70 / 0.74 / -5.5%
clickbench_q07/duckdb:parquet 17926732 / 17993160 / -0.4% 22580054 / 22337709 / +1.1% 0.79 / 0.81 / -1.4%
clickbench_q08/duckdb:parquet 74823980 / 75074766 / -0.3% 88724151 / 93024452 / -4.6% 0.84 / 0.81 / +4.5%
clickbench_q09/duckdb:parquet 102722772 / 103794619 / -1.0% 122455070 / 121917219 / +0.4% 0.84 / 0.85 / -1.5%
clickbench_q10/duckdb:parquet 41881068 / 41383818 / +1.2% 54988051 / 53619651 / +2.6% 0.76 / 0.77 / -1.3%
clickbench_q11/duckdb:parquet 46028512 / 46643339 / -1.3% 62116619 / 61615297 / +0.8% 0.74 / 0.76 / -2.1%
clickbench_q12/duckdb:parquet 93779146 / 93595602 / +0.2% 106956660 / 108115697 / -1.1% 0.88 / 0.87 / +1.3%
clickbench_q13/duckdb:parquet 150166382 / 148244281 / +1.3% 168886859 / 168231324 / +0.4% 0.89 / 0.88 / +0.9%
clickbench_q14/duckdb:parquet 100945392 / 101682435 / -0.7% 113165575 / 114164311 / -0.9% 0.89 / 0.89 / +0.2%
clickbench_q15/duckdb:parquet 86983008 / 85946628 / +1.2% 102670018 / 100644448 / +2.0% 0.85 / 0.85 / -0.8%
clickbench_q16/duckdb:parquet 163646340 / 165498386 / -1.1% 174878122 / 179975882 / -2.8% 0.94 / 0.92 / +1.8%
clickbench_q17/duckdb:parquet 163747212 / 171531960 / -4.5% 179077502 / 178665714 / +0.2% 0.91 / 0.96 / -4.8%
clickbench_q18/duckdb:parquet 288707528 / 291016272 / -0.8% 313727102 / 315607081 / -0.6% 0.92 / 0.92 / -0.2%
clickbench_q19/duckdb:parquet 19492302 / 19859715 / -1.9% 27015058 / 25786255 / +4.8% 0.72 / 0.77 / -6.3%
clickbench_q20/duckdb:parquet 191689010 / 180420120 / +6.2% 230705327 / 232480084 / -0.8% 0.83 / 0.78 / +7.1%
clickbench_q21/duckdb:parquet 216671544 / 218477350 / -0.8% 264479809 / 262983512 / +0.6% 0.82 / 0.83 / -1.4%
clickbench_q22/duckdb:parquet 308955264 / 304926990 / +1.3% 359286891 / 357379579 / +0.5% 0.86 / 0.85 / +0.8%
clickbench_q23/duckdb:parquet 171604981 / 171775762 / -0.1% 236942107 / 253121056 / -6.4% 0.72 / 0.68 / +6.7%
clickbench_q24/duckdb:parquet 29669559 / 29958716 / -1.0% 42627629 / 42482462 / +0.3% 0.70 / 0.71 / -1.3%
clickbench_q25/duckdb:parquet 41729907 / 42463750 / -1.7% 59474887 / 60982131 / -2.5% 0.70 / 0.70 / +0.8%
clickbench_q26/duckdb:parquet 30407046 / 32739711 / -7.1% 48272029 / 47017556 / +2.7% 0.63 / 0.70 / -9.5%
clickbench_q27/duckdb:parquet 189675009 / 191541398 / -1.0% 223405934 / 230295986 / -3.0% 0.85 / 0.83 / +2.1%
clickbench_q28/duckdb:parquet 972330838 / 950006560 / +2.3% 956738983 / 983079731 / -2.7% 1.02 / 0.97 / +5.2%
clickbench_q29/duckdb:parquet 24096596 / 24317362 / -0.9% 30884374 / 30925214 / -0.1% 0.78 / 0.79 / -0.8%
clickbench_q30/duckdb:parquet 105748487 / 104622488 / +1.1% 125892032 / 129419189 / -2.7% 0.84 / 0.81 / +3.9%
clickbench_q31/duckdb:parquet 157094882 / 160480217 / -2.1% 173147809 / 174417616 / -0.7% 0.91 / 0.92 / -1.4%
clickbench_q32/duckdb:parquet 379926770 / 385925739 / -1.6% 405654385 / 407659843 / -0.5% 0.94 / 0.95 / -1.1%
clickbench_q33/duckdb:parquet 482468216 / 468922366 / +2.9% 443020493 / 442695781 / +0.1% 1.09 / 1.06 / +2.8%
clickbench_q34/duckdb:parquet 461584332 / 462238432 / -0.1% 457002879 / 447629696 / +2.1% 1.01 / 1.03 / -2.2%
clickbench_q35/duckdb:parquet 60820626 / 61543474 / -1.2% 72197115 / 77479685 / -6.8% 0.84 / 0.79 / +6.1%
clickbench_q36/duckdb:parquet 29725354 / 30172014 / -1.5% 35790268 / 36925558 / -3.1% 0.83 / 0.82 / +1.6%
clickbench_q37/duckdb:parquet 23234190 / 23204022 / +0.1% 29339703 / 30425350 / -3.6% 0.79 / 0.76 / +3.8%
clickbench_q38/duckdb:parquet 23606755 / 23431136 / +0.7% 29939260 / 30912378 / -3.1% 0.79 / 0.76 / +4.0%
clickbench_q39/duckdb:parquet 53167626 / 52956229 / +0.4% 59599178 / 60047399 / -0.7% 0.89 / 0.88 / +1.2%
clickbench_q40/duckdb:parquet 14695754 / 14924840 / -1.5% 20142576 / 20066747 / +0.4% 0.73 / 0.74 / -1.9%
clickbench_q41/duckdb:parquet 15714480 / 15331596 / +2.5% 20817150 / 23069987 / -9.8% 0.75 / 0.66 / +13.6%
clickbench_q42/duckdb:parquet 13944858 / 14130908 / -1.3% 20361824 / 20120985 / +1.2% 0.68 / 0.70 / -2.5%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 62adb044 vs base ab5a0046
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (+5.4%, environment too noisy confidence) · DuckDB No clear signal (-5.9%, environment too noisy confidence)
Vortex (geomean): hot 1.050x ➖ · cold 1.053x ➖
Parquet (geomean): hot 1.055x ➖ · cold 1.101x ➖
Shifts: Parquet (control) +5.5% · Median polish +5.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.077x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 217648674 / 213717821 / +1.8% 908751355 / 764398977 / +18.9% 0.24 / 0.28 / -14.3%
tpch_q02/datafusion:vortex-file-compressed 344324715 / 320984758 / +7.3% 699111143 / 553448858 / +26.3% 0.49 / 0.58 / -15.1%
tpch_q03/datafusion:vortex-file-compressed 460773532 / 310450262 / +48.4% 🔴 867112790 / 854530904 / +1.5% 0.53 / 0.36 / +46.3%
tpch_q04/datafusion:vortex-file-compressed 161141249 / 159007585 / +1.3% 365301586 / 372572808 / -2.0% 0.44 / 0.43 / +3.4%
tpch_q05/datafusion:vortex-file-compressed 358814815 / 344078558 / +4.3% 599201838 / 546047746 / +9.7% 0.60 / 0.63 / -5.0%
tpch_q06/datafusion:vortex-file-compressed 158242690 / 123668516 / +28.0% 309151971 / 317073449 / -2.5% 0.51 / 0.39 / +31.2%
tpch_q07/datafusion:vortex-file-compressed 441715275 / 426177142 / +3.6% 590432227 / 586012416 / +0.8% 0.75 / 0.73 / +2.9%
tpch_q08/datafusion:vortex-file-compressed 444937282 / 410714646 / +8.3% 572861421 / 541459260 / +5.8% 0.78 / 0.76 / +2.4%
tpch_q09/datafusion:vortex-file-compressed 310187535 / 301899395 / +2.7% 527623043 / 455403137 / +15.9% 0.59 / 0.66 / -11.3%
tpch_q10/datafusion:vortex-file-compressed 384958573 / 361036359 / +6.6% 630366921 / 525406226 / +20.0% 0.61 / 0.69 / -11.1%
tpch_q11/datafusion:vortex-file-compressed 290082171 / 272228443 / +6.6% 507599339 / 382260665 / +32.8% 🔴 0.57 / 0.71 / -19.8%
tpch_q12/datafusion:vortex-file-compressed 235850731 / 203460731 / +15.9% 357919493 / 338106908 / +5.9% 0.66 / 0.60 / +9.5%
tpch_q13/datafusion:vortex-file-compressed 105232848 / 116217877 / -9.5% 358266348 / 309114444 / +15.9% 0.29 / 0.38 / -21.9%
tpch_q14/datafusion:vortex-file-compressed 195348994 / 181074526 / +7.9% 378443498 / 354128334 / +6.9% 0.52 / 0.51 / +1.0%
tpch_q15/datafusion:vortex-file-compressed 301650249 / 306125584 / -1.5% 502267295 / 727209626 / -30.9% 🟢 0.60 / 0.42 / +42.7%
tpch_q16/datafusion:vortex-file-compressed 143923079 / 134848492 / +6.7% 325036418 / 285978767 / +13.7% 0.44 / 0.47 / -6.1%
tpch_q17/datafusion:vortex-file-compressed 258261728 / 252865916 / +2.1% 435903997 / 494400127 / -11.8% 0.59 / 0.51 / +15.8%
tpch_q18/datafusion:vortex-file-compressed 233791215 / 222278514 / +5.2% 481074897 / 389005809 / +23.7% 0.49 / 0.57 / -15.0%
tpch_q19/datafusion:vortex-file-compressed 219063892 / 226209017 / -3.2% 421963941 / 296515885 / +42.3% 🔴 0.52 / 0.76 / -31.9%
tpch_q20/datafusion:vortex-file-compressed 293836769 / 248686849 / +18.2% 444957293 / 477297666 / -6.8% 0.66 / 0.52 / +26.7%
tpch_q21/datafusion:vortex-file-compressed 408393246 / 384422617 / +6.2% 638944355 / 739838656 / -13.6% 0.64 / 0.52 / +23.0%
tpch_q22/datafusion:vortex-file-compressed 167237469 / 147475449 / +13.4% 380915730 / 337385924 / +12.9% 0.44 / 0.44 / +0.4%
datafusion / parquet / ns (1.021x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 151562320 / 143033960 / +6.0% 512021202 / 425422516 / +20.4% 0.30 / 0.34 / -12.0%
tpch_q02/datafusion:parquet 282800806 / 274389077 / +3.1% 479989356 / 421418541 / +13.9% 0.59 / 0.65 / -9.5%
tpch_q03/datafusion:parquet 236324226 / 240153039 / -1.6% 644537501 / 656104536 / -1.8% 0.37 / 0.37 / +0.2%
tpch_q04/datafusion:parquet 129417204 / 129091170 / +0.3% 285840834 / 262434371 / +8.9% 0.45 / 0.49 / -8.0%
tpch_q05/datafusion:parquet 337059619 / 325560808 / +3.5% 485174431 / 708712744 / -31.5% 🟢 0.69 / 0.46 / +51.2%
tpch_q06/datafusion:parquet 127710171 / 104623731 / +22.1% 238290887 / 202039421 / +17.9% 0.54 / 0.52 / +3.5%
tpch_q07/datafusion:parquet 334303441 / 326115720 / +2.5% 450691798 / 439408571 / +2.6% 0.74 / 0.74 / -0.1%
tpch_q08/datafusion:parquet 390959906 / 383031456 / +2.1% 537545884 / 487777150 / +10.2% 0.73 / 0.79 / -7.4%
tpch_q09/datafusion:parquet 401659130 / 507741508 / -20.9% 547926008 / 948722124 / -42.2% 🟢 0.73 / 0.54 / +37.0%
tpch_q10/datafusion:parquet 301672994 / 318225993 / -5.2% 440643659 / 431490793 / +2.1% 0.68 / 0.74 / -7.2%
tpch_q11/datafusion:parquet 257394191 / 245309101 / +4.9% 388805646 / 324804219 / +19.7% 0.66 / 0.76 / -12.3%
tpch_q12/datafusion:parquet 162256734 / 160703746 / +1.0% 327250126 / 262477140 / +24.7% 0.50 / 0.61 / -19.0%
tpch_q13/datafusion:parquet 275283737 / 274764633 / +0.2% 445725159 / 387802001 / +14.9% 0.62 / 0.71 / -12.8%
tpch_q14/datafusion:parquet 149487307 / 141590102 / +5.6% 263518120 / 264823133 / -0.5% 0.57 / 0.53 / +6.1%
tpch_q15/datafusion:parquet 302276194 / 297935495 / +1.5% 564640124 / 444599102 / +27.0% 0.54 / 0.67 / -20.1%
tpch_q16/datafusion:parquet 100692639 / 96864793 / +4.0% 207510935 / 207092637 / +0.2% 0.49 / 0.47 / +3.7%
tpch_q17/datafusion:parquet 264561762 / 268630342 / -1.5% 459224751 / 416939497 / +10.1% 0.58 / 0.64 / -10.6%
tpch_q18/datafusion:parquet 313433253 / 305302634 / +2.7% 463314505 / 465639400 / -0.5% 0.68 / 0.66 / +3.2%
tpch_q19/datafusion:parquet 151742568 / 149310744 / +1.6% 300792568 / 274137368 / +9.7% 0.50 / 0.54 / -7.4%
tpch_q20/datafusion:parquet 242292126 / 228071243 / +6.2% 373496856 / 424446687 / -12.0% 0.65 / 0.54 / +20.7%
tpch_q21/datafusion:parquet 314640962 / 291483866 / +7.9% 512379586 / 469762099 / +9.1% 0.61 / 0.62 / -1.0%
tpch_q22/datafusion:parquet 154272336 / 145366900 / +6.1% 318783006 / 299750221 / +6.3% 0.48 / 0.48 / -0.2%
duckdb / vortex-file-compressed / ns (1.025x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 266487331 / 237695207 / +12.1% 297423151 / 298096331 / -0.2% 0.90 / 0.80 / +12.4%
tpch_q02/duckdb:vortex-file-compressed 410147135 / 394665672 / +3.9% 512183635 / 474795024 / +7.9% 0.80 / 0.83 / -3.7%
tpch_q03/duckdb:vortex-file-compressed 402404535 / 398939371 / +0.9% 474341637 / 460688509 / +3.0% 0.85 / 0.87 / -2.0%
tpch_q04/duckdb:vortex-file-compressed 298991373 / 255227345 / +17.1% 331367774 / 296337544 / +11.8% 0.90 / 0.86 / +4.8%
tpch_q05/duckdb:vortex-file-compressed 593384701 / 709957932 / -16.4% 623247231 / 785337665 / -20.6% 0.95 / 0.90 / +5.3%
tpch_q06/duckdb:vortex-file-compressed 170337905 / 148777224 / +14.5% 298427857 / 208058114 / +43.4% 🔴 0.57 / 0.72 / -20.2%
tpch_q07/duckdb:vortex-file-compressed 430914321 / 387859027 / +11.1% 453761551 / 510621725 / -11.1% 0.95 / 0.76 / +25.0%
tpch_q08/duckdb:vortex-file-compressed 686407438 / 617848086 / +11.1% 1149863305 / 732855328 / +56.9% 🔴 0.60 / 0.84 / -29.2%
tpch_q09/duckdb:vortex-file-compressed 662965964 / 392528875 / +68.9% 🔴 614211920 / 482201706 / +27.4% 1.08 / 0.81 / +32.6%
tpch_q10/duckdb:vortex-file-compressed 559447144 / 526138612 / +6.3% 658075842 / 576801469 / +14.1% 0.85 / 0.91 / -6.8%
tpch_q11/duckdb:vortex-file-compressed 294315308 / 288496302 / +2.0% 284831742 / 270775100 / +5.2% 1.03 / 1.07 / -3.0%
tpch_q12/duckdb:vortex-file-compressed 231533317 / 271105721 / -14.6% 296048905 / 407392913 / -27.3% 0.78 / 0.67 / +17.5%
tpch_q13/duckdb:vortex-file-compressed 246884221 / 247871881 / -0.4% 260777488 / 208806747 / +24.9% 0.95 / 1.19 / -20.2%
tpch_q14/duckdb:vortex-file-compressed 233511490 / 224785869 / +3.9% 344597459 / 273953898 / +25.8% 0.68 / 0.82 / -17.4%
tpch_q15/duckdb:vortex-file-compressed 235298033 / 237917836 / -1.1% 285405321 / 453417020 / -37.1% 🟢 0.82 / 0.52 / +57.1%
tpch_q16/duckdb:vortex-file-compressed 217546438 / 206543544 / +5.3% 249426789 / 287344280 / -13.2% 0.87 / 0.72 / +21.3%
tpch_q17/duckdb:vortex-file-compressed 341992843 / 454602893 / -24.8% 401922179 / 443734007 / -9.4% 0.85 / 1.02 / -16.9%
tpch_q18/duckdb:vortex-file-compressed 358451041 / 339736454 / +5.5% 473833969 / 418339259 / +13.3% 0.76 / 0.81 / -6.8%
tpch_q19/duckdb:vortex-file-compressed 290405782 / 320978677 / -9.5% 330862279 / 349847295 / -5.4% 0.88 / 0.92 / -4.3%
tpch_q20/duckdb:vortex-file-compressed 322764912 / 334782469 / -3.6% 431009223 / 412936083 / +4.4% 0.75 / 0.81 / -7.6%
tpch_q21/duckdb:vortex-file-compressed 542668981 / 558602915 / -2.9% 656804078 / 630439819 / +4.2% 0.83 / 0.89 / -6.8%
tpch_q22/duckdb:vortex-file-compressed 235091422 / 253794094 / -7.4% 283887880 / 269551763 / +5.3% 0.83 / 0.94 / -12.0%
duckdb / parquet / ns (1.089x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 182493001 / 178327142 / +2.3% 219633721 / 188180852 / +16.7% 0.83 / 0.95 / -12.3%
tpch_q02/duckdb:parquet 473570845 / 428571834 / +10.5% 563840898 / 421258354 / +33.8% 🔴 0.84 / 1.02 / -17.4%
tpch_q03/duckdb:parquet 536852010 / 384797319 / +39.5% 🔴 697016639 / 402689855 / +73.1% 🔴 0.77 / 0.96 / -19.4%
tpch_q04/duckdb:parquet 283006189 / 278868438 / +1.5% 411835290 / 290411092 / +41.8% 🔴 0.69 / 0.96 / -28.4%
tpch_q05/duckdb:parquet 511343090 / 512960026 / -0.3% 661075334 / 589908823 / +12.1% 0.77 / 0.87 / -11.0%
tpch_q06/duckdb:parquet 176474039 / 154774655 / +14.0% 193365059 / 188086085 / +2.8% 0.91 / 0.82 / +10.9%
tpch_q07/duckdb:parquet 446363300 / 419672939 / +6.4% 492082103 / 421853390 / +16.6% 0.91 / 0.99 / -8.8%
tpch_q08/duckdb:parquet 635643679 / 588960652 / +7.9% 725986117 / 658661231 / +10.2% 0.88 / 0.89 / -2.1%
tpch_q09/duckdb:parquet 574208186 / 557378838 / +3.0% 623950256 / 656390425 / -4.9% 0.92 / 0.85 / +8.4%
tpch_q10/duckdb:parquet 608566950 / 517349035 / +17.6% 608594552 / 581884894 / +4.6% 1.00 / 0.89 / +12.5%
tpch_q11/duckdb:parquet 315568048 / 279247336 / +13.0% 343007541 / 301469405 / +13.8% 0.92 / 0.93 / -0.7%
tpch_q12/duckdb:parquet 249511532 / 244321025 / +2.1% 354929664 / 281145014 / +26.2% 0.70 / 0.87 / -19.1%
tpch_q13/duckdb:parquet 386668796 / 382703043 / +1.0% 543614863 / 463219570 / +17.4% 0.71 / 0.83 / -13.9%
tpch_q14/duckdb:parquet 258891501 / 255047143 / +1.5% 308898306 / 301222259 / +2.5% 0.84 / 0.85 / -1.0%
tpch_q15/duckdb:parquet 226373180 / 191438501 / +18.2% 273116123 / 220554518 / +23.8% 0.83 / 0.87 / -4.5%
tpch_q16/duckdb:parquet 269180670 / 287313946 / -6.3% 277895198 / 301984087 / -8.0% 0.97 / 0.95 / +1.8%
tpch_q17/duckdb:parquet 346056792 / 258007938 / +34.1% 🔴 459701116 / 314199718 / +46.3% 🔴 0.75 / 0.82 / -8.3%
tpch_q18/duckdb:parquet 337959430 / 306425002 / +10.3% 388081520 / 355418381 / +9.2% 0.87 / 0.86 / +1.0%
tpch_q19/duckdb:parquet 230604821 / 241485587 / -4.5% 348714021 / 285468394 / +22.2% 0.66 / 0.85 / -21.8%
tpch_q20/duckdb:parquet 495413767 / 432599380 / +14.5% 580741003 / 540117093 / +7.5% 0.85 / 0.80 / +6.5%
tpch_q21/duckdb:parquet 465172723 / 417617294 / +11.4% 503331854 / 463876894 / +8.5% 0.92 / 0.90 / +2.7%
tpch_q22/duckdb:parquet 316308611 / 287438341 / +10.0% 328619449 / 253402369 / +29.7% 0.96 / 1.13 / -15.1%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=10 on NVME 📖

Commits: PR 62adb044 vs base 4598f857
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): hot 0.998x ➖ · cold 1.001x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.995x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 35770460 / 35836658 / -0.2% 61262226 / 59839649 / +2.4% 0.58 / 0.60 / -2.5%
tpcds_q02/datafusion:vortex-file-compressed 50973648 / 51540980 / -1.1% 77589075 / 75356430 / +3.0% 0.66 / 0.68 / -3.9%
tpcds_q03/datafusion:vortex-file-compressed 20102944 / 20246396 / -0.7% 46583751 / 46166223 / +0.9% 0.43 / 0.44 / -1.6%
tpcds_q04/datafusion:vortex-file-compressed 290678151 / 293432920 / -0.9% 358582373 / 354050198 / +1.3% 0.81 / 0.83 / -2.2%
tpcds_q05/datafusion:vortex-file-compressed 71397216 / 71656747 / -0.4% 101862269 / 107692212 / -5.4% 0.70 / 0.67 / +5.3%
tpcds_q06/datafusion:vortex-file-compressed 42249296 / 42258217 / -0.0% 70869006 / 70535607 / +0.5% 0.60 / 0.60 / -0.5%
tpcds_q07/datafusion:vortex-file-compressed 42111315 / 42156216 / -0.1% 80196120 / 80613054 / -0.5% 0.53 / 0.52 / +0.4%
tpcds_q08/datafusion:vortex-file-compressed 28859997 / 28614063 / +0.9% 57156641 / 57730721 / -1.0% 0.50 / 0.50 / +1.9%
tpcds_q09/datafusion:vortex-file-compressed 42161874 / 44012164 / -4.2% 77209262 / 77101674 / +0.1% 0.55 / 0.57 / -4.3%
tpcds_q10/datafusion:vortex-file-compressed 35650080 / 37189576 / -4.1% 65140670 / 63021635 / +3.4% 0.55 / 0.59 / -7.3%
tpcds_q11/datafusion:vortex-file-compressed 172437258 / 174495550 / -1.2% 213287921 / 221987691 / -3.9% 0.81 / 0.79 / +2.9%
tpcds_q12/datafusion:vortex-file-compressed 17669216 / 17549844 / +0.7% 36911992 / 38571171 / -4.3% 0.48 / 0.45 / +5.2%
tpcds_q13/datafusion:vortex-file-compressed 38930108 / 38899632 / +0.1% 80983226 / 85520203 / -5.3% 0.48 / 0.45 / +5.7%
tpcds_q14/datafusion:vortex-file-compressed 229736558 / 231725092 / -0.9% 278497255 / 271215982 / +2.7% 0.82 / 0.85 / -3.5%
tpcds_q15/datafusion:vortex-file-compressed 40829873 / 40095029 / +1.8% 57232084 / 54164984 / +5.7% 0.71 / 0.74 / -3.6%
tpcds_q16/datafusion:vortex-file-compressed 23289192 / 22869641 / +1.8% 42808039 / 42034772 / +1.8% 0.54 / 0.54 / -0.0%
tpcds_q17/datafusion:vortex-file-compressed 64558700 / 64808376 / -0.4% 97160456 / 89558176 / +8.5% 0.66 / 0.72 / -8.2%
tpcds_q18/datafusion:vortex-file-compressed 69092476 / 69097730 / -0.0% 98243302 / 94787906 / +3.6% 0.70 / 0.73 / -3.5%
tpcds_q19/datafusion:vortex-file-compressed 22510372 / 22408799 / +0.5% 55140425 / 55496169 / -0.6% 0.41 / 0.40 / +1.1%
tpcds_q20/datafusion:vortex-file-compressed 23941076 / 23702741 / +1.0% 42587512 / 40220803 / +5.9% 0.56 / 0.59 / -4.6%
tpcds_q21/datafusion:vortex-file-compressed 46949486 / 47542674 / -1.2% 76790120 / 64058585 / +19.9% 🔴 0.61 / 0.74 / -17.6%
tpcds_q22/datafusion:vortex-file-compressed 433767318 / 431366016 / +0.6% 457583956 / 465284097 / -1.7% 0.95 / 0.93 / +2.2%
tpcds_q23/datafusion:vortex-file-compressed 302843652 / 299587271 / +1.1% 363649304 / 351318540 / +3.5% 0.83 / 0.85 / -2.3%
tpcds_q24/datafusion:vortex-file-compressed 121497596 / 120023524 / +1.2% 160242410 / 159982078 / +0.2% 0.76 / 0.75 / +1.1%
tpcds_q25/datafusion:vortex-file-compressed 61448304 / 63311010 / -2.9% 101788646 / 102454935 / -0.7% 0.60 / 0.62 / -2.3%
tpcds_q26/datafusion:vortex-file-compressed 37379646 / 37429288 / -0.1% 59935954 / 59331611 / +1.0% 0.62 / 0.63 / -1.1%
tpcds_q27/datafusion:vortex-file-compressed 72481354 / 72377160 / +0.1% 105677019 / 104225546 / +1.4% 0.69 / 0.69 / -1.2%
tpcds_q28/datafusion:vortex-file-compressed 43601102 / 42296916 / +3.1% 86753989 / 82755038 / +4.8% 0.50 / 0.51 / -1.7%
tpcds_q29/datafusion:vortex-file-compressed 59722456 / 61922299 / -3.6% 103188313 / 97201813 / +6.2% 0.58 / 0.64 / -9.1%
tpcds_q30/datafusion:vortex-file-compressed 51892394 / 51311054 / +1.1% 79435477 / 79114003 / +0.4% 0.65 / 0.65 / +0.7%
tpcds_q31/datafusion:vortex-file-compressed 197293354 / 196557266 / +0.4% 230808369 / 235875877 / -2.1% 0.85 / 0.83 / +2.6%
tpcds_q32/datafusion:vortex-file-compressed 15042646 / 15236954 / -1.3% 33294165 / 31554300 / +5.5% 0.45 / 0.48 / -6.4%
tpcds_q33/datafusion:vortex-file-compressed 33071829 / 33321710 / -0.7% 70401923 / 67027574 / +5.0% 0.47 / 0.50 / -5.5%
tpcds_q34/datafusion:vortex-file-compressed 41019806 / 41148345 / -0.3% 65691067 / 68234625 / -3.7% 0.62 / 0.60 / +3.5%
tpcds_q35/datafusion:vortex-file-compressed 92021642 / 92443260 / -0.5% 122021851 / 120652799 / +1.1% 0.75 / 0.77 / -1.6%
tpcds_q36/datafusion:vortex-file-compressed 65810953 / 65946206 / -0.2% 97350101 / 100250170 / -2.9% 0.68 / 0.66 / +2.8%
tpcds_q37/datafusion:vortex-file-compressed 26030006 / 23553139 / +10.5% 🔴 59530097 / 43598667 / +36.5% 🔴 0.44 / 0.54 / -19.1%
tpcds_q38/datafusion:vortex-file-compressed 79662826 / 76507711 / +4.1% 107561343 / 106221269 / +1.3% 0.74 / 0.72 / +2.8%
tpcds_q39/datafusion:vortex-file-compressed 881182785 / 887680404 / -0.7% 909429428 / 906829393 / +0.3% 0.97 / 0.98 / -1.0%
tpcds_q40/datafusion:vortex-file-compressed 28847256 / 28735451 / +0.4% 47999802 / 47789817 / +0.4% 0.60 / 0.60 / -0.1%
tpcds_q41/datafusion:vortex-file-compressed 20445671 / 19056672 / +7.3% 32264569 / 30560191 / +5.6% 0.63 / 0.62 / +1.6%
tpcds_q42/datafusion:vortex-file-compressed 14258405 / 14306364 / -0.3% 38029572 / 39330916 / -3.3% 0.37 / 0.36 / +3.1%
tpcds_q43/datafusion:vortex-file-compressed 16880718 / 17123520 / -1.4% 43323951 / 40887604 / +6.0% 0.39 / 0.42 / -7.0%
tpcds_q44/datafusion:vortex-file-compressed 44398246 / 42841783 / +3.6% 73323598 / 73034215 / +0.4% 0.61 / 0.59 / +3.2%
tpcds_q45/datafusion:vortex-file-compressed 43270395 / 42716522 / +1.3% 65387730 / 64325351 / +1.7% 0.66 / 0.66 / -0.3%
tpcds_q46/datafusion:vortex-file-compressed 72275126 / 70770951 / +2.1% 101363681 / 103002911 / -1.6% 0.71 / 0.69 / +3.8%
tpcds_q47/datafusion:vortex-file-compressed 172914562 / 176930862 / -2.3% 224097110 / 217533458 / +3.0% 0.77 / 0.81 / -5.1%
tpcds_q48/datafusion:vortex-file-compressed 35871104 / 35477019 / +1.1% 70303915 / 70167195 / +0.2% 0.51 / 0.51 / +0.9%
tpcds_q49/datafusion:vortex-file-compressed 76575022 / 79901468 / -4.2% 118173990 / 120233831 / -1.7% 0.65 / 0.66 / -2.5%
tpcds_q50/datafusion:vortex-file-compressed 56489249 / 56310110 / +0.3% 90512364 / 89046429 / +1.6% 0.62 / 0.63 / -1.3%
tpcds_q51/datafusion:vortex-file-compressed 246782477 / 241461239 / +2.2% 271293902 / 280306123 / -3.2% 0.91 / 0.86 / +5.6%
tpcds_q52/datafusion:vortex-file-compressed 14539332 / 14942948 / -2.7% 41674715 / 41146983 / +1.3% 0.35 / 0.36 / -3.9%
tpcds_q53/datafusion:vortex-file-compressed 23785792 / 23025893 / +3.3% 52176946 / 52394142 / -0.4% 0.46 / 0.44 / +3.7%
tpcds_q54/datafusion:vortex-file-compressed 56600731 / 59630808 / -5.1% 92122485 / 92798502 / -0.7% 0.61 / 0.64 / -4.4%
tpcds_q55/datafusion:vortex-file-compressed 14059330 / 15209610 / -7.6% 39799415 / 39200802 / +1.5% 0.35 / 0.39 / -9.0%
tpcds_q56/datafusion:vortex-file-compressed 33406666 / 34211642 / -2.4% 63980724 / 63579406 / +0.6% 0.52 / 0.54 / -3.0%
tpcds_q57/datafusion:vortex-file-compressed 131700442 / 130827096 / +0.7% 161179774 / 162474233 / -0.8% 0.82 / 0.81 / +1.5%
tpcds_q58/datafusion:vortex-file-compressed 48579518 / 49071762 / -1.0% 84239466 / 84738612 / -0.6% 0.58 / 0.58 / -0.4%
tpcds_q59/datafusion:vortex-file-compressed 54561134 / 54936949 / -0.7% 85509149 / 85696270 / -0.2% 0.64 / 0.64 / -0.5%
tpcds_q60/datafusion:vortex-file-compressed 35078654 / 34485962 / +1.7% 64746182 / 66114270 / -2.1% 0.54 / 0.52 / +3.9%
tpcds_q61/datafusion:vortex-file-compressed 44593837 / 45202724 / -1.3% 68274337 / 70916447 / -3.7% 0.65 / 0.64 / +2.5%
tpcds_q62/datafusion:vortex-file-compressed 19158578 / 19841460 / -3.4% 43827866 / 43084349 / +1.7% 0.44 / 0.46 / -5.1%
tpcds_q63/datafusion:vortex-file-compressed 22958820 / 22619521 / +1.5% 53088390 / 49716174 / +6.8% 0.43 / 0.45 / -4.9%
tpcds_q64/datafusion:vortex-file-compressed 335213358 / 332776120 / +0.7% 402842586 / 399340320 / +0.9% 0.83 / 0.83 / -0.1%
tpcds_q65/datafusion:vortex-file-compressed 73384022 / 73751860 / -0.5% 113370953 / 110569158 / +2.5% 0.65 / 0.67 / -3.0%
tpcds_q66/datafusion:vortex-file-compressed 52772956 / 52486634 / +0.5% 77481212 / 77837826 / -0.5% 0.68 / 0.67 / +1.0%
tpcds_q67/datafusion:vortex-file-compressed 419270992 / 420503111 / -0.3% 510221084 / 528828691 / -3.5% 0.82 / 0.80 / +3.3%
tpcds_q68/datafusion:vortex-file-compressed 67095106 / 66831493 / +0.4% 102347859 / 99391180 / +3.0% 0.66 / 0.67 / -2.5%
tpcds_q69/datafusion:vortex-file-compressed 36435628 / 36278824 / +0.4% 64204155 / 63625322 / +0.9% 0.57 / 0.57 / -0.5%
tpcds_q70/datafusion:vortex-file-compressed 195235794 / 194497137 / +0.4% 228959072 / 232217411 / -1.4% 0.85 / 0.84 / +1.8%
tpcds_q71/datafusion:vortex-file-compressed 25781662 / 25424784 / +1.4% 57753401 / 61267492 / -5.7% 0.45 / 0.41 / +7.6%
tpcds_q72/datafusion:vortex-file-compressed 1606050853 / 1575229677 / +2.0% 1609815139 / 1696144047 / -5.1% 1.00 / 0.93 / +7.4%
tpcds_q73/datafusion:vortex-file-compressed 38523570 / 38589712 / -0.2% 66956026 / 62969996 / +6.3% 0.58 / 0.61 / -6.1%
tpcds_q74/datafusion:vortex-file-compressed 134272310 / 134601274 / -0.2% 175030961 / 173765353 / +0.7% 0.77 / 0.77 / -1.0%
tpcds_q75/datafusion:vortex-file-compressed 156631562 / 155633299 / +0.6% 197575317 / 198511793 / -0.5% 0.79 / 0.78 / +1.1%
tpcds_q76/datafusion:vortex-file-compressed 33983652 / 34722660 / -2.1% 72949135 / 73189101 / -0.3% 0.47 / 0.47 / -1.8%
tpcds_q77/datafusion:vortex-file-compressed 55412004 / 54175824 / +2.3% 89927799 / 87493805 / +2.8% 0.62 / 0.62 / -0.5%
tpcds_q78/datafusion:vortex-file-compressed 141699142 / 140889933 / +0.6% 195131637 / 191779256 / +1.7% 0.73 / 0.73 / -1.2%
tpcds_q79/datafusion:vortex-file-compressed 53142866 / 53408896 / -0.5% 85309862 / 83137730 / +2.6% 0.62 / 0.64 / -3.0%
tpcds_q80/datafusion:vortex-file-compressed 81228546 / 80795658 / +0.5% 125241389 / 127799771 / -2.0% 0.65 / 0.63 / +2.6%
tpcds_q81/datafusion:vortex-file-compressed 55822824 / 55975548 / -0.3% 85817670 / 83846761 / +2.4% 0.65 / 0.67 / -2.6%
tpcds_q82/datafusion:vortex-file-compressed 31646112 / 30549740 / +3.6% 56042547 / 48106493 / +16.5% 🔴 0.56 / 0.64 / -11.1%
tpcds_q83/datafusion:vortex-file-compressed 42048632 / 42358020 / -0.7% 66079473 / 65597866 / +0.7% 0.64 / 0.65 / -1.5%
tpcds_q84/datafusion:vortex-file-compressed 12784474 / 12799204 / -0.1% 31890499 / 30970538 / +3.0% 0.40 / 0.41 / -3.0%
tpcds_q85/datafusion:vortex-file-compressed 59065812 / 60660052 / -2.6% 89284354 / 90654953 / -1.5% 0.66 / 0.67 / -1.1%
tpcds_q86/datafusion:vortex-file-compressed 18529150 / 18272155 / +1.4% 41431598 / 40425570 / +2.5% 0.45 / 0.45 / -1.1%
tpcds_q87/datafusion:vortex-file-compressed 78575958 / 79615489 / -1.3% 105815254 / 107689679 / -1.7% 0.74 / 0.74 / +0.4%
tpcds_q88/datafusion:vortex-file-compressed 53839862 / 56206700 / -4.2% 92340568 / 93094539 / -0.8% 0.58 / 0.60 / -3.4%
tpcds_q89/datafusion:vortex-file-compressed 26757700 / 26931306 / -0.6% 56735176 / 56072635 / +1.2% 0.47 / 0.48 / -1.8%
tpcds_q90/datafusion:vortex-file-compressed 13433458 / 12758200 / +5.3% 33300086 / 34107490 / -2.4% 0.40 / 0.37 / +7.8%
tpcds_q91/datafusion:vortex-file-compressed 19290662 / 19519254 / -1.2% 43308945 / 42141655 / +2.8% 0.45 / 0.46 / -3.8%
tpcds_q92/datafusion:vortex-file-compressed 15068488 / 15245025 / -1.2% 36554968 / 33922326 / +7.8% 0.41 / 0.45 / -8.3%
tpcds_q93/datafusion:vortex-file-compressed 55289282 / 54842766 / +0.8% 96068538 / 88696680 / +8.3% 0.58 / 0.62 / -6.9%
tpcds_q94/datafusion:vortex-file-compressed 21855040 / 21620928 / +1.1% 46419778 / 46231785 / +0.4% 0.47 / 0.47 / +0.7%
tpcds_q95/datafusion:vortex-file-compressed 97018252 / 95000299 / +2.1% 126993141 / 123858370 / +2.5% 0.76 / 0.77 / -0.4%
tpcds_q96/datafusion:vortex-file-compressed 11639756 / 11533278 / +0.9% 32495128 / 31102793 / +4.5% 0.36 / 0.37 / -3.4%
tpcds_q97/datafusion:vortex-file-compressed 39306724 / 39467840 / -0.4% 66636297 / 66425488 / +0.3% 0.59 / 0.59 / -0.7%
tpcds_q98/datafusion:vortex-file-compressed 20526634 / 20665282 / -0.7% 46851767 / 48509099 / -3.4% 0.44 / 0.43 / +2.8%
tpcds_q99/datafusion:vortex-file-compressed 29929844 / 29545800 / +1.3% 49699025 / 48862458 / +1.7% 0.60 / 0.60 / -0.4%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 59687818 / 59408052 / +0.5% 77092089 / 82373568 / -6.4% 0.77 / 0.72 / +7.4%
tpcds_q02/datafusion:parquet 69561722 / 69761366 / -0.3% 93241422 / 90812813 / +2.7% 0.75 / 0.77 / -2.9%
tpcds_q03/datafusion:parquet 28392630 / 28478768 / -0.3% 50433636 / 49334251 / +2.2% 0.56 / 0.58 / -2.5%
tpcds_q04/datafusion:parquet 643879060 / 642610250 / +0.2% 701368019 / 708231753 / -1.0% 0.92 / 0.91 / +1.2%
tpcds_q05/datafusion:parquet 80607614 / 81388832 / -1.0% 118266933 / 113800720 / +3.9% 0.68 / 0.72 / -4.7%
tpcds_q06/datafusion:parquet 90374486 / 90852955 / -0.5% 116498151 / 115952402 / +0.5% 0.78 / 0.78 / -1.0%
tpcds_q07/datafusion:parquet 100971986 / 101418282 / -0.4% 128400265 / 133695330 / -4.0% 0.79 / 0.76 / +3.7%
tpcds_q08/datafusion:parquet 50137132 / 48684130 / +3.0% 75642451 / 74133519 / +2.0% 0.66 / 0.66 / +0.9%
tpcds_q09/datafusion:parquet 75442502 / 75160834 / +0.4% 98218006 / 102849415 / -4.5% 0.77 / 0.73 / +5.1%
tpcds_q10/datafusion:parquet 57574314 / 60416750 / -4.7% 84704819 / 84947233 / -0.3% 0.68 / 0.71 / -4.4%
tpcds_q11/datafusion:parquet 411305584 / 412444870 / -0.3% 453567549 / 461294550 / -1.7% 0.91 / 0.89 / +1.4%
tpcds_q12/datafusion:parquet 39925008 / 39871562 / +0.1% 58452726 / 57128529 / +2.3% 0.68 / 0.70 / -2.1%
tpcds_q13/datafusion:parquet 85283574 / 84637846 / +0.8% 132797224 / 130466094 / +1.8% 0.64 / 0.65 / -1.0%
tpcds_q14/datafusion:parquet 373196807 / 378360104 / -1.4% 411130644 / 433388374 / -5.1% 0.91 / 0.87 / +4.0%
tpcds_q15/datafusion:parquet 51302823 / 51502606 / -0.4% 73207747 / 72303263 / +1.3% 0.70 / 0.71 / -1.6%
tpcds_q16/datafusion:parquet 45088762 / 45710882 / -1.4% 63431836 / 63650471 / -0.3% 0.71 / 0.72 / -1.0%
tpcds_q17/datafusion:parquet 138131536 / 138067928 / +0.0% 170300887 / 172187136 / -1.1% 0.81 / 0.80 / +1.2%
tpcds_q18/datafusion:parquet 109115372 / 110369917 / -1.1% 144514548 / 144952536 / -0.3% 0.76 / 0.76 / -0.8%
tpcds_q19/datafusion:parquet 48140504 / 48384048 / -0.5% 76461883 / 75539146 / +1.2% 0.63 / 0.64 / -1.7%
tpcds_q20/datafusion:parquet 41813360 / 41512735 / +0.7% 53176364 / 55090816 / -3.5% 0.79 / 0.75 / +4.4%
tpcds_q21/datafusion:parquet 61025433 / 61141701 / -0.2% 73834976 / 73095747 / +1.0% 0.83 / 0.84 / -1.2%
tpcds_q22/datafusion:parquet 463270021 / 464195324 / -0.2% 479026316 / 478139930 / +0.2% 0.97 / 0.97 / -0.4%
tpcds_q23/datafusion:parquet 361067973 / 357626356 / +1.0% 398751970 / 417833459 / -4.6% 0.91 / 0.86 / +5.8%
tpcds_q24/datafusion:parquet 240556306 / 241331307 / -0.3% 274165332 / 278266611 / -1.5% 0.88 / 0.87 / +1.2%
tpcds_q25/datafusion:parquet 144675590 / 146902811 / -1.5% 188993492 / 196039200 / -3.6% 0.77 / 0.75 / +2.2%
tpcds_q26/datafusion:parquet 54384987 / 53821080 / +1.0% 79247597 / 80565923 / -1.6% 0.69 / 0.67 / +2.7%
tpcds_q27/datafusion:parquet 210335270 / 210089836 / +0.1% 244868868 / 235911774 / +3.8% 0.86 / 0.89 / -3.5%
tpcds_q28/datafusion:parquet 86140415 / 86784142 / -0.7% 113524114 / 119280232 / -4.8% 0.76 / 0.73 / +4.3%
tpcds_q29/datafusion:parquet 142806604 / 145820741 / -2.1% 178064324 / 175411233 / +1.5% 0.80 / 0.83 / -3.5%
tpcds_q30/datafusion:parquet 96712662 / 99608501 / -2.9% 120991844 / 120071149 / +0.8% 0.80 / 0.83 / -3.6%
tpcds_q31/datafusion:parquet 319956187 / 319058792 / +0.3% 343041984 / 344041143 / -0.3% 0.93 / 0.93 / +0.6%
tpcds_q32/datafusion:parquet 29338554 / 29399552 / -0.2% 42382789 / 43643939 / -2.9% 0.69 / 0.67 / +2.8%
tpcds_q33/datafusion:parquet 50763362 / 51971680 / -2.3% 75297685 / 76538194 / -1.6% 0.67 / 0.68 / -0.7%
tpcds_q34/datafusion:parquet 63213122 / 65511648 / -3.5% 86522927 / 85276600 / +1.5% 0.73 / 0.77 / -4.9%
tpcds_q35/datafusion:parquet 125269234 / 126922984 / -1.3% 151634728 / 150646646 / +0.7% 0.83 / 0.84 / -1.9%
tpcds_q36/datafusion:parquet 98739858 / 97863638 / +0.9% 130505558 / 126419427 / +3.2% 0.76 / 0.77 / -2.3%
tpcds_q37/datafusion:parquet 50626132 / 50046237 / +1.2% 65326100 / 65033749 / +0.4% 0.77 / 0.77 / +0.7%
tpcds_q38/datafusion:parquet 122347826 / 122147195 / +0.2% 151023789 / 145034869 / +4.1% 0.81 / 0.84 / -3.8%
tpcds_q39/datafusion:parquet 851052456 / 846526498 / +0.5% 859125735 / 859437879 / -0.0% 0.99 / 0.98 / +0.6%
tpcds_q40/datafusion:parquet 35334255 / 35936465 / -1.7% 56081212 / 54650564 / +2.6% 0.63 / 0.66 / -4.2%
tpcds_q41/datafusion:parquet 32045057 / 31200319 / +2.7% 43012823 / 42657926 / +0.8% 0.75 / 0.73 / +1.9%
tpcds_q42/datafusion:parquet 26098498 / 25952126 / +0.6% 46711539 / 43716014 / +6.9% 0.56 / 0.59 / -5.9%
tpcds_q43/datafusion:parquet 27748100 / 27372783 / +1.4% 47543045 / 46844617 / +1.5% 0.58 / 0.58 / -0.1%
tpcds_q44/datafusion:parquet 66220480 / 65006033 / +1.9% 88109315 / 87803178 / +0.3% 0.75 / 0.74 / +1.5%
tpcds_q45/datafusion:parquet 65156385 / 66536274 / -2.1% 88205879 / 87212845 / +1.1% 0.74 / 0.76 / -3.2%
tpcds_q46/datafusion:parquet 108831050 / 106805720 / +1.9% 148308268 / 153607976 / -3.5% 0.73 / 0.70 / +5.5%
tpcds_q47/datafusion:parquet 235647390 / 237808994 / -0.9% 280434267 / 273252482 / +2.6% 0.84 / 0.87 / -3.4%
tpcds_q48/datafusion:parquet 78229926 / 76955857 / +1.7% 109946838 / 105870247 / +3.9% 0.71 / 0.73 / -2.1%
tpcds_q49/datafusion:parquet 112995422 / 118898020 / -5.0% 146462539 / 170084458 / -13.9% 🟢 0.77 / 0.70 / +10.4%
tpcds_q50/datafusion:parquet 91379490 / 92705258 / -1.4% 118046217 / 120435148 / -2.0% 0.77 / 0.77 / +0.6%
tpcds_q51/datafusion:parquet 252863504 / 254091982 / -0.5% 288529885 / 289211985 / -0.2% 0.88 / 0.88 / -0.2%
tpcds_q52/datafusion:parquet 26428043 / 26889958 / -1.7% 45526288 / 45469536 / +0.1% 0.58 / 0.59 / -1.8%
tpcds_q53/datafusion:parquet 37154430 / 36382336 / +2.1% 58746158 / 57842390 / +1.6% 0.63 / 0.63 / +0.6%
tpcds_q54/datafusion:parquet 86741419 / 85254806 / +1.7% 113677933 / 109551589 / +3.8% 0.76 / 0.78 / -1.9%
tpcds_q55/datafusion:parquet 26709557 / 26510566 / +0.8% 47206346 / 46645823 / +1.2% 0.57 / 0.57 / -0.4%
tpcds_q56/datafusion:parquet 52257652 / 54094848 / -3.4% 75061669 / 77335323 / -2.9% 0.70 / 0.70 / -0.5%
tpcds_q57/datafusion:parquet 172122914 / 171894920 / +0.1% 192592859 / 193978047 / -0.7% 0.89 / 0.89 / +0.9%
tpcds_q58/datafusion:parquet 97341960 / 98465482 / -1.1% 126761006 / 125032548 / +1.4% 0.77 / 0.79 / -2.5%
tpcds_q59/datafusion:parquet 104696187 / 103659830 / +1.0% 128590938 / 130225505 / -1.3% 0.81 / 0.80 / +2.3%
tpcds_q60/datafusion:parquet 53913826 / 55741260 / -3.3% 75368805 / 78220449 / -3.6% 0.72 / 0.71 / +0.4%
tpcds_q61/datafusion:parquet 74537351 / 78001000 / -4.4% 98826911 / 106432779 / -7.1% 0.75 / 0.73 / +2.9%
tpcds_q62/datafusion:parquet 27629124 / 27762318 / -0.5% 45143671 / 44527940 / +1.4% 0.61 / 0.62 / -1.8%
tpcds_q63/datafusion:parquet 36249704 / 36196190 / +0.1% 60181234 / 58834211 / +2.3% 0.60 / 0.62 / -2.1%
tpcds_q64/datafusion:parquet 660164968 / 659557758 / +0.1% 734912220 / 742173662 / -1.0% 0.90 / 0.89 / +1.1%
tpcds_q65/datafusion:parquet 101645004 / 100715906 / +0.9% 131999228 / 133981634 / -1.5% 0.77 / 0.75 / +2.4%
tpcds_q66/datafusion:parquet 77396920 / 76575936 / +1.1% 103938260 / 104374000 / -0.4% 0.74 / 0.73 / +1.5%
tpcds_q67/datafusion:parquet 433608931 / 430912350 / +0.6% 505082968 / 500297658 / +1.0% 0.86 / 0.86 / -0.3%
tpcds_q68/datafusion:parquet 109561128 / 108700552 / +0.8% 154253457 / 156742031 / -1.6% 0.71 / 0.69 / +2.4%
tpcds_q69/datafusion:parquet 60257076 / 61003348 / -1.2% 86683467 / 84325988 / +2.8% 0.70 / 0.72 / -3.9%
tpcds_q70/datafusion:parquet 211901691 / 212975306 / -0.5% 242235428 / 246017700 / -1.5% 0.87 / 0.87 / +1.0%
tpcds_q71/datafusion:parquet 38160915 / 39083124 / -2.4% 62213233 / 64662143 / -3.8% 0.61 / 0.60 / +1.5%
tpcds_q72/datafusion:parquet 1734101032 / 1794732356 / -3.4% 1772255155 / 1806078341 / -1.9% 0.98 / 0.99 / -1.5%
tpcds_q73/datafusion:parquet 64529052 / 62856255 / +2.7% 85337794 / 84855052 / +0.6% 0.76 / 0.74 / +2.1%
tpcds_q74/datafusion:parquet 293237926 / 292768250 / +0.2% 328499226 / 331483495 / -0.9% 0.89 / 0.88 / +1.1%
tpcds_q75/datafusion:parquet 198385517 / 193794623 / +2.4% 238817046 / 239131737 / -0.1% 0.83 / 0.81 / +2.5%
tpcds_q76/datafusion:parquet 50473360 / 49958244 / +1.0% 77668103 / 78897199 / -1.6% 0.65 / 0.63 / +2.6%
tpcds_q77/datafusion:parquet 72390274 / 73280301 / -1.2% 102476897 / 98096657 / +4.5% 0.71 / 0.75 / -5.4%
tpcds_q78/datafusion:parquet 210586013 / 211119866 / -0.3% 266521743 / 273491694 / -2.5% 0.79 / 0.77 / +2.4%
tpcds_q79/datafusion:parquet 77086230 / 77375078 / -0.4% 115184187 / 112413871 / +2.5% 0.67 / 0.69 / -2.8%
tpcds_q80/datafusion:parquet 146298671 / 143104068 / +2.2% 193825581 / 191975662 / +1.0% 0.75 / 0.75 / +1.3%
tpcds_q81/datafusion:parquet 107137892 / 106756472 / +0.4% 128059135 / 129378123 / -1.0% 0.84 / 0.83 / +1.4%
tpcds_q82/datafusion:parquet 53955394 / 53582485 / +0.7% 71610264 / 70410662 / +1.7% 0.75 / 0.76 / -1.0%
tpcds_q83/datafusion:parquet 65220317 / 66630048 / -2.1% 84428482 / 85136032 / -0.8% 0.77 / 0.78 / -1.3%
tpcds_q84/datafusion:parquet 35658320 / 36220898 / -1.6% 51149545 / 49805351 / +2.7% 0.70 / 0.73 / -4.1%
tpcds_q85/datafusion:parquet 106305802 / 103848480 / +2.4% 130958831 / 129149354 / +1.4% 0.81 / 0.80 / +1.0%
tpcds_q86/datafusion:parquet 22126220 / 22112695 / +0.1% 38845040 / 39672664 / -2.1% 0.57 / 0.56 / +2.2%
tpcds_q87/datafusion:parquet 120319593 / 122470358 / -1.8% 142906288 / 148224625 / -3.6% 0.84 / 0.83 / +1.9%
tpcds_q88/datafusion:parquet 85489762 / 86047137 / -0.6% 108515505 / 108358632 / +0.1% 0.79 / 0.79 / -0.8%
tpcds_q89/datafusion:parquet 39254060 / 38401756 / +2.2% 64893814 / 64923770 / -0.0% 0.60 / 0.59 / +2.3%
tpcds_q90/datafusion:parquet 17230528 / 18100802 / -4.8% 33425953 / 32273520 / +3.6% 0.52 / 0.56 / -8.1%
tpcds_q91/datafusion:parquet 43480916 / 41738000 / +4.2% 58680005 / 57454843 / +2.1% 0.74 / 0.73 / +2.0%
tpcds_q92/datafusion:parquet 28749304 / 28604120 / +0.5% 46528523 / 47460689 / -2.0% 0.62 / 0.60 / +2.5%
tpcds_q93/datafusion:parquet 60727882 / 63722030 / -4.7% 91204861 / 87405909 / +4.3% 0.67 / 0.73 / -8.7%
tpcds_q94/datafusion:parquet 39025782 / 37847109 / +3.1% 56843496 / 58549059 / -2.9% 0.69 / 0.65 / +6.2%
tpcds_q95/datafusion:parquet 126579622 / 128012922 / -1.1% 156990964 / 149910916 / +4.7% 0.81 / 0.85 / -5.6%
tpcds_q96/datafusion:parquet 20689257 / 20691258 / -0.0% 37002685 / 36951345 / +0.1% 0.56 / 0.56 / -0.1%
tpcds_q97/datafusion:parquet 55034354 / 54645566 / +0.7% 78945585 / 80351616 / -1.7% 0.70 / 0.68 / +2.5%
tpcds_q98/datafusion:parquet 60780940 / 61965680 / -1.9% 84738472 / 83775704 / +1.1% 0.72 / 0.74 / -3.0%
tpcds_q99/datafusion:parquet 42869577 / 42461627 / +1.0% 58374898 / 57802802 / +1.0% 0.73 / 0.73 / -0.0%
duckdb / vortex-file-compressed / ns (0.995x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 32643548 / 32726779 / -0.3% 44667213 / 45377689 / -1.6% 0.73 / 0.72 / +1.3%
tpcds_q02/duckdb:vortex-file-compressed 30481605 / 30267290 / +0.7% 44796768 / 44087004 / +1.6% 0.68 / 0.69 / -0.9%
tpcds_q03/duckdb:vortex-file-compressed 13400076 / 13779130 / -2.8% 30201337 / 30718899 / -1.7% 0.44 / 0.45 / -1.1%
tpcds_q04/duckdb:vortex-file-compressed 127002747 / 130206338 / -2.5% 154215456 / 157201556 / -1.9% 0.82 / 0.83 / -0.6%
tpcds_q05/duckdb:vortex-file-compressed 54035984 / 53727511 / +0.6% 81125074 / 83478676 / -2.8% 0.67 / 0.64 / +3.5%
tpcds_q06/duckdb:vortex-file-compressed 59122439 / 58800986 / +0.5% 80070299 / 79094008 / +1.2% 0.74 / 0.74 / -0.7%
tpcds_q07/duckdb:vortex-file-compressed 30142012 / 31168844 / -3.3% 54067708 / 54099517 / -0.1% 0.56 / 0.58 / -3.2%
tpcds_q08/duckdb:vortex-file-compressed 31317626 / 31134683 / +0.6% 40859516 / 41772800 / -2.2% 0.77 / 0.75 / +2.8%
tpcds_q09/duckdb:vortex-file-compressed 56562453 / 55235330 / +2.4% 79800943 / 79107779 / +0.9% 0.71 / 0.70 / +1.5%
tpcds_q10/duckdb:vortex-file-compressed 39449458 / 39038430 / +1.1% 59372123 / 58236826 / +1.9% 0.66 / 0.67 / -0.9%
tpcds_q11/duckdb:vortex-file-compressed 94961196 / 96226126 / -1.3% 111679724 / 112266994 / -0.5% 0.85 / 0.86 / -0.8%
tpcds_q12/duckdb:vortex-file-compressed 17203564 / 17276975 / -0.4% 29973412 / 30254952 / -0.9% 0.57 / 0.57 / +0.5%
tpcds_q13/duckdb:vortex-file-compressed 38450891 / 38940578 / -1.3% 72167309 / 71103229 / +1.5% 0.53 / 0.55 / -2.7%
tpcds_q14/duckdb:vortex-file-compressed 120055872 / 119983268 / +0.1% 137387628 / 140641737 / -2.3% 0.87 / 0.85 / +2.4%
tpcds_q15/duckdb:vortex-file-compressed 56545486 / 60759281 / -6.9% 76302900 / 76171754 / +0.2% 0.74 / 0.80 / -7.1%
tpcds_q16/duckdb:vortex-file-compressed 34941116 / 34771337 / +0.5% 52153722 / 53890958 / -3.2% 0.67 / 0.65 / +3.8%
tpcds_q17/duckdb:vortex-file-compressed 57777591 / 57289182 / +0.9% 80238700 / 81955246 / -2.1% 0.72 / 0.70 / +3.0%
tpcds_q18/duckdb:vortex-file-compressed 83325397 / 82993345 / +0.4% 101782465 / 104424434 / -2.5% 0.82 / 0.79 / +3.0%
tpcds_q19/duckdb:vortex-file-compressed 44614443 / 43899722 / +1.6% 61587075 / 65276395 / -5.7% 0.72 / 0.67 / +7.7%
tpcds_q20/duckdb:vortex-file-compressed 21799082 / 21520304 / +1.3% 35789457 / 34931964 / +2.5% 0.61 / 0.62 / -1.1%
tpcds_q21/duckdb:vortex-file-compressed 27628100 / 28120830 / -1.8% 58887423 / 62004166 / -5.0% 0.47 / 0.45 / +3.4%
tpcds_q22/duckdb:vortex-file-compressed 165319172 / 165099230 / +0.1% 172035866 / 170541662 / +0.9% 0.96 / 0.97 / -0.7%
tpcds_q23/duckdb:vortex-file-compressed 181933467 / 185876490 / -2.1% 202990651 / 199673618 / +1.7% 0.90 / 0.93 / -3.7%
tpcds_q24/duckdb:vortex-file-compressed 52529203 / 52636914 / -0.2% 75768839 / 77254623 / -1.9% 0.69 / 0.68 / +1.8%
tpcds_q25/duckdb:vortex-file-compressed 53849042 / 53220034 / +1.2% 75901281 / 75302591 / +0.8% 0.71 / 0.71 / +0.4%
tpcds_q26/duckdb:vortex-file-compressed 26197282 / 26713063 / -1.9% 46357407 / 42934826 / +8.0% 0.57 / 0.62 / -9.2%
tpcds_q27/duckdb:vortex-file-compressed 31568428 / 32585874 / -3.1% 54694545 / 53424233 / +2.4% 0.58 / 0.61 / -5.4%
tpcds_q28/duckdb:vortex-file-compressed 41623268 / 41342696 / +0.7% 61542554 / 66089322 / -6.9% 0.68 / 0.63 / +8.1%
tpcds_q29/duckdb:vortex-file-compressed 52866854 / 51866994 / +1.9% 74165250 / 74066949 / +0.1% 0.71 / 0.70 / +1.8%
tpcds_q30/duckdb:vortex-file-compressed 38133300 / 37914817 / +0.6% 51807321 / 52960815 / -2.2% 0.74 / 0.72 / +2.8%
tpcds_q31/duckdb:vortex-file-compressed 37780680 / 37512062 / +0.7% 52914521 / 53392186 / -0.9% 0.71 / 0.70 / +1.6%
tpcds_q32/duckdb:vortex-file-compressed 13686886 / 13855892 / -1.2% 29119546 / 28855272 / +0.9% 0.47 / 0.48 / -2.1%
tpcds_q33/duckdb:vortex-file-compressed 34478390 / 33813963 / +2.0% 57787551 / 59046480 / -2.1% 0.60 / 0.57 / +4.2%
tpcds_q34/duckdb:vortex-file-compressed 22872080 / 22811725 / +0.3% 38865044 / 39776812 / -2.3% 0.59 / 0.57 / +2.6%
tpcds_q35/duckdb:vortex-file-compressed 65637480 / 66786588 / -1.7% 88556681 / 85242000 / +3.9% 0.74 / 0.78 / -5.4%
tpcds_q36/duckdb:vortex-file-compressed 29028200 / 29806828 / -2.6% 47300929 / 49308472 / -4.1% 0.61 / 0.60 / +1.5%
tpcds_q37/duckdb:vortex-file-compressed 26093488 / 25605208 / +1.9% 75073406 / 74457214 / +0.8% 0.35 / 0.34 / +1.1%
tpcds_q38/duckdb:vortex-file-compressed 61629197 / 62408870 / -1.2% 72587590 / 81156842 / -10.6% 🟢 0.85 / 0.77 / +10.4%
tpcds_q39/duckdb:vortex-file-compressed 55569101 / 56168904 / -1.1% 84743800 / 85127364 / -0.5% 0.66 / 0.66 / -0.6%
tpcds_q40/duckdb:vortex-file-compressed 18828110 / 19238372 / -2.1% 36057153 / 35099919 / +2.7% 0.52 / 0.55 / -4.7%
tpcds_q41/duckdb:vortex-file-compressed 19177900 / 18720698 / +2.4% 26304176 / 25500417 / +3.2% 0.73 / 0.73 / -0.7%
tpcds_q42/duckdb:vortex-file-compressed 14307522 / 14015144 / +2.1% 30480972 / 30966847 / -1.6% 0.47 / 0.45 / +3.7%
tpcds_q43/duckdb:vortex-file-compressed 19521994 / 19403602 / +0.6% 33946377 / 32011378 / +6.0% 0.58 / 0.61 / -5.1%
tpcds_q44/duckdb:vortex-file-compressed 27711674 / 28307018 / -2.1% 51076992 / 51668551 / -1.1% 0.54 / 0.55 / -1.0%
tpcds_q45/duckdb:vortex-file-compressed 46385402 / 46586273 / -0.4% 60001349 / 60370446 / -0.6% 0.77 / 0.77 / +0.2%
tpcds_q46/duckdb:vortex-file-compressed 51100037 / 51192653 / -0.2% 74883224 / 75043524 / -0.2% 0.68 / 0.68 / +0.0%
tpcds_q47/duckdb:vortex-file-compressed 79588378 / 80927444 / -1.7% 98875997 / 97094785 / +1.8% 0.80 / 0.83 / -3.4%
tpcds_q48/duckdb:vortex-file-compressed 52738672 / 53155386 / -0.8% 79906454 / 81823473 / -2.3% 0.66 / 0.65 / +1.6%
tpcds_q49/duckdb:vortex-file-compressed 39157206 / 37950044 / +3.2% 77817856 / 78847393 / -1.3% 0.50 / 0.48 / +4.5%
tpcds_q50/duckdb:vortex-file-compressed 31850024 / 32675461 / -2.5% 56867966 / 57051911 / -0.3% 0.56 / 0.57 / -2.2%
tpcds_q51/duckdb:vortex-file-compressed 203316739 / 204779876 / -0.7% 215579858 / 217736852 / -1.0% 0.94 / 0.94 / +0.3%
tpcds_q52/duckdb:vortex-file-compressed 14548514 / 15384257 / -5.4% 32362587 / 31876748 / +1.5% 0.45 / 0.48 / -6.9%
tpcds_q53/duckdb:vortex-file-compressed 22604848 / 22960290 / -1.5% 38370320 / 39000657 / -1.6% 0.59 / 0.59 / +0.1%
tpcds_q54/duckdb:vortex-file-compressed 44492048 / 44886930 / -0.9% 65075636 / 65481173 / -0.6% 0.68 / 0.69 / -0.3%
tpcds_q55/duckdb:vortex-file-compressed 14556290 / 14612501 / -0.4% 30112752 / 30570651 / -1.5% 0.48 / 0.48 / +1.1%
tpcds_q56/duckdb:vortex-file-compressed 32729767 / 32462078 / +0.8% 56262433 / 57717193 / -2.5% 0.58 / 0.56 / +3.4%
tpcds_q57/duckdb:vortex-file-compressed 70350636 / 64171452 / +9.6% 77505551 / 78496038 / -1.3% 0.91 / 0.82 / +11.0%
tpcds_q58/duckdb:vortex-file-compressed 37515504 / 37835588 / -0.8% 56160569 / 64016051 / -12.3% 🟢 0.67 / 0.59 / +13.0%
tpcds_q59/duckdb:vortex-file-compressed 54417318 / 53810956 / +1.1% 63745494 / 71107629 / -10.4% 🟢 0.85 / 0.76 / +12.8%
tpcds_q60/duckdb:vortex-file-compressed 35043595 / 35369636 / -0.9% 60279723 / 59793701 / +0.8% 0.58 / 0.59 / -1.7%
tpcds_q61/duckdb:vortex-file-compressed 34337588 / 34298255 / +0.1% 53745367 / 53069753 / +1.3% 0.64 / 0.65 / -1.1%
tpcds_q62/duckdb:vortex-file-compressed 14835026 / 14822514 / +0.1% 26301643 / 26421769 / -0.5% 0.56 / 0.56 / +0.5%
tpcds_q63/duckdb:vortex-file-compressed 21306876 / 20828409 / +2.3% 37276762 / 38114655 / -2.2% 0.57 / 0.55 / +4.6%
tpcds_q64/duckdb:vortex-file-compressed 118206160 / 118342334 / -0.1% 151122675 / 152181613 / -0.7% 0.78 / 0.78 / +0.6%
tpcds_q65/duckdb:vortex-file-compressed 52102551 / 51466061 / +1.2% 60843166 / 58907342 / +3.3% 0.86 / 0.87 / -2.0%
tpcds_q66/duckdb:vortex-file-compressed 41590788 / 40998564 / +1.4% 57935814 / 58858579 / -1.6% 0.72 / 0.70 / +3.1%
tpcds_q67/duckdb:vortex-file-compressed 276743818 / 277425812 / -0.2% 281960354 / 283678837 / -0.6% 0.98 / 0.98 / +0.4%
tpcds_q68/duckdb:vortex-file-compressed 45184764 / 44593714 / +1.3% 74069935 / 72079771 / +2.8% 0.61 / 0.62 / -1.4%
tpcds_q69/duckdb:vortex-file-compressed 38380361 / 38356528 / +0.1% 59814852 / 59755970 / +0.1% 0.64 / 0.64 / -0.0%
tpcds_q70/duckdb:vortex-file-compressed 25125136 / 25085070 / +0.2% 41696127 / 41516746 / +0.4% 0.60 / 0.60 / -0.3%
tpcds_q71/duckdb:vortex-file-compressed 27785364 / 27715436 / +0.3% 50518117 / 50902781 / -0.8% 0.55 / 0.54 / +1.0%
tpcds_q72/duckdb:vortex-file-compressed 137535287 / 135900823 / +1.2% 161443582 / 164226936 / -1.7% 0.85 / 0.83 / +2.9%
tpcds_q73/duckdb:vortex-file-compressed 20507214 / 20089200 / +2.1% 36959434 / 37315276 / -1.0% 0.55 / 0.54 / +3.1%
tpcds_q74/duckdb:vortex-file-compressed 83297302 / 82722980 / +0.7% 96809836 / 99629718 / -2.8% 0.86 / 0.83 / +3.6%
tpcds_q75/duckdb:vortex-file-compressed 112190160 / 111929736 / +0.2% 137352303 / 139908352 / -1.8% 0.82 / 0.80 / +2.1%
tpcds_q76/duckdb:vortex-file-compressed 27779562 / 27219565 / +2.1% 55105261 / 58492855 / -5.8% 0.50 / 0.47 / +8.3%
tpcds_q77/duckdb:vortex-file-compressed 35945124 / 36316546 / -1.0% 58234306 / 62103115 / -6.2% 0.62 / 0.58 / +5.6%
tpcds_q78/duckdb:vortex-file-compressed 135923540 / 137442428 / -1.1% 159471849 / 159793923 / -0.2% 0.85 / 0.86 / -0.9%
tpcds_q79/duckdb:vortex-file-compressed 37946494 / 37665982 / +0.7% 61106998 / 59874325 / +2.1% 0.62 / 0.63 / -1.3%
tpcds_q80/duckdb:vortex-file-compressed 57448116 / 57541290 / -0.2% 90043056 / 89399248 / +0.7% 0.64 / 0.64 / -0.9%
tpcds_q81/duckdb:vortex-file-compressed 56744507 / 57777750 / -1.8% 70759773 / 71231569 / -0.7% 0.80 / 0.81 / -1.1%
tpcds_q82/duckdb:vortex-file-compressed 26621303 / 26860434 / -0.9% 75572743 / 77804956 / -2.9% 0.35 / 0.35 / +2.0%
tpcds_q83/duckdb:vortex-file-compressed 21439199 / 21694036 / -1.2% 31516272 / 32263861 / -2.3% 0.68 / 0.67 / +1.2%
tpcds_q84/duckdb:vortex-file-compressed 13351756 / 13366814 / -0.1% 23455318 / 23226339 / +1.0% 0.57 / 0.58 / -1.1%
tpcds_q85/duckdb:vortex-file-compressed 36952810 / 36707151 / +0.7% 57025663 / 56348206 / +1.2% 0.65 / 0.65 / -0.5%
tpcds_q86/duckdb:vortex-file-compressed 16212642 / 16411782 / -1.2% 28838178 / 28182293 / +2.3% 0.56 / 0.58 / -3.5%
tpcds_q87/duckdb:vortex-file-compressed 73095214 / 75201770 / -2.8% 88663167 / 87749398 / +1.0% 0.82 / 0.86 / -3.8%
tpcds_q88/duckdb:vortex-file-compressed 37879331 / 37878092 / +0.0% 49108070 / 49979733 / -1.7% 0.77 / 0.76 / +1.8%
tpcds_q89/duckdb:vortex-file-compressed 24462744 / 24974289 / -2.0% 39313784 / 41888285 / -6.1% 0.62 / 0.60 / +4.4%
tpcds_q90/duckdb:vortex-file-compressed 9852626 / 9843474 / +0.1% 19220935 / 20353435 / -5.6% 0.51 / 0.48 / +6.0%
tpcds_q91/duckdb:vortex-file-compressed 19564916 / 19617013 / -0.3% 27820493 / 29081972 / -4.3% 0.70 / 0.67 / +4.3%
tpcds_q92/duckdb:vortex-file-compressed 13050115 / 13643566 / -4.3% 26741519 / 27682975 / -3.4% 0.49 / 0.49 / -1.0%
tpcds_q93/duckdb:vortex-file-compressed 25289754 / 25876894 / -2.3% 51159514 / 52613864 / -2.8% 0.49 / 0.49 / +0.5%
tpcds_q94/duckdb:vortex-file-compressed 32778867 / 32152022 / +1.9% 46132432 / 47204449 / -2.3% 0.71 / 0.68 / +4.3%
tpcds_q95/duckdb:vortex-file-compressed 94044360 / 97513786 / -3.6% 103567541 / 117615692 / -11.9% 🟢 0.91 / 0.83 / +9.5%
tpcds_q96/duckdb:vortex-file-compressed 11916850 / 11752061 / +1.4% 25914234 / 24570663 / +5.5% 0.46 / 0.48 / -3.9%
tpcds_q97/duckdb:vortex-file-compressed 61341360 / 62178961 / -1.3% 81502521 / 82766588 / -1.5% 0.75 / 0.75 / +0.2%
tpcds_q98/duckdb:vortex-file-compressed 27400680 / 26889542 / +1.9% 42958473 / 43917859 / -2.2% 0.64 / 0.61 / +4.2%
tpcds_q99/duckdb:vortex-file-compressed 20524844 / 26072871 / -21.3% 🟢 34759105 / 35980286 / -3.4% 0.59 / 0.72 / -18.5%
duckdb / parquet / ns (0.999x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 43151772 / 43748750 / -1.4% 50115731 / 50433867 / -0.6% 0.86 / 0.87 / -0.7%
tpcds_q02/duckdb:parquet 40305930 / 39630168 / +1.7% 45035218 / 50715675 / -11.2% 🟢 0.89 / 0.78 / +14.5%
tpcds_q03/duckdb:parquet 26373109 / 25995732 / +1.5% 38057830 / 36796166 / +3.4% 0.69 / 0.71 / -1.9%
tpcds_q04/duckdb:parquet 205546202 / 203957459 / +0.8% 230331863 / 234181220 / -1.6% 0.89 / 0.87 / +2.5%
tpcds_q05/duckdb:parquet 69582455 / 68357342 / +1.8% 86044117 / 87464497 / -1.6% 0.81 / 0.78 / +3.5%
tpcds_q06/duckdb:parquet 74216467 / 75115975 / -1.2% 91402221 / 89166769 / +2.5% 0.81 / 0.84 / -3.6%
tpcds_q07/duckdb:parquet 62471892 / 62193874 / +0.4% 78314826 / 76707973 / +2.1% 0.80 / 0.81 / -1.6%
tpcds_q08/duckdb:parquet 38317937 / 38663366 / -0.9% 46273075 / 46394278 / -0.3% 0.83 / 0.83 / -0.6%
tpcds_q09/duckdb:parquet 86362135 / 87080988 / -0.8% 98020048 / 101981323 / -3.9% 0.88 / 0.85 / +3.2%
tpcds_q10/duckdb:parquet 51691816 / 52520572 / -1.6% 61987161 / 62695229 / -1.1% 0.83 / 0.84 / -0.5%
tpcds_q11/duckdb:parquet 158456940 / 159415788 / -0.6% 169801776 / 164104249 / +3.5% 0.93 / 0.97 / -3.9%
tpcds_q12/duckdb:parquet 40350270 / 40814548 / -1.1% 48578419 / 48941959 / -0.7% 0.83 / 0.83 / -0.4%
tpcds_q13/duckdb:parquet 68718887 / 69804706 / -1.6% 89889051 / 87793121 / +2.4% 0.76 / 0.80 / -3.9%
tpcds_q14/duckdb:parquet 183339658 / 185753765 / -1.3% 201499506 / 202864595 / -0.7% 0.91 / 0.92 / -0.6%
tpcds_q15/duckdb:parquet 60473056 / 60934452 / -0.8% 68958108 / 69050398 / -0.1% 0.88 / 0.88 / -0.6%
tpcds_q16/duckdb:parquet 37948210 / 37850674 / +0.3% 46743764 / 45839434 / +2.0% 0.81 / 0.83 / -1.7%
tpcds_q17/duckdb:parquet 83180650 / 84076050 / -1.1% 90523104 / 89860905 / +0.7% 0.92 / 0.94 / -1.8%
tpcds_q18/duckdb:parquet 86056786 / 87775860 / -2.0% 96078714 / 98136096 / -2.1% 0.90 / 0.89 / +0.1%
tpcds_q19/duckdb:parquet 48182740 / 47466565 / +1.5% 59356515 / 63007623 / -5.8% 0.81 / 0.75 / +7.8%
tpcds_q20/duckdb:parquet 42031155 / 42342882 / -0.7% 48412738 / 48573403 / -0.3% 0.87 / 0.87 / -0.4%
tpcds_q21/duckdb:parquet 23790392 / 23962194 / -0.7% 28282693 / 28440652 / -0.6% 0.84 / 0.84 / -0.2%
tpcds_q22/duckdb:parquet 166965678 / 166072912 / +0.5% 169622358 / 167098902 / +1.5% 0.98 / 0.99 / -1.0%
tpcds_q23/duckdb:parquet 184681671 / 188036546 / -1.8% 196476792 / 193148517 / +1.7% 0.94 / 0.97 / -3.4%
tpcds_q24/duckdb:parquet 69260632 / 71146241 / -2.7% 83810834 / 82487151 / +1.6% 0.83 / 0.86 / -4.2%
tpcds_q25/duckdb:parquet 50488748 / 51215258 / -1.4% 61385538 / 61288817 / +0.2% 0.82 / 0.84 / -1.6%
tpcds_q26/duckdb:parquet 42061822 / 42361802 / -0.7% 51969992 / 51343370 / +1.2% 0.81 / 0.83 / -1.9%
tpcds_q27/duckdb:parquet 58198749 / 57111037 / +1.9% 75038141 / 81608147 / -8.1% 0.78 / 0.70 / +10.8%
tpcds_q28/duckdb:parquet 92833206 / 93252698 / -0.4% 106483708 / 112178597 / -5.1% 0.87 / 0.83 / +4.9%
tpcds_q29/duckdb:parquet 83485493 / 83041768 / +0.5% 95562758 / 96583021 / -1.1% 0.87 / 0.86 / +1.6%
tpcds_q30/duckdb:parquet 71925986 / 72470468 / -0.8% 80828999 / 81148208 / -0.4% 0.89 / 0.89 / -0.4%
tpcds_q31/duckdb:parquet 99272314 / 98601462 / +0.7% 110057364 / 111465299 / -1.3% 0.90 / 0.88 / +2.0%
tpcds_q32/duckdb:parquet 18034498 / 18353748 / -1.7% 25725509 / 26590155 / -3.3% 0.70 / 0.69 / +1.6%
tpcds_q33/duckdb:parquet 61832517 / 62367010 / -0.9% 76055543 / 73989561 / +2.8% 0.81 / 0.84 / -3.6%
tpcds_q34/duckdb:parquet 32791562 / 33006494 / -0.7% 40400612 / 41889230 / -3.6% 0.81 / 0.79 / +3.0%
tpcds_q35/duckdb:parquet 76938200 / 77399391 / -0.6% 88595504 / 86087567 / +2.9% 0.87 / 0.90 / -3.4%
tpcds_q36/duckdb:parquet 97701198 / 99335950 / -1.6% 113356073 / 112263590 / +1.0% 0.86 / 0.88 / -2.6%
tpcds_q37/duckdb:parquet 41423664 / 41378236 / +0.1% 46537355 / 47554095 / -2.1% 0.89 / 0.87 / +2.3%
tpcds_q38/duckdb:parquet 74734013 / 76468258 / -2.3% 83581954 / 85294747 / -2.0% 0.89 / 0.90 / -0.3%
tpcds_q39/duckdb:parquet 61180010 / 61661639 / -0.8% 67746644 / 67797634 / -0.1% 0.90 / 0.91 / -0.7%
tpcds_q40/duckdb:parquet 27939222 / 27952642 / -0.0% 35984357 / 36118029 / -0.4% 0.78 / 0.77 / +0.3%
tpcds_q41/duckdb:parquet 20035768 / 20143537 / -0.5% 26428529 / 26266476 / +0.6% 0.76 / 0.77 / -1.1%
tpcds_q42/duckdb:parquet 26771524 / 26999602 / -0.8% 36756238 / 36451419 / +0.8% 0.73 / 0.74 / -1.7%
tpcds_q43/duckdb:parquet 28607626 / 28272378 / +1.2% 33038535 / 35793884 / -7.7% 0.87 / 0.79 / +9.6%
tpcds_q44/duckdb:parquet 60589417 / 60736375 / -0.2% 72865726 / 74562633 / -2.3% 0.83 / 0.81 / +2.1%
tpcds_q45/duckdb:parquet 60559475 / 60622120 / -0.1% 68035378 / 67027287 / +1.5% 0.89 / 0.90 / -1.6%
tpcds_q46/duckdb:parquet 71209788 / 72394963 / -1.6% 90449291 / 88023341 / +2.8% 0.79 / 0.82 / -4.3%
tpcds_q47/duckdb:parquet 90496325 / 90830810 / -0.4% 99222086 / 105146923 / -5.6% 0.91 / 0.86 / +5.6%
tpcds_q48/duckdb:parquet 65975748 / 67648746 / -2.5% 78975154 / 85359866 / -7.5% 0.84 / 0.79 / +5.4%
tpcds_q49/duckdb:parquet 68759196 / 67399774 / +2.0% 91034352 / 92020170 / -1.1% 0.76 / 0.73 / +3.1%
tpcds_q50/duckdb:parquet 45081888 / 45228659 / -0.3% 55473834 / 50910629 / +9.0% 0.81 / 0.89 / -8.5%
tpcds_q51/duckdb:parquet 214987256 / 217340788 / -1.1% 225032565 / 225257376 / -0.1% 0.96 / 0.96 / -1.0%
tpcds_q52/duckdb:parquet 27576783 / 26490668 / +4.1% 38269701 / 37218058 / +2.8% 0.72 / 0.71 / +1.2%
tpcds_q53/duckdb:parquet 35961343 / 34202255 / +5.1% 46977218 / 48232701 / -2.6% 0.77 / 0.71 / +8.0%
tpcds_q54/duckdb:parquet 57083335 / 55357348 / +3.1% 62999589 / 63307482 / -0.5% 0.91 / 0.87 / +3.6%
tpcds_q55/duckdb:parquet 26663540 / 26580602 / +0.3% 37547789 / 38734658 / -3.1% 0.71 / 0.69 / +3.5%
tpcds_q56/duckdb:parquet 68173282 / 68450543 / -0.4% 85649322 / 84208264 / +1.7% 0.80 / 0.81 / -2.1%
tpcds_q57/duckdb:parquet 68172326 / 67905272 / +0.4% 75567136 / 75530496 / +0.0% 0.90 / 0.90 / +0.3%
tpcds_q58/duckdb:parquet 56127390 / 55351262 / +1.4% 67411563 / 67300961 / +0.2% 0.83 / 0.82 / +1.2%
tpcds_q59/duckdb:parquet 61572450 / 61543058 / +0.0% 66904882 / 67498896 / -0.9% 0.92 / 0.91 / +0.9%
tpcds_q60/duckdb:parquet 79853288 / 81154691 / -1.6% 97533131 / 95719978 / +1.9% 0.82 / 0.85 / -3.4%
tpcds_q61/duckdb:parquet 80634008 / 78725636 / +2.4% 93296540 / 94693948 / -1.5% 0.86 / 0.83 / +4.0%
tpcds_q62/duckdb:parquet 19131722 / 21271646 / -10.1% 🟢 24763571 / 24742108 / +0.1% 0.77 / 0.86 / -10.1%
tpcds_q63/duckdb:parquet 34418134 / 33973322 / +1.3% 44949436 / 44293841 / +1.5% 0.77 / 0.77 / -0.2%
tpcds_q64/duckdb:parquet 135255706 / 134987804 / +0.2% 153791160 / 149714203 / +2.7% 0.88 / 0.90 / -2.5%
tpcds_q65/duckdb:parquet 94287444 / 92507762 / +1.9% 93666291 / 106732283 / -12.2% 🟢 1.01 / 0.87 / +16.1%
tpcds_q66/duckdb:parquet 46989738 / 45574203 / +3.1% 55297043 / 52408182 / +5.5% 0.85 / 0.87 / -2.3%
tpcds_q67/duckdb:parquet 294864597 / 294181831 / +0.2% 300918461 / 294225942 / +2.3% 0.98 / 1.00 / -2.0%
tpcds_q68/duckdb:parquet 63064283 / 61610444 / +2.4% 77442171 / 77643526 / -0.3% 0.81 / 0.79 / +2.6%
tpcds_q69/duckdb:parquet 66157516 / 65821270 / +0.5% 75644354 / 75369095 / +0.4% 0.87 / 0.87 / +0.1%
tpcds_q70/duckdb:parquet 43792700 / 42560156 / +2.9% 50725920 / 50824609 / -0.2% 0.86 / 0.84 / +3.1%
tpcds_q71/duckdb:parquet 41191830 / 41353862 / -0.4% 52486751 / 54241063 / -3.2% 0.78 / 0.76 / +2.9%
tpcds_q72/duckdb:parquet 173066203 / 172146606 / +0.5% 186590419 / 189350126 / -1.5% 0.93 / 0.91 / +2.0%
tpcds_q73/duckdb:parquet 28232638 / 27072398 / +4.3% 37260091 / 37030456 / +0.6% 0.76 / 0.73 / +3.6%
tpcds_q74/duckdb:parquet 214114938 / 216089249 / -0.9% 221601395 / 223017657 / -0.6% 0.97 / 0.97 / -0.3%
tpcds_q75/duckdb:parquet 133475646 / 131891024 / +1.2% 148460727 / 152249842 / -2.5% 0.90 / 0.87 / +3.8%
tpcds_q76/duckdb:parquet 50404511 / 51285484 / -1.7% 65238462 / 65205448 / +0.1% 0.77 / 0.79 / -1.8%
tpcds_q77/duckdb:parquet 56964034 / 54841040 / +3.9% 72250992 / 67440836 / +7.1% 0.79 / 0.81 / -3.0%
tpcds_q78/duckdb:parquet 151308618 / 155747874 / -2.9% 162665489 / 168363678 / -3.4% 0.93 / 0.93 / +0.6%
tpcds_q79/duckdb:parquet 55254856 / 51430181 / +7.4% 66820108 / 64568583 / +3.5% 0.83 / 0.80 / +3.8%
tpcds_q80/duckdb:parquet 81571936 / 82941310 / -1.7% 101993912 / 103690804 / -1.6% 0.80 / 0.80 / -0.0%
tpcds_q81/duckdb:parquet 97521944 / 98572923 / -1.1% 106451336 / 104274293 / +2.1% 0.92 / 0.95 / -3.1%
tpcds_q82/duckdb:parquet 45673052 / 46604344 / -2.0% 52571013 / 52315928 / +0.5% 0.87 / 0.89 / -2.5%
tpcds_q83/duckdb:parquet 28360142 / 28152398 / +0.7% 33036508 / 33185714 / -0.4% 0.86 / 0.85 / +1.2%
tpcds_q84/duckdb:parquet 22729531 / 22751552 / -0.1% 29330694 / 29406408 / -0.3% 0.77 / 0.77 / +0.2%
tpcds_q85/duckdb:parquet 51773911 / 52752074 / -1.9% 60140567 / 62960389 / -4.5% 0.86 / 0.84 / +2.7%
tpcds_q86/duckdb:parquet 25320750 / 25146913 / +0.7% 30423408 / 33004413 / -7.8% 0.83 / 0.76 / +9.2%
tpcds_q87/duckdb:parquet 86502773 / 88695797 / -2.5% 87259694 / 92564858 / -5.7% 0.99 / 0.96 / +3.5%
tpcds_q88/duckdb:parquet 102563166 / 106796080 / -4.0% 113907950 / 111229279 / +2.4% 0.90 / 0.96 / -6.2%
tpcds_q89/duckdb:parquet 38054028 / 37846748 / +0.5% 46464563 / 48196620 / -3.6% 0.82 / 0.79 / +4.3%
tpcds_q90/duckdb:parquet 15159624 / 15015242 / +1.0% 20146696 / 20928242 / -3.7% 0.75 / 0.72 / +4.9%
tpcds_q91/duckdb:parquet 25462436 / 25515043 / -0.2% 32791080 / 33274247 / -1.5% 0.78 / 0.77 / +1.3%
tpcds_q92/duckdb:parquet 22302400 / 22329364 / -0.1% 31198873 / 31995562 / -2.5% 0.71 / 0.70 / +2.4%
tpcds_q93/duckdb:parquet 34776240 / 35799040 / -2.9% 46502249 / 49479404 / -6.0% 0.75 / 0.72 / +3.4%
tpcds_q94/duckdb:parquet 38174446 / 38247234 / -0.2% 45137545 / 46965479 / -3.9% 0.85 / 0.81 / +3.9%
tpcds_q95/duckdb:parquet 81908703 / 81409130 / +0.6% 88172259 / 86595751 / +1.8% 0.93 / 0.94 / -1.2%
tpcds_q96/duckdb:parquet 17600858 / 17012262 / +3.5% 22427499 / 24425947 / -8.2% 0.78 / 0.70 / +12.7%
tpcds_q97/duckdb:parquet 75142093 / 73153984 / +2.7% 79516069 / 78153554 / +1.7% 0.94 / 0.94 / +1.0%
tpcds_q98/duckdb:parquet 54814236 / 55289756 / -0.9% 66407416 / 66788134 / -0.6% 0.83 / 0.83 / -0.3%
tpcds_q99/duckdb:parquet 24486440 / 24402862 / +0.3% 32163206 / 30438057 / +5.7% 0.76 / 0.80 / -5.0%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 62adb044 vs base 74c8f9d2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.027x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.014x ➖
Shifts: Parquet (control) -0.0% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 92318287 / 92177346 / +0.2% 157112203 / 156197099 / +0.6% 0.59 / 0.59 / -0.4%
tpch_q02/datafusion:vortex-file-compressed 64487600 / 64428754 / +0.1% 100271601 / 94872596 / +5.7% 0.64 / 0.68 / -5.3%
tpch_q03/datafusion:vortex-file-compressed 63076342 / 64151894 / -1.7% 120181130 / 126780702 / -5.2% 0.52 / 0.51 / +3.7%
tpch_q04/datafusion:vortex-file-compressed 34272969 / 35028676 / -2.2% 73567329 / 68466710 / +7.4% 0.47 / 0.51 / -8.9%
tpch_q05/datafusion:vortex-file-compressed 116209102 / 118900162 / -2.3% 185357199 / 185439522 / -0.0% 0.63 / 0.64 / -2.2%
tpch_q06/datafusion:vortex-file-compressed 9531657 / 9649196 / -1.2% 59244436 / 57652551 / +2.8% 0.16 / 0.17 / -3.9%
tpch_q07/datafusion:vortex-file-compressed 98130717 / 97449767 / +0.7% 153390425 / 161011516 / -4.7% 0.64 / 0.61 / +5.7%
tpch_q08/datafusion:vortex-file-compressed 141429332 / 142206475 / -0.5% 221181993 / 226695985 / -2.4% 0.64 / 0.63 / +1.9%
tpch_q09/datafusion:vortex-file-compressed 184158920 / 182840408 / +0.7% 263422626 / 275147335 / -4.3% 0.70 / 0.66 / +5.2%
tpch_q10/datafusion:vortex-file-compressed 71307026 / 70621645 / +1.0% 134960472 / 136262721 / -1.0% 0.53 / 0.52 / +1.9%
tpch_q11/datafusion:vortex-file-compressed 45766625 / 45658051 / +0.2% 71647670 / 72364105 / -1.0% 0.64 / 0.63 / +1.2%
tpch_q12/datafusion:vortex-file-compressed 35193392 / 35235879 / -0.1% 81157735 / 79705799 / +1.8% 0.43 / 0.44 / -1.9%
tpch_q13/datafusion:vortex-file-compressed 49483024 / 48598467 / +1.8% 81541831 / 87210304 / -6.5% 0.61 / 0.56 / +8.9%
tpch_q14/datafusion:vortex-file-compressed 20592898 / 20650370 / -0.3% 87084353 / 88048054 / -1.1% 0.24 / 0.23 / +0.8%
tpch_q15/datafusion:vortex-file-compressed 32879046 / 33753614 / -2.6% 92615573 / 90785220 / +2.0% 0.36 / 0.37 / -4.5%
tpch_q16/datafusion:vortex-file-compressed 37255157 / 36919743 / +0.9% 66988055 / 65843812 / +1.7% 0.56 / 0.56 / -0.8%
tpch_q17/datafusion:vortex-file-compressed 176037911 / 176998771 / -0.5% 236760064 / 239755261 / -1.2% 0.74 / 0.74 / +0.7%
tpch_q18/datafusion:vortex-file-compressed 203778403 / 207996354 / -2.0% 269018893 / 275106107 / -2.2% 0.76 / 0.76 / +0.2%
tpch_q19/datafusion:vortex-file-compressed 28296137 / 28526869 / -0.8% 85333802 / 87666580 / -2.7% 0.33 / 0.33 / +1.9%
tpch_q20/datafusion:vortex-file-compressed 60957283 / 61936223 / -1.6% 117990142 / 118852369 / -0.7% 0.52 / 0.52 / -0.9%
tpch_q21/datafusion:vortex-file-compressed 179954752 / 182704046 / -1.5% 237579438 / 234984863 / +1.1% 0.76 / 0.78 / -2.6%
tpch_q22/datafusion:vortex-file-compressed 25776446 / 25513774 / +1.0% 55110288 / 55406439 / -0.5% 0.47 / 0.46 / +1.6%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 86900847 / 87311538 / -0.5% 124210758 / 122516163 / +1.4% 0.70 / 0.71 / -1.8%
tpch_q02/datafusion:parquet 173560122 / 174735537 / -0.7% 199138023 / 198265824 / +0.4% 0.87 / 0.88 / -1.1%
tpch_q03/datafusion:parquet 134625231 / 135233090 / -0.4% 181136213 / 179364012 / +1.0% 0.74 / 0.75 / -1.4%
tpch_q04/datafusion:parquet 56712858 / 56985913 / -0.5% 91347028 / 85885070 / +6.4% 0.62 / 0.66 / -6.4%
tpch_q05/datafusion:parquet 166442995 / 166291221 / +0.1% 222330779 / 214896169 / +3.5% 0.75 / 0.77 / -3.3%
tpch_q06/datafusion:parquet 36157846 / 36510562 / -1.0% 75133378 / 72908306 / +3.1% 0.48 / 0.50 / -3.9%
tpch_q07/datafusion:parquet 215638121 / 215778947 / -0.1% 267475484 / 260314182 / +2.8% 0.81 / 0.83 / -2.7%
tpch_q08/datafusion:parquet 218464163 / 216791369 / +0.8% 286759632 / 278971702 / +2.8% 0.76 / 0.78 / -2.0%
tpch_q09/datafusion:parquet 309376545 / 307685989 / +0.5% 379051788 / 369588127 / +2.6% 0.82 / 0.83 / -2.0%
tpch_q10/datafusion:parquet 311507149 / 311954014 / -0.1% 369898906 / 359417304 / +2.9% 0.84 / 0.87 / -3.0%
tpch_q11/datafusion:parquet 127698845 / 127035714 / +0.5% 149952551 / 149936598 / +0.0% 0.85 / 0.85 / +0.5%
tpch_q12/datafusion:parquet 81793034 / 82433202 / -0.8% 115905721 / 116835758 / -0.8% 0.71 / 0.71 / +0.0%
tpch_q13/datafusion:parquet 210685053 / 210618688 / +0.0% 238703861 / 238788117 / -0.0% 0.88 / 0.88 / +0.1%
tpch_q14/datafusion:parquet 85444352 / 85602024 / -0.2% 193491021 / 186569859 / +3.7% 0.44 / 0.46 / -3.8%
tpch_q15/datafusion:parquet 106133762 / 106606603 / -0.4% 153069711 / 154598932 / -1.0% 0.69 / 0.69 / +0.6%
tpch_q16/datafusion:parquet 95261683 / 94683007 / +0.6% 121503263 / 123221265 / -1.4% 0.78 / 0.77 / +2.0%
tpch_q17/datafusion:parquet 214562198 / 215630850 / -0.5% 261774763 / 257798988 / +1.5% 0.82 / 0.84 / -2.0%
tpch_q18/datafusion:parquet 267661338 / 267541314 / +0.0% 314961499 / 318452912 / -1.1% 0.85 / 0.84 / +1.2%
tpch_q19/datafusion:parquet 107820299 / 108282497 / -0.4% 167020212 / 164045798 / +1.8% 0.65 / 0.66 / -2.2%
tpch_q20/datafusion:parquet 185708842 / 185298197 / +0.2% 251152139 / 237189433 / +5.9% 0.74 / 0.78 / -5.4%
tpch_q21/datafusion:parquet 243665882 / 244268713 / -0.2% 308480404 / 306493573 / +0.6% 0.79 / 0.80 / -0.9%
tpch_q22/datafusion:parquet 149857605 / 149723897 / +0.1% 175759565 / 171986203 / +2.2% 0.85 / 0.87 / -2.1%
duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 33124073 / 33162813 / -0.1% 74222279 / 60965941 / +21.7% 🔴 0.45 / 0.54 / -18.0%
tpch_q02/duckdb:vortex-file-compressed 28470424 / 28441284 / +0.1% 42354106 / 42490796 / -0.3% 0.67 / 0.67 / +0.4%
tpch_q03/duckdb:vortex-file-compressed 52492408 / 51806352 / +1.3% 107257971 / 96181102 / +11.5% 🔴 0.49 / 0.54 / -9.1%
tpch_q04/duckdb:vortex-file-compressed 51703488 / 51520893 / +0.4% 91328072 / 83080389 / +9.9% 0.57 / 0.62 / -8.7%
tpch_q05/duckdb:vortex-file-compressed 68345030 / 68278233 / +0.1% 111309286 / 110549285 / +0.7% 0.61 / 0.62 / -0.6%
tpch_q06/duckdb:vortex-file-compressed 14867237 / 14995905 / -0.9% 54208331 / 49678736 / +9.1% 0.27 / 0.30 / -9.1%
tpch_q07/duckdb:vortex-file-compressed 54412156 / 55095502 / -1.2% 111530421 / 99927713 / +11.6% 🔴 0.49 / 0.55 / -11.5%
tpch_q08/duckdb:vortex-file-compressed 84933183 / 84730600 / +0.2% 137410440 / 128300677 / +7.1% 0.62 / 0.66 / -6.4%
tpch_q09/duckdb:vortex-file-compressed 102935139 / 102680463 / +0.2% 155083377 / 149752209 / +3.6% 0.66 / 0.69 / -3.2%
tpch_q10/duckdb:vortex-file-compressed 95513041 / 95736829 / -0.2% 149503317 / 145772381 / +2.6% 0.64 / 0.66 / -2.7%
tpch_q11/duckdb:vortex-file-compressed 13279039 / 13161487 / +0.9% 28429008 / 28614710 / -0.6% 0.47 / 0.46 / +1.6%
tpch_q12/duckdb:vortex-file-compressed 44870050 / 45171630 / -0.7% 83116714 / 74559415 / +11.5% 🔴 0.54 / 0.61 / -10.9%
tpch_q13/duckdb:vortex-file-compressed 70626219 / 71277113 / -0.9% 102893155 / 98751212 / +4.2% 0.69 / 0.72 / -4.9%
tpch_q14/duckdb:vortex-file-compressed 27663645 / 27742167 / -0.3% 74445718 / 68588058 / +8.5% 0.37 / 0.40 / -8.1%
tpch_q15/duckdb:vortex-file-compressed 23884637 / 24169914 / -1.2% 66796060 / 62760479 / +6.4% 0.36 / 0.39 / -7.2%
tpch_q16/duckdb:vortex-file-compressed 49066537 / 49823920 / -1.5% 60270048 / 58191998 / +3.6% 0.81 / 0.86 / -4.9%
tpch_q17/duckdb:vortex-file-compressed 35551918 / 34928738 / +1.8% 69532986 / 64550565 / +7.7% 0.51 / 0.54 / -5.5%
tpch_q18/duckdb:vortex-file-compressed 109806100 / 102866087 / +6.7% 125318888 / 121696816 / +3.0% 0.88 / 0.85 / +3.7%
tpch_q19/duckdb:vortex-file-compressed 27626552 / 27489534 / +0.5% 76472788 / 76106199 / +0.5% 0.36 / 0.36 / +0.0%
tpch_q20/duckdb:vortex-file-compressed 41191771 / 41385355 / -0.5% 91204459 / 88937430 / +2.5% 0.45 / 0.47 / -2.9%
tpch_q21/duckdb:vortex-file-compressed 92984537 / 92643489 / +0.4% 148706309 / 140692444 / +5.7% 0.63 / 0.66 / -5.0%
tpch_q22/duckdb:vortex-file-compressed 33396779 / 33019958 / +1.1% 49574895 / 47168881 / +5.1% 0.67 / 0.70 / -3.8%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67667803 / 68061708 / -0.6% 89524337 / 88188170 / +1.5% 0.76 / 0.77 / -2.1%
tpch_q02/duckdb:parquet 86684783 / 87254980 / -0.7% 97474346 / 98880371 / -1.4% 0.89 / 0.88 / +0.8%
tpch_q03/duckdb:parquet 109903403 / 110221645 / -0.3% 143348517 / 141238280 / +1.5% 0.77 / 0.78 / -1.8%
tpch_q04/duckdb:parquet 76618751 / 76532636 / +0.1% 99256776 / 97762896 / +1.5% 0.77 / 0.78 / -1.4%
tpch_q05/duckdb:parquet 126643537 / 123479542 / +2.6% 157217863 / 155668079 / +1.0% 0.81 / 0.79 / +1.6%
tpch_q06/duckdb:parquet 35410037 / 35931981 / -1.5% 58312444 / 56977323 / +2.3% 0.61 / 0.63 / -3.7%
tpch_q07/duckdb:parquet 118793255 / 119339250 / -0.5% 156012585 / 153627189 / +1.6% 0.76 / 0.78 / -2.0%
tpch_q08/duckdb:parquet 147413078 / 147255450 / +0.1% 192945680 / 190628929 / +1.2% 0.76 / 0.77 / -1.1%
tpch_q09/duckdb:parquet 237610008 / 235578554 / +0.9% 278815984 / 276803702 / +0.7% 0.85 / 0.85 / +0.1%
tpch_q10/duckdb:parquet 315525338 / 313587478 / +0.6% 340231308 / 337403692 / +0.8% 0.93 / 0.93 / -0.2%
tpch_q11/duckdb:parquet 43574893 / 43490479 / +0.2% 50777348 / 50005616 / +1.5% 0.86 / 0.87 / -1.3%
tpch_q12/duckdb:parquet 70998976 / 70505417 / +0.7% 91000761 / 90007679 / +1.1% 0.78 / 0.78 / -0.4%
tpch_q13/duckdb:parquet 293179852 / 293441858 / -0.1% 306686762 / 310736944 / -1.3% 0.96 / 0.94 / +1.2%
tpch_q14/duckdb:parquet 102058085 / 101133653 / +0.9% 135654898 / 136327535 / -0.5% 0.75 / 0.74 / +1.4%
tpch_q15/duckdb:parquet 57479014 / 57306184 / +0.3% 86522481 / 84972419 / +1.8% 0.66 / 0.67 / -1.5%
tpch_q16/duckdb:parquet 101127543 / 100633707 / +0.5% 107951884 / 107203047 / +0.7% 0.94 / 0.94 / -0.2%
tpch_q17/duckdb:parquet 81945776 / 83962666 / -2.4% 111847788 / 110031995 / +1.7% 0.73 / 0.76 / -4.0%
tpch_q18/duckdb:parquet 159825601 / 157083225 / +1.7% 178946098 / 172862922 / +3.5% 0.89 / 0.91 / -1.7%
tpch_q19/duckdb:parquet 98287862 / 98792583 / -0.5% 130097520 / 130377546 / -0.2% 0.76 / 0.76 / -0.3%
tpch_q20/duckdb:parquet 147544394 / 146971997 / +0.4% 185200318 / 181619680 / +2.0% 0.80 / 0.81 / -1.6%
tpch_q21/duckdb:parquet 250793842 / 254756250 / -1.6% 283716764 / 271034790 / +4.7% 0.88 / 0.94 / -6.0%
tpch_q22/duckdb:parquet 168921678 / 168406469 / +0.3% 180098701 / 179252698 / +0.5% 0.94 / 0.94 / -0.2%

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant