Skip to content

Default DuckDB to Scan V2 and optimize sparse and wide scans - #10964

Draft
joseph-isaacs wants to merge 28 commits into
developfrom
ji/codex/scan-v2-topk-feedback
Draft

joseph-isaacs wants to merge 28 commits into
developfrom
ji/codex/scan-v2-topk-feedback

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

V2 benefits from amortized planning and reads, but oversized materialization and duplicated setup can delay consumers. This PR sizes narrow and wide work separately, preserves stored projection pieces, and overlaps DuckDB reads across two active work items per thread.

DuckDB extension scans default to V2; VORTEX_SCAN_V2=0 restores V1. Benchmark binaries retain --scan-v1 false for V2 and --scan-v1 true for V1.

  • Fixed-width filter/projection references totaling at most 32 bytes per row use 1,048,576-row work; wider or variable-width filters use 131,072 rows. Sequential projections preserve stored pieces, while sparse random access keeps bounded gathering.
  • DataFusion converts narrow fixed-width output (at most 16 bytes per row) in batches of at most 65,536 rows. Small pieces retain move ownership; wide and variable-width output preserves stored boundaries.
  • Narrow unfiltered DataFusion byte partitions share 65,536-row boundaries, reducing preparation on small dimensions. Filtered and wide partitions keep the 8,192-row grid. Adjacent partitions cover every row exactly once.
  • Sorted segment locations reuse existing storage for range lookup; unordered locations keep indexed lookup. Duplicate ranges preserve the last segment ID.
  • DataFusion preserves default overlapping execution. Each admitted root owns an I/O session so retiring one root preserves another root’s pending reads. Explicit inline execution stays on one task across I/O waits.

Sparse payload retrieval preserves exact file/row pairs and gathers referenced dictionary entries before conversion. Dynamic bounds refresh before projection, dictionaries retain chunk boundaries, and scans preserve requested column order. The optional startup budget remains disabled by default. These paths use existing filters and compute operations.

Actions evidence

Run 41673564950 is complete for head ac26753966cfcc66c758ed32d2f0e336b1386f67 and pinned develop 7146a1b31783b6609c5de7f08652fb5416ac3fbd. Four cases completed successfully; TPC-DS SF50 is incomplete because baseline DuckDB Q64 exhausted 150.6 GiB.

Suite Engine V2 / baseline V2 (95% interval) V2 / V1 in same binary (95% interval)
TPC-H SF10, 22/22 duckdb 0.961 (0.953–0.968), improved 0.904 (0.897–0.913), improved
TPC-H SF10, 22/22 datafusion 0.985 (0.981–0.990), improved 1.002 (0.998–1.007), unclear
TPC-H SF50, 22/22 duckdb 0.911 (0.908–0.915), improved 0.833 (0.829–0.837), improved
TPC-H SF50, 22/22 datafusion 0.976 (0.973–0.979), improved 0.979 (0.976–0.982), improved
ClickBench, 43/43 duckdb 0.943 (0.939–0.948), improved 0.980 (0.976–0.985), improved
ClickBench, 43/43 datafusion 0.989 (0.984–0.992), improved 1.007 (1.002–1.010), regressed
TPC-DS SF10, 99/99 duckdb 1.001 (0.998–1.005), unclear 0.995 (0.991–0.998), improved
TPC-DS SF10, 99/99 datafusion 1.005 (1.002–1.007), regressed 0.993 (0.991–0.994), improved
TPC-DS SF50, 98/99 incomplete duckdb 0.959 (0.955–0.963), improved 0.931 (0.928–0.936), improved
TPC-DS SF50, 99/99 datafusion 0.980 (0.977–0.983), improved 0.999 (0.996–1.002), unclear

Ratios are fixed-workload geometric means; below one means faster V2. The within-head comparison holds compute code fixed. The develop baseline includes newer decimal-compare and zip kernels, so the cross-revision comparison also includes compute changes. DataFusion TPC-H SF10 and TPC-DS SF50 remain inconclusive against V1; ClickBench regresses. The full speed objective is not established.

Each case ran sequential base V2, head V2 and head V1 on identical head-prepared inline-metadata files, on a dedicated Graviton 4 host with 94 pinned workers. Non-SF50 cases used four reversed-order rounds, eleven iterations per process and two excluded warmups. SF50 used two rounds of seven iterations and the same warmup exclusion. SF50 processes allow 900 seconds; other cases allow 300 seconds. Source revisions and executable hashes are verified independently of checkout metadata. Artifacts include raw samples, manifests and failed-query logs.

Mental model and remaining limits

Larger scan windows amortize conjunct setup, metadata planning and reads. Smaller Arrow materializations improve narrow decode/cast working sets without reducing the read window. Applying the row bound to wide output had regressed local TPC-H Q1 by 7.5%; restricting it to narrow values retained the approximately 5% ClickBench Q29 benefit and reduced that Q1 difference.

Earlier dedicated profiles, from the verified 6c3 binaries, show less CPU in V2 for TPC-H Q13 and ClickBench Q19 despite worse elapsed time. Q13’s small unfiltered customer scan produced 100 batches versus V1’s 23. This motivates studying setup, scheduling and handoff latency; it does not establish a missing compute kernel.

Develop’s DuckDB cardinality correction resolved the earlier SF10 Q64 OOM; all 99 SF10 queries now complete. SF50 Q64 fails in the current pinned develop baseline before either head variant is measured. Its 98-query DuckDB results cannot describe the full suite.

Bounded local SF50 Q64 checks reach 12 GiB with V1, V2 and Parquet; V2 also reaches that bound with one thread. These controlled stops are not engine OOMs and do not prove what a larger-memory run would do. A single-thread V2 profile, stopped at 8 GiB and symbolicated against exact Rust and DuckDB ELF build IDs, attributes 93.5% of sampled CPU to DuckDB’s hash-aggregate sink and about 0.08% to Vortex’s scan adaptor during the memory-growth phase. Scan read-buffer tuning alone cannot release the engine’s retained group state.

Validation

The measured checkpoint passes all 836 DataFusion library tests, workspace all-target/all-feature Clippy with warnings denied, pinned formatting, strict workflow YAML lint and shell parsing. Sixteen cold/warm-cache repartition cases cover 30K/150K rows and three/eight requested partitions with exact full-file output. Earlier unchanged layout, scan and DuckDB code passed their affected library tests, doctests, and changed C++ formatting checks. The comparison runner’s 13 tests and Python lint/type checks passed.

Additional early-filter handoff, partial-partition work-budget and byte-aware Arrow trials were rejected when paired comparisons did not establish the targeted gains. Temporary benchmark switches are removed from the final source; their samples and signed commits are retained locally for audit.

Keep this PR as a draft. Ordinary CI skips draft PRs, and skipped checks are not passes. The full performance objective remains unmet.

@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 29, 2026
@joseph-isaacs
joseph-isaacs force-pushed the ji/scan-v2-clickbench-tpcds branch from e503266 to f0752c6 Compare October 29, 2026 14:44
@codspeed

codspeed Bot commented Oct 29, 2026 •

Copy link
Copy Markdown

Merging this PR will degrade performance by 5.77%

2 warnings

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ 3 benchmarks with a significant change ran in a different software environment

Their base and head results were measured with a different OS or toolchain, such as compiler, runtime or library versions, so the changes might come from this difference rather than from the code. Open an affected benchmark to see what changed.

See affected benchmarks

⚡ 4 improved benchmarks
❌ 6 regressed benchmarks
✅ 2308 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ CPU Simulation filter_powerlaw_by_random[10000] 993.7 ns 1,300.8 ns -23.61%
❌ CPU Simulation bench_compare_varbin[(50000, 2)] 132.2 µs 162.1 µs -18.45%
❌ CPU Simulation bench_compare_varbin[(50000, 64)] 134.2 µs 164 µs -18.2%
❌ CPU Simulation bench_compare_sliced_dict_varbinview[(7500, 10000)] 199.3 µs 227.7 µs -12.47%
❌ CPU Simulation bench_compare_sliced_dict_varbinview[(1000, 10000)] 77.8 µs 88.8 µs -12.4%
❌ CPU Simulation bench_compare_sliced_dict_varbinview[(10000, 10000)] 205.6 µs 234 µs -12.15%
⚡ CPU Simulation take_filter_primitive_small_uncached_random_mask_random_indices[4096, 10] 23.9 µs 20.7 µs +15.63%
⚡ CPU Simulation test_repeated_scan_filter[int] 2.4 ms 2.1 ms +12.96%
⚡ CPU Simulation test_scan_filter_to_arrow_array[int] 2.8 ms 2.5 ms +11.25%
⚡ CPU Simulation test_scan_filter[int] 2.9 ms 2.6 ms +10.69%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ji/codex/scan-v2-topk-feedback (7dcaf56) with develop (7baa376)

Open in CodSpeed

@joseph-isaacs
joseph-isaacs force-pushed the ji/codex/scan-v2-topk-feedback branch from 47bbb02 to e1d38d8 Compare October 29, 2026 15:11
@joseph-isaacs joseph-isaacs added the changelog/performance A performance improvement label Oct 29, 2026 — with ChatGPT Codex Connector
Base automatically changed from ji/scan-v2-clickbench-tpcds to develop October 29, 2026 15:21
@joseph-isaacs
joseph-isaacs force-pushed the ji/codex/scan-v2-topk-feedback branch from e1d38d8 to d3f067e Compare October 29, 2026 15:32
@joseph-isaacs joseph-isaacs removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 29, 2026
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 29, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 29, 2026
@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 18748c5 clickbench-nvme 1 Explore Profiling Data
🟢 Done 18748c5 fineweb 1 Explore Profiling Data
🟢 Done 18748c5 polarsignals 1 Explore Profiling Data
🟢 Done 18748c5 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 18748c5 tpch-s3 1 Explore Profiling Data
🟢 Done 18748c5 tpcds-nvme 1 Explore Profiling Data
🟢 Done 18748c5 tpch-nvme 1 Explore Profiling Data
Previous Runs (63)
Status Commit Job Attempt Link
🟢 Done 7dcaf56 clickbench-nvme 1 Explore Profiling Data
🟢 Done 7dcaf56 polarsignals 1 Explore Profiling Data
🟢 Done 7dcaf56 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 7dcaf56 fineweb 1 Explore Profiling Data
🟢 Done 7dcaf56 tpch-s3 1 Explore Profiling Data
🟢 Done 7dcaf56 tpch-nvme 1 Explore Profiling Data
🟢 Done 7dcaf56 tpcds-nvme 1 Explore Profiling Data
🟢 Done 1f41995 clickbench-nvme 1 Explore Profiling Data
🟢 Done 1f41995 polarsignals 1 Explore Profiling Data
🟢 Done 1f41995 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 1f41995 tpcds-nvme 1 Explore Profiling Data
🟢 Done 1f41995 fineweb 1 Explore Profiling Data
🟢 Done 1f41995 tpch-s3 1 Explore Profiling Data
🟢 Done 1f41995 tpch-nvme 1 Explore Profiling Data
🟢 Done 026e354 clickbench-nvme 1 Explore Profiling Data
🟢 Done 026e354 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 026e354 polarsignals 1 Explore Profiling Data
🟢 Done 026e354 tpcds-nvme 1 Explore Profiling Data
🟢 Done 026e354 fineweb 1 Explore Profiling Data
🟢 Done 026e354 tpch-s3 1 Explore Profiling Data
🟢 Done 026e354 tpch-nvme 1 Explore Profiling Data
🟢 Done 3b3f8d8 clickbench-nvme 1 Explore Profiling Data
🟢 Done 3b3f8d8 tpch-s3 1 Explore Profiling Data
🟢 Done 3b3f8d8 polarsignals 1 Explore Profiling Data
🟢 Done 3b3f8d8 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 3b3f8d8 fineweb 1 Explore Profiling Data
🟢 Done 3b3f8d8 tpch-nvme 1 Explore Profiling Data
🟢 Done 3b3f8d8 tpcds-nvme 1 Explore Profiling Data
🟢 Done 92b8101 clickbench-nvme 1 Explore Profiling Data
🟢 Done 92b8101 polarsignals 1 Explore Profiling Data
🟢 Done 92b8101 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 92b8101 tpch-s3 1 Explore Profiling Data
🟢 Done 92b8101 tpch-nvme 1 Explore Profiling Data
🟢 Done 92b8101 tpcds-nvme 1 Explore Profiling Data
🟢 Done 92b8101 fineweb 1 Explore Profiling Data
🟢 Done dc98c59 clickbench-nvme 1 Explore Profiling Data
🟢 Done dc98c59 tpch-nvme-10 1 Explore Profiling Data
🟢 Done dc98c59 polarsignals 1 Explore Profiling Data
🟢 Done dc98c59 tpch-s3 1 Explore Profiling Data
🟢 Done dc98c59 fineweb 1 Explore Profiling Data
🟢 Done dc98c59 tpch-nvme 1 Explore Profiling Data
🟢 Done dc98c59 tpcds-nvme 1 Explore Profiling Data
🟢 Done 83d5434 clickbench-nvme 1 Explore Profiling Data
🟢 Done 83d5434 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 83d5434 polarsignals 1 Explore Profiling Data
🟢 Done 83d5434 fineweb 1 Explore Profiling Data
🟢 Done 83d5434 tpcds-nvme 1 Explore Profiling Data
🟢 Done 83d5434 tpch-nvme 1 Explore Profiling Data
🟢 Done 83d5434 tpch-s3 1 Explore Profiling Data
🟢 Done 5799b04 clickbench-nvme 2 Explore Profiling Data
🟢 Done 5799b04 tpch-nvme-10 2 Explore Profiling Data
🟢 Done 5799b04 polarsignals 2 Explore Profiling Data
🟢 Done 5799b04 fineweb 2 Explore Profiling Data
🟢 Done 5799b04 tpch-s3 2 Explore Profiling Data
🟢 Done 5799b04 tpch-nvme 2 Explore Profiling Data
🟢 Done 5799b04 tpcds-nvme 2 Explore Profiling Data
🟢 Done d3f067e polarsignals 2 Explore Profiling Data
🟢 Done d3f067e tpch-nvme-10 2 Explore Profiling Data
🟢 Done d3f067e fineweb 2 Explore Profiling Data
🟢 Done d3f067e tpch-nvme 2 Explore Profiling Data
🟢 Done d3f067e tpcds-nvme 1 Explore Profiling Data
🟢 Done d3f067e clickbench-nvme 1 Explore Profiling Data
🟢 Done d3f067e tpch-s3 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 18748c51 vs base 7d003295
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -4.6%
Engines: DataFusion No clear signal (-13.6%, environment too noisy confidence) · DuckDB No clear signal (+5.3%, environment too noisy confidence)
Vortex (geomean): hot 0.946x ➖ · cold 0.999x ➖
Parquet (geomean): hot 0.991x ➖ · cold 0.899x ➖
Shifts: Parquet (control) -0.9% · Median polish -1.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.886x ➖, 3↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 215890583 / 216750270 / -0.4% 791394131 / 556783145 / +42.1% 🔴 0.27 / 0.39 / -29.9%
tpch_q02/datafusion:vortex-file-compressed 319627555 / 436608137 / -26.8% 625099118 / 636120064 / -1.7% 0.51 / 0.69 / -25.5%
tpch_q03/datafusion:vortex-file-compressed 438586553 / 355313556 / +23.4% 1110197706 / 1073278980 / +3.4% 0.40 / 0.33 / +19.3%
tpch_q04/datafusion:vortex-file-compressed 215690999 / 208298806 / +3.5% 431462701 / 393295027 / +9.7% 0.50 / 0.53 / -5.6%
tpch_q05/datafusion:vortex-file-compressed 489558384 / 625490964 / -21.7% 845693758 / 898660400 / -5.9% 0.58 / 0.70 / -16.8%
tpch_q06/datafusion:vortex-file-compressed 142136583 / 402014841 / -64.6% 🟢 287803859 / 502897243 / -42.8% 🟢 0.49 / 0.80 / -38.2%
tpch_q07/datafusion:vortex-file-compressed 378109622 / 425649930 / -11.2% 601194254 / 591461794 / +1.6% 0.63 / 0.72 / -12.6%
tpch_q08/datafusion:vortex-file-compressed 411265033 / 584628118 / -29.7% 597060113 / 721200659 / -17.2% 0.69 / 0.81 / -15.0%
tpch_q09/datafusion:vortex-file-compressed 337599471 / 292111564 / +15.6% 500187063 / 534838084 / -6.5% 0.67 / 0.55 / +23.6%
tpch_q10/datafusion:vortex-file-compressed 376791327 / 356436703 / +5.7% 494508949 / 575447430 / -14.1% 0.76 / 0.62 / +23.0%
tpch_q11/datafusion:vortex-file-compressed 286516965 / 263789593 / +8.6% 563344549 / 422563694 / +33.3% 🔴 0.51 / 0.62 / -18.5%
tpch_q12/datafusion:vortex-file-compressed 244983556 / 220444295 / +11.1% 574282546 / 430166578 / +33.5% 🔴 0.43 / 0.51 / -16.8%
tpch_q13/datafusion:vortex-file-compressed 138246281 / 131088053 / +5.5% 348845649 / 324725500 / +7.4% 0.40 / 0.40 / -1.8%
tpch_q14/datafusion:vortex-file-compressed 176750026 / 167187292 / +5.7% 330963503 / 321469658 / +3.0% 0.53 / 0.52 / +2.7%
tpch_q15/datafusion:vortex-file-compressed 326323241 / 304625741 / +7.1% 594347749 / 526234509 / +12.9% 0.55 / 0.58 / -5.2%
tpch_q16/datafusion:vortex-file-compressed 127199770 / 130683114 / -2.7% 279887838 / 590918996 / -52.6% 🟢 0.45 / 0.22 / +105.5%
tpch_q17/datafusion:vortex-file-compressed 234001319 / 536359194 / -56.4% 🟢 417423625 / 607050808 / -31.2% 🟢 0.56 / 0.88 / -36.6%
tpch_q18/datafusion:vortex-file-compressed 281484995 / 524200611 / -46.3% 🟢 539722995 / 477723283 / +13.0% 0.52 / 1.10 / -52.5%
tpch_q19/datafusion:vortex-file-compressed 236889703 / 300389896 / -21.1% 364582877 / 466966023 / -21.9% 0.65 / 0.64 / +1.0%
tpch_q20/datafusion:vortex-file-compressed 296111039 / 297339730 / -0.4% 529426428 / 468823878 / +12.9% 0.56 / 0.63 / -11.8%
tpch_q21/datafusion:vortex-file-compressed 707942125 / 448726460 / +57.8% 🔴 838357532 / 628177171 / +33.5% 🔴 0.84 / 0.71 / +18.2%
tpch_q22/datafusion:vortex-file-compressed 151937821 / 176301981 / -13.8% 450391510 / 501137705 / -10.1% 0.34 / 0.35 / -4.1%
datafusion / parquet / ns (1.025x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 151499708 / 233676105 / -35.2% 🟢 455387130 / 533573370 / -14.7% 0.33 / 0.44 / -24.0%
tpch_q02/datafusion:parquet 447425569 / 282590991 / +58.3% 🔴 585814869 / 536730418 / +9.1% 0.76 / 0.53 / +45.1%
tpch_q03/datafusion:parquet 252337785 / 284727337 / -11.4% 785013712 / 701204751 / +12.0% 0.32 / 0.41 / -20.8%
tpch_q04/datafusion:parquet 138635656 / 143894206 / -3.7% 300534918 / 307515259 / -2.3% 0.46 / 0.47 / -1.4%
tpch_q05/datafusion:parquet 349167596 / 342924207 / +1.8% 529227762 / 547548538 / -3.3% 0.66 / 0.63 / +5.3%
tpch_q06/datafusion:parquet 119054215 / 112247367 / +6.1% 277185967 / 228734460 / +21.2% 0.43 / 0.49 / -12.5%
tpch_q07/datafusion:parquet 588220085 / 321368309 / +83.0% 🔴 727399068 / 494899141 / +47.0% 🔴 0.81 / 0.65 / +24.5%
tpch_q08/datafusion:parquet 463390263 / 400924512 / +15.6% 727057116 / 519232221 / +40.0% 🔴 0.64 / 0.77 / -17.5%
tpch_q09/datafusion:parquet 401284806 / 409500216 / -2.0% 556429189 / 624900494 / -11.0% 0.72 / 0.66 / +10.1%
tpch_q10/datafusion:parquet 310065128 / 308837362 / +0.4% 526217360 / 443885338 / +18.5% 0.59 / 0.70 / -15.3%
tpch_q11/datafusion:parquet 260233661 / 252035759 / +3.3% 379736519 / 2842374377 / -86.6% 🟢 0.69 / 0.09 / +672.9%
tpch_q12/datafusion:parquet 178092634 / 155933486 / +14.2% 288222063 / 295600165 / -2.5% 0.62 / 0.53 / +17.1%
tpch_q13/datafusion:parquet 271784923 / 274403826 / -1.0% 391366317 / 455754984 / -14.1% 0.69 / 0.60 / +15.3%
tpch_q14/datafusion:parquet 156954373 / 151256130 / +3.8% 267548404 / 288171178 / -7.2% 0.59 / 0.52 / +11.8%
tpch_q15/datafusion:parquet 309318534 / 297520063 / +4.0% 510421062 / 565692575 / -9.8% 0.61 / 0.53 / +15.2%
tpch_q16/datafusion:parquet 99356721 / 106537660 / -6.7% 210725138 / 210795743 / -0.0% 0.47 / 0.51 / -6.7%
tpch_q17/datafusion:parquet 272131859 / 285338025 / -4.6% 391380163 / 594281217 / -34.1% 🟢 0.70 / 0.48 / +44.8%
tpch_q18/datafusion:parquet 324415717 / 396044421 / -18.1% 494856190 / 600670510 / -17.6% 0.66 / 0.66 / -0.6%
tpch_q19/datafusion:parquet 156325187 / 171392938 / -8.8% 283770764 / 299114536 / -5.1% 0.55 / 0.57 / -3.9%
tpch_q20/datafusion:parquet 239752381 / 254074873 / -5.6% 372945503 / 433563369 / -14.0% 0.64 / 0.59 / +9.7%
tpch_q21/datafusion:parquet 295569713 / 296909972 / -0.5% 492704546 / 458840375 / +7.4% 0.60 / 0.65 / -7.3%
tpch_q22/datafusion:parquet 167584203 / 151769873 / +10.4% 310977556 / 361767699 / -14.0% 0.54 / 0.42 / +28.5%
duckdb / vortex-file-compressed / ns (1.010x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 277954174 / 259058510 / +7.3% 303775380 / 291952504 / +4.0% 0.91 / 0.89 / +3.1%
tpch_q02/duckdb:vortex-file-compressed 378360547 / 425245538 / -11.0% 489836726 / 507857976 / -3.5% 0.77 / 0.84 / -7.8%
tpch_q03/duckdb:vortex-file-compressed 425925176 / 423971636 / +0.5% 484068339 / 619530840 / -21.9% 0.88 / 0.68 / +28.6%
tpch_q04/duckdb:vortex-file-compressed 251685656 / 301748047 / -16.6% 310645862 / 346705778 / -10.4% 0.81 / 0.87 / -6.9%
tpch_q05/duckdb:vortex-file-compressed 633144431 / 531147534 / +19.2% 650267951 / 603044913 / +7.8% 0.97 / 0.88 / +10.5%
tpch_q06/duckdb:vortex-file-compressed 169098370 / 200296388 / -15.6% 215771506 / 360301965 / -40.1% 🟢 0.78 / 0.56 / +41.0%
tpch_q07/duckdb:vortex-file-compressed 413498595 / 441783067 / -6.4% 462350179 / 492358393 / -6.1% 0.89 / 0.90 / -0.3%
tpch_q08/duckdb:vortex-file-compressed 927689866 / 555438824 / +67.0% 🔴 691126477 / 659567571 / +4.8% 1.34 / 0.84 / +59.4%
tpch_q09/duckdb:vortex-file-compressed 417038522 / 421232910 / -1.0% 536592004 / 473775786 / +13.3% 0.78 / 0.89 / -12.6%
tpch_q10/duckdb:vortex-file-compressed 502599662 / 541852417 / -7.2% 572985919 / 523011812 / +9.6% 0.88 / 1.04 / -15.3%
tpch_q11/duckdb:vortex-file-compressed 291155554 / 302602921 / -3.8% 334081048 / 312697815 / +6.8% 0.87 / 0.97 / -9.9%
tpch_q12/duckdb:vortex-file-compressed 268242846 / 244171052 / +9.9% 273839967 / 256270030 / +6.9% 0.98 / 0.95 / +2.8%
tpch_q13/duckdb:vortex-file-compressed 261242219 / 290202531 / -10.0% 275610891 / 273316415 / +0.8% 0.95 / 1.06 / -10.7%
tpch_q14/duckdb:vortex-file-compressed 245308057 / 229588863 / +6.8% 301574708 / 305822268 / -1.4% 0.81 / 0.75 / +8.4%
tpch_q15/duckdb:vortex-file-compressed 250103136 / 247255400 / +1.2% 409804358 / 290279576 / +41.2% 🔴 0.61 / 0.85 / -28.4%
tpch_q16/duckdb:vortex-file-compressed 236430222 / 192296947 / +23.0% 263405058 / 221476641 / +18.9% 0.90 / 0.87 / +3.4%
tpch_q17/duckdb:vortex-file-compressed 324477704 / 382408068 / -15.1% 361167740 / 344348960 / +4.9% 0.90 / 1.11 / -19.1%
tpch_q18/duckdb:vortex-file-compressed 367802047 / 462847652 / -20.5% 443857934 / 450622530 / -1.5% 0.83 / 1.03 / -19.3%
tpch_q19/duckdb:vortex-file-compressed 435442897 / 318050215 / +36.9% 🔴 495514710 / 361858966 / +36.9% 🔴 0.88 / 0.88 / -0.0%
tpch_q20/duckdb:vortex-file-compressed 349164799 / 357263163 / -2.3% 514884009 / 591063093 / -12.9% 0.68 / 0.60 / +12.2%
tpch_q21/duckdb:vortex-file-compressed 647029233 / 737751447 / -12.3% 1069696101 / 711004459 / +50.4% 🔴 0.60 / 1.04 / -41.7%
tpch_q22/duckdb:vortex-file-compressed 257586800 / 241312998 / +6.7% 278222653 / 288754313 / -3.6% 0.93 / 0.84 / +10.8%
duckdb / parquet / ns (0.959x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 177863463 / 201597499 / -11.8% 229787782 / 277793346 / -17.3% 0.77 / 0.73 / +6.7%
tpch_q02/duckdb:parquet 468502992 / 432931882 / +8.2% 448537704 / 480889821 / -6.7% 1.04 / 0.90 / +16.0%
tpch_q03/duckdb:parquet 329658104 / 333322098 / -1.1% 442457867 / 471151329 / -6.1% 0.75 / 0.71 / +5.3%
tpch_q04/duckdb:parquet 234026205 / 226737740 / +3.2% 296579400 / 309677484 / -4.2% 0.79 / 0.73 / +7.8%
tpch_q05/duckdb:parquet 454266515 / 622529540 / -27.0% 482932722 / 655153336 / -26.3% 0.94 / 0.95 / -1.0%
tpch_q06/duckdb:parquet 166679918 / 154217525 / +8.1% 184436864 / 197237271 / -6.5% 0.90 / 0.78 / +15.6%
tpch_q07/duckdb:parquet 445811697 / 458058187 / -2.7% 516931128 / 522050745 / -1.0% 0.86 / 0.88 / -1.7%
tpch_q08/duckdb:parquet 789924097 / 716312070 / +10.3% 671807334 / 671250397 / +0.1% 1.18 / 1.07 / +10.2%
tpch_q09/duckdb:parquet 564221540 / 620991664 / -9.1% 602248717 / 733765576 / -17.9% 0.94 / 0.85 / +10.7%
tpch_q10/duckdb:parquet 541825008 / 572086628 / -5.3% 504823117 / 587862207 / -14.1% 1.07 / 0.97 / +10.3%
tpch_q11/duckdb:parquet 277359663 / 532463692 / -47.9% 🟢 281459180 / 533949980 / -47.3% 🟢 0.99 / 1.00 / -1.2%
tpch_q12/duckdb:parquet 262772149 / 268319526 / -2.1% 285884785 / 246982267 / +15.8% 0.92 / 1.09 / -15.4%
tpch_q13/duckdb:parquet 401265902 / 403764128 / -0.6% 457027878 / 711760491 / -35.8% 🟢 0.88 / 0.57 / +54.8%
tpch_q14/duckdb:parquet 290950556 / 276406662 / +5.3% 298256970 / 329158703 / -9.4% 0.98 / 0.84 / +16.2%
tpch_q15/duckdb:parquet 238630695 / 241296189 / -1.1% 283156964 / 277146797 / +2.2% 0.84 / 0.87 / -3.2%
tpch_q16/duckdb:parquet 293856191 / 293324158 / +0.2% 379784667 / 326012136 / +16.5% 0.77 / 0.90 / -14.0%
tpch_q17/duckdb:parquet 288150023 / 313162920 / -8.0% 334007282 / 600821136 / -44.4% 🟢 0.86 / 0.52 / +65.5%
tpch_q18/duckdb:parquet 424904777 / 346346687 / +22.7% 425842276 / 391406907 / +8.8% 1.00 / 0.88 / +12.8%
tpch_q19/duckdb:parquet 254550077 / 289168771 / -12.0% 345643448 / 338581202 / +2.1% 0.74 / 0.85 / -13.8%
tpch_q20/duckdb:parquet 461702284 / 413957706 / +11.5% 529737327 / 469779197 / +12.8% 0.87 / 0.88 / -1.1%
tpch_q21/duckdb:parquet 489673610 / 465051727 / +5.3% 546655366 / 502708505 / +8.7% 0.90 / 0.93 / -3.2%
tpch_q22/duckdb:parquet 270426404 / 300203572 / -9.9% 284771545 / 321484748 / -11.4% 0.95 / 0.93 / +1.7%

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 18748c51 vs base 7d003295
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.9%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (-5.5%, low confidence)
Vortex (geomean): hot 0.968x ➖ · cold 0.961x ➖
Parquet (geomean): hot 0.997x ➖ · cold 1.004x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.996x ➖, 2↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1235300 / 1238454 / -0.3% 22405106 / 23547718 / -4.9% 0.06 / 0.05 / +4.8%
clickbench_q01/datafusion:vortex-file-compressed 6171668 / 6208950 / -0.6% 30248704 / 30135902 / +0.4% 0.20 / 0.21 / -1.0%
clickbench_q02/datafusion:vortex-file-compressed 10521586 / 10445208 / +0.7% 37094981 / 46944835 / -21.0% 🟢 0.28 / 0.22 / +27.5%
clickbench_q03/datafusion:vortex-file-compressed 13446465 / 13278630 / +1.3% 52677792 / 57542526 / -8.5% 0.26 / 0.23 / +10.6%
clickbench_q04/datafusion:vortex-file-compressed 54843076 / 57386236 / -4.4% 92740977 / 103327852 / -10.2% 🟢 0.59 / 0.56 / +6.5%
clickbench_q05/datafusion:vortex-file-compressed 76506405 / 77080644 / -0.7% 122046064 / 128892530 / -5.3% 0.63 / 0.60 / +4.8%
clickbench_q06/datafusion:vortex-file-compressed 1238219 / 1235509 / +0.2% 22992764 / 22713905 / +1.2% 0.05 / 0.05 / -1.0%
clickbench_q07/datafusion:vortex-file-compressed 9191630 / 9493326 / -3.2% 33847527 / 39548759 / -14.4% 🟢 0.27 / 0.24 / +13.1%
clickbench_q08/datafusion:vortex-file-compressed 73858182 / 81808692 / -9.7% 116375934 / 118796484 / -2.0% 0.63 / 0.69 / -7.8%
clickbench_q09/datafusion:vortex-file-compressed 169321746 / 172657058 / -1.9% 206833201 / 217115811 / -4.7% 0.82 / 0.80 / +2.9%
clickbench_q10/datafusion:vortex-file-compressed 24192209 / 22671834 / +6.7% 73133907 / 71475068 / +2.3% 0.33 / 0.32 / +4.3%
clickbench_q11/datafusion:vortex-file-compressed 24918148 / 25988076 / -4.1% 70815463 / 71876121 / -1.5% 0.35 / 0.36 / -2.7%
clickbench_q12/datafusion:vortex-file-compressed 73768154 / 71768100 / +2.8% 124581142 / 125541208 / -0.8% 0.59 / 0.57 / +3.6%
clickbench_q13/datafusion:vortex-file-compressed 115623694 / 117417514 / -1.5% 183844714 / 182998777 / +0.5% 0.63 / 0.64 / -2.0%
clickbench_q14/datafusion:vortex-file-compressed 75433332 / 73229254 / +3.0% 125994501 / 125787834 / +0.2% 0.60 / 0.58 / +2.8%
clickbench_q15/datafusion:vortex-file-compressed 61089392 / 64163614 / -4.8% 98476957 / 99287748 / -0.8% 0.62 / 0.65 / -4.0%
clickbench_q16/datafusion:vortex-file-compressed 149038504 / 153176414 / -2.7% 207695807 / 217385452 / -4.5% 0.72 / 0.70 / +1.8%
clickbench_q17/datafusion:vortex-file-compressed 150770478 / 155498596 / -3.0% 207948206 / 221605131 / -6.2% 0.73 / 0.70 / +3.3%
clickbench_q18/datafusion:vortex-file-compressed 299968546 / 293195535 / +2.3% 380712243 / 375658734 / +1.3% 0.79 / 0.78 / +1.0%
clickbench_q19/datafusion:vortex-file-compressed 8907704 / 8405504 / +6.0% 46648797 / 49992662 / -6.7% 0.19 / 0.17 / +13.6%
clickbench_q20/datafusion:vortex-file-compressed 66916508 / 66959632 / -0.1% 246848081 / 244622781 / +0.9% 0.27 / 0.27 / -1.0%
clickbench_q21/datafusion:vortex-file-compressed 61193840 / 81068328 / -24.5% 🟢 281228938 / 286223641 / -1.7% 0.22 / 0.28 / -23.2%
clickbench_q22/datafusion:vortex-file-compressed 75694224 / 90420298 / -16.3% 🟢 389228104 / 402320901 / -3.3% 0.19 / 0.22 / -13.5%
clickbench_q23/datafusion:vortex-file-compressed 187836417 / 190179106 / -1.2% 544952423 / 542678679 / +0.4% 0.34 / 0.35 / -1.6%
clickbench_q24/datafusion:vortex-file-compressed 15463418 / 16115369 / -4.0% 76190813 / 67705769 / +12.5% 🔴 0.20 / 0.24 / -14.7%
clickbench_q25/datafusion:vortex-file-compressed 19592132 / 19372705 / +1.1% 69863570 / 61726757 / +13.2% 🔴 0.28 / 0.31 / -10.6%
clickbench_q26/datafusion:vortex-file-compressed 16131862 / 16442524 / -1.9% 71824631 / 70799546 / +1.4% 0.22 / 0.23 / -3.3%
clickbench_q27/datafusion:vortex-file-compressed 101140008 / 103330591 / -2.1% 261306589 / 257359600 / +1.5% 0.39 / 0.40 / -3.6%
clickbench_q28/datafusion:vortex-file-compressed 556032590 / 567469716 / -2.0% 648996692 / 646890676 / +0.3% 0.86 / 0.88 / -2.3%
clickbench_q29/datafusion:vortex-file-compressed 26301908 / 23593132 / +11.5% 🔴 53102617 / 57394739 / -7.5% 0.50 / 0.41 / +20.5%
clickbench_q30/datafusion:vortex-file-compressed 55600799 / 57421004 / -3.2% 114732528 / 113624115 / +1.0% 0.48 / 0.51 / -4.1%
clickbench_q31/datafusion:vortex-file-compressed 64994569 / 65622582 / -1.0% 158343291 / 156055030 / +1.5% 0.41 / 0.42 / -2.4%
clickbench_q32/datafusion:vortex-file-compressed 287930592 / 286052900 / +0.7% 398050014 / 385959292 / +3.1% 0.72 / 0.74 / -2.4%
clickbench_q33/datafusion:vortex-file-compressed 329734396 / 318280516 / +3.6% 471506191 / 430813626 / +9.4% 0.70 / 0.74 / -5.3%
clickbench_q34/datafusion:vortex-file-compressed 327166488 / 317416612 / +3.1% 473987905 / 434580072 / +9.1% 0.69 / 0.73 / -5.5%
clickbench_q35/datafusion:vortex-file-compressed 55712942 / 57421790 / -3.0% 91709391 / 90420778 / +1.4% 0.61 / 0.64 / -4.3%
clickbench_q36/datafusion:vortex-file-compressed 37849438 / 37699196 / +0.4% 68551107 / 68362337 / +0.3% 0.55 / 0.55 / +0.1%
clickbench_q37/datafusion:vortex-file-compressed 21013486 / 21209088 / -0.9% 48339433 / 48350222 / -0.0% 0.43 / 0.44 / -0.9%
clickbench_q38/datafusion:vortex-file-compressed 13278466 / 12982408 / +2.3% 42675358 / 43122016 / -1.0% 0.31 / 0.30 / +3.4%
clickbench_q39/datafusion:vortex-file-compressed 78952172 / 78337988 / +0.8% 114344688 / 111720811 / +2.3% 0.69 / 0.70 / -1.5%
clickbench_q40/datafusion:vortex-file-compressed 12282128 / 10493292 / +17.0% 🔴 39003849 / 37503843 / +4.0% 0.31 / 0.28 / +12.5%
clickbench_q41/datafusion:vortex-file-compressed 11647666 / 10133571 / +14.9% 🔴 36991019 / 35343923 / +4.7% 0.31 / 0.29 / +9.8%
clickbench_q42/datafusion:vortex-file-compressed 11271546 / 10000511 / +12.7% 🔴 38083488 / 35758786 / +6.5% 0.30 / 0.28 / +5.8%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1228495 / 1219329 / +0.8% 50937053 / 52412884 / -2.8% 0.02 / 0.02 / +3.7%
clickbench_q01/datafusion:parquet 16200296 / 16267469 / -0.4% 67743735 / 64711127 / +4.7% 0.24 / 0.25 / -4.9%
clickbench_q02/datafusion:parquet 18701865 / 18713492 / -0.1% 82299931 / 82013204 / +0.3% 0.23 / 0.23 / -0.4%
clickbench_q03/datafusion:parquet 17255177 / 17184538 / +0.4% 81446301 / 79466266 / +2.5% 0.21 / 0.22 / -2.0%
clickbench_q04/datafusion:parquet 62881800 / 63138358 / -0.4% 125408412 / 126413980 / -0.8% 0.50 / 0.50 / +0.4%
clickbench_q05/datafusion:parquet 89564216 / 88834568 / +0.8% 158027566 / 156879085 / +0.7% 0.57 / 0.57 / +0.1%
clickbench_q06/datafusion:parquet 1264692 / 1225194 / +3.2% 50896613 / 49423469 / +3.0% 0.02 / 0.02 / +0.2%
clickbench_q07/datafusion:parquet 16989476 / 16933858 / +0.3% 69188870 / 67259266 / +2.9% 0.25 / 0.25 / -2.5%
clickbench_q08/datafusion:parquet 83358243 / 85133044 / -2.1% 165771194 / 161238010 / +2.8% 0.50 / 0.53 / -4.8%
clickbench_q09/datafusion:parquet 184892982 / 186484050 / -0.9% 275302663 / 268714308 / +2.5% 0.67 / 0.69 / -3.2%
clickbench_q10/datafusion:parquet 36905435 / 36293985 / +1.7% 103020635 / 100549444 / +2.5% 0.36 / 0.36 / -0.8%
clickbench_q11/datafusion:parquet 43763978 / 43071580 / +1.6% 111587577 / 110277568 / +1.2% 0.39 / 0.39 / +0.4%
clickbench_q12/datafusion:parquet 97170858 / 96536508 / +0.7% 164981631 / 163567032 / +0.9% 0.59 / 0.59 / -0.2%
clickbench_q13/datafusion:parquet 148060070 / 147003786 / +0.7% 233125776 / 230034891 / +1.3% 0.64 / 0.64 / -0.6%
clickbench_q14/datafusion:parquet 102089190 / 103016176 / -0.9% 173325084 / 172616470 / +0.4% 0.59 / 0.60 / -1.3%
clickbench_q15/datafusion:parquet 73293574 / 70382268 / +4.1% 134588042 / 131695871 / +2.2% 0.54 / 0.53 / +1.9%
clickbench_q16/datafusion:parquet 155243595 / 157096509 / -1.2% 235684261 / 234629336 / +0.4% 0.66 / 0.67 / -1.6%
clickbench_q17/datafusion:parquet 154527309 / 156713043 / -1.4% 240683932 / 233312051 / +3.2% 0.64 / 0.67 / -4.4%
clickbench_q18/datafusion:parquet 308465420 / 311237827 / -0.9% 421593360 / 428840624 / -1.7% 0.73 / 0.73 / +0.8%
clickbench_q19/datafusion:parquet 19093868 / 19295339 / -1.0% 80178356 / 78111029 / +2.6% 0.24 / 0.25 / -3.6%
clickbench_q20/datafusion:parquet 177941286 / 178467206 / -0.3% 295725215 / 281155044 / +5.2% 0.60 / 0.63 / -5.2%
clickbench_q21/datafusion:parquet 172616791 / 174394838 / -1.0% 316149484 / 298864302 / +5.8% 0.55 / 0.58 / -6.4%
clickbench_q22/datafusion:parquet 260579438 / 262437436 / -0.7% 454900277 / 427525088 / +6.4% 0.57 / 0.61 / -6.7%
clickbench_q23/datafusion:parquet 1004989647 / 1010150880 / -0.5% 1212088089 / 1199333211 / +1.1% 0.83 / 0.84 / -1.6%
clickbench_q24/datafusion:parquet 29841835 / 30218774 / -1.2% 91628067 / 89037908 / +2.9% 0.33 / 0.34 / -4.0%
clickbench_q25/datafusion:parquet 36354070 / 35911539 / +1.2% 107122859 / 101272093 / +5.8% 0.34 / 0.35 / -4.3%
clickbench_q26/datafusion:parquet 30576010 / 30574916 / +0.0% 92522542 / 90457052 / +2.3% 0.33 / 0.34 / -2.2%
clickbench_q27/datafusion:parquet 192888771 / 193719257 / -0.4% 305020361 / 284368833 / +7.3% 0.63 / 0.68 / -7.2%
clickbench_q28/datafusion:parquet 615689751 / 621683844 / -1.0% 709669782 / 709569172 / +0.0% 0.87 / 0.88 / -1.0%
clickbench_q29/datafusion:parquet 28813660 / 28541826 / +1.0% 92004103 / 89838114 / +2.4% 0.31 / 0.32 / -1.4%
clickbench_q30/datafusion:parquet 91235172 / 90632070 / +0.7% 175264145 / 172370078 / +1.7% 0.52 / 0.53 / -1.0%
clickbench_q31/datafusion:parquet 101951760 / 102631436 / -0.7% 201252656 / 201029003 / +0.1% 0.51 / 0.51 / -0.8%
clickbench_q32/datafusion:parquet 306240840 / 307457132 / -0.4% 426381051 / 422570726 / +0.9% 0.72 / 0.73 / -1.3%
clickbench_q33/datafusion:parquet 375161036 / 377153959 / -0.5% 479227679 / 491201328 / -2.4% 0.78 / 0.77 / +2.0%
clickbench_q34/datafusion:parquet 376373996 / 377724282 / -0.4% 474700862 / 491672217 / -3.5% 0.79 / 0.77 / +3.2%
clickbench_q35/datafusion:parquet 63683962 / 64764252 / -1.7% 128190616 / 125081578 / +2.5% 0.50 / 0.52 / -4.1%
clickbench_q36/datafusion:parquet 73672032 / 73540266 / +0.2% 137757335 / 134536348 / +2.4% 0.53 / 0.55 / -2.2%
clickbench_q37/datafusion:parquet 35847194 / 35677870 / +0.5% 92177633 / 90696248 / +1.6% 0.39 / 0.39 / -1.1%
clickbench_q38/datafusion:parquet 47897457 / 47972242 / -0.2% 108751847 / 107145763 / +1.5% 0.44 / 0.45 / -1.6%
clickbench_q39/datafusion:parquet 143633279 / 143910016 / -0.2% 213005473 / 211677649 / +0.6% 0.67 / 0.68 / -0.8%
clickbench_q40/datafusion:parquet 19664157 / 20010632 / -1.7% 77830055 / 77370824 / +0.6% 0.25 / 0.26 / -2.3%
clickbench_q41/datafusion:parquet 18697256 / 18844066 / -0.8% 75798789 / 75429616 / +0.5% 0.25 / 0.25 / -1.3%
clickbench_q42/datafusion:parquet 19033102 / 19449628 / -2.1% 75040825 / 73863007 / +1.6% 0.25 / 0.26 / -3.7%
duckdb / vortex-file-compressed / ns (0.942x ➖, 6↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2225777 / 2223724 / +0.1% 23623481 / 26695191 / -11.5% 🟢 0.09 / 0.08 / +13.1%
clickbench_q01/duckdb:vortex-file-compressed 7497248 / 7531124 / -0.4% 29331472 / 28022044 / +4.7% 0.26 / 0.27 / -4.9%
clickbench_q02/duckdb:vortex-file-compressed 7693380 / 8881792 / -13.4% 🟢 32310396 / 34495697 / -6.3% 0.24 / 0.26 / -7.5%
clickbench_q03/duckdb:vortex-file-compressed 12923846 / 14113722 / -8.4% 48186596 / 50789882 / -5.1% 0.27 / 0.28 / -3.5%
clickbench_q04/duckdb:vortex-file-compressed 55339396 / 56004977 / -1.2% 87561387 / 89633439 / -2.3% 0.63 / 0.62 / +1.1%
clickbench_q05/duckdb:vortex-file-compressed 63128940 / 63510585 / -0.6% 92805797 / 94511850 / -1.8% 0.68 / 0.67 / +1.2%
clickbench_q06/duckdb:vortex-file-compressed 2646821 / 2592458 / +2.1% 28473217 / 33008890 / -13.7% 🟢 0.09 / 0.08 / +18.4%
clickbench_q07/duckdb:vortex-file-compressed 9084222 / 9634970 / -5.7% 27503422 / 30859905 / -10.9% 🟢 0.33 / 0.31 / +5.8%
clickbench_q08/duckdb:vortex-file-compressed 67452795 / 68953430 / -2.2% 98653594 / 105852175 / -6.8% 0.68 / 0.65 / +5.0%
clickbench_q09/duckdb:vortex-file-compressed 88522958 / 92914732 / -4.7% 123910323 / 132751616 / -6.7% 0.71 / 0.70 / +2.1%
clickbench_q10/duckdb:vortex-file-compressed 24938520 / 27476839 / -9.2% 61655413 / 72193262 / -14.6% 🟢 0.40 / 0.38 / +6.3%
clickbench_q11/duckdb:vortex-file-compressed 27701068 / 30446189 / -9.0% 66397716 / 74307121 / -10.6% 🟢 0.42 / 0.41 / +1.8%
clickbench_q12/duckdb:vortex-file-compressed 69167860 / 70587740 / -2.0% 94332202 / 98188145 / -3.9% 0.73 / 0.72 / +2.0%
clickbench_q13/duckdb:vortex-file-compressed 120952114 / 125074636 / -3.3% 153996156 / 169305751 / -9.0% 0.79 / 0.74 / +6.3%
clickbench_q14/duckdb:vortex-file-compressed 72543890 / 74068988 / -2.1% 99959271 / 105225424 / -5.0% 0.73 / 0.70 / +3.1%
clickbench_q15/duckdb:vortex-file-compressed 75718052 / 76058832 / -0.4% 106638349 / 111542401 / -4.4% 0.71 / 0.68 / +4.1%
clickbench_q16/duckdb:vortex-file-compressed 132425568 / 135581462 / -2.3% 170942426 / 173449895 / -1.4% 0.77 / 0.78 / -0.9%
clickbench_q17/duckdb:vortex-file-compressed 138417048 / 136967124 / +1.1% 166853380 / 168738764 / -1.1% 0.83 / 0.81 / +2.2%
clickbench_q18/duckdb:vortex-file-compressed 248383900 / 261204804 / -4.9% 297971673 / 308284924 / -3.3% 0.83 / 0.85 / -1.6%
clickbench_q19/duckdb:vortex-file-compressed 8709191 / 9312587 / -6.5% 36758091 / 34969626 / +5.1% 0.24 / 0.27 / -11.0%
clickbench_q20/duckdb:vortex-file-compressed 64529134 / 68908531 / -6.4% 145148240 / 170683371 / -15.0% 🟢 0.44 / 0.40 / +10.1%
clickbench_q21/duckdb:vortex-file-compressed 72818388 / 85367700 / -14.7% 🟢 166776374 / 194337768 / -14.2% 🟢 0.44 / 0.44 / -0.6%
clickbench_q22/duckdb:vortex-file-compressed 101442116 / 174058622 / -41.7% 🟢 279219428 / 361460245 / -22.8% 🟢 0.36 / 0.48 / -24.6%
clickbench_q23/duckdb:vortex-file-compressed 31316022 / 41638014 / -24.8% 🟢 65634690 / 89084017 / -26.3% 🟢 0.48 / 0.47 / +2.1%
clickbench_q24/duckdb:vortex-file-compressed 12744692 / 14089824 / -9.5% 33449394 / 36885854 / -9.3% 0.38 / 0.38 / -0.3%
clickbench_q25/duckdb:vortex-file-compressed 18449806 / 19076429 / -3.3% 50530886 / 55396270 / -8.8% 0.37 / 0.34 / +6.0%
clickbench_q26/duckdb:vortex-file-compressed 9748594 / 11536394 / -15.5% 🟢 36821488 / 36389014 / +1.2% 0.26 / 0.32 / -16.5%
clickbench_q27/duckdb:vortex-file-compressed 50231780 / 54421844 / -7.7% 152770880 / 180945822 / -15.6% 🟢 0.33 / 0.30 / +9.3%
clickbench_q28/duckdb:vortex-file-compressed 496169900 / 515424262 / -3.7% 533975005 / 566626120 / -5.8% 0.93 / 0.91 / +2.2%
clickbench_q29/duckdb:vortex-file-compressed 15538493 / 17025654 / -8.7% 40451535 / 45675061 / -11.4% 🟢 0.38 / 0.37 / +3.1%
clickbench_q30/duckdb:vortex-file-compressed 57786070 / 61444504 / -6.0% 98878027 / 112689612 / -12.3% 🟢 0.58 / 0.55 / +7.2%
clickbench_q31/duckdb:vortex-file-compressed 96150035 / 111344766 / -13.6% 🟢 163568605 / 177596572 / -7.9% 0.59 / 0.63 / -6.2%
clickbench_q32/duckdb:vortex-file-compressed 369907496 / 365430586 / +1.2% 394517633 / 401704069 / -1.8% 0.94 / 0.91 / +3.1%
clickbench_q33/duckdb:vortex-file-compressed 337360170 / 348258290 / -3.1% 399687760 / 399620969 / +0.0% 0.84 / 0.87 / -3.1%
clickbench_q34/duckdb:vortex-file-compressed 349697442 / 356179085 / -1.8% 408182356 / 415199756 / -1.7% 0.86 / 0.86 / -0.1%
clickbench_q35/duckdb:vortex-file-compressed 58092536 / 57546098 / +0.9% 86836784 / 87221145 / -0.4% 0.67 / 0.66 / +1.4%
clickbench_q36/duckdb:vortex-file-compressed 11951358 / 11734780 / +1.8% 32489811 / 33753095 / -3.7% 0.37 / 0.35 / +5.8%
clickbench_q37/duckdb:vortex-file-compressed 7944738 / 8305907 / -4.3% 30727618 / 28726416 / +7.0% 0.26 / 0.29 / -10.6%
clickbench_q38/duckdb:vortex-file-compressed 9027783 / 8788994 / +2.7% 28584416 / 29112462 / -1.8% 0.32 / 0.30 / +4.6%
clickbench_q39/duckdb:vortex-file-compressed 19402110 / 18883098 / +2.7% 38654843 / 40142702 / -3.7% 0.50 / 0.47 / +6.7%
clickbench_q40/duckdb:vortex-file-compressed 7252834 / 7287779 / -0.5% 27346769 / 30355506 / -9.9% 0.27 / 0.24 / +10.5%
clickbench_q41/duckdb:vortex-file-compressed 8220410 / 8472070 / -3.0% 26936773 / 29837902 / -9.7% 0.31 / 0.28 / +7.5%
clickbench_q42/duckdb:vortex-file-compressed 7340816 / 7491768 / -2.0% 27497415 / 28374450 / -3.1% 0.27 / 0.26 / +1.1%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9191317 / 9273238 / -0.9% 14154753 / 14572972 / -2.9% 0.65 / 0.64 / +2.0%
clickbench_q01/duckdb:parquet 15371323 / 15473304 / -0.7% 21868780 / 21949771 / -0.4% 0.70 / 0.70 / -0.3%
clickbench_q02/duckdb:parquet 22394402 / 22327423 / +0.3% 32977707 / 34064900 / -3.2% 0.68 / 0.66 / +3.6%
clickbench_q03/duckdb:parquet 22463170 / 22581296 / -0.5% 34576647 / 33513853 / +3.2% 0.65 / 0.67 / -3.6%
clickbench_q04/duckdb:parquet 61497734 / 60621366 / +1.4% 71841832 / 74600021 / -3.7% 0.86 / 0.81 / +5.3%
clickbench_q05/duckdb:parquet 82498103 / 82732352 / -0.3% 93220555 / 96634097 / -3.5% 0.88 / 0.86 / +3.4%
clickbench_q06/duckdb:parquet 20295038 / 20427221 / -0.6% 27280130 / 27061659 / +0.8% 0.74 / 0.75 / -1.4%
clickbench_q07/duckdb:parquet 17278296 / 16994710 / +1.7% 23276350 / 24380337 / -4.5% 0.74 / 0.70 / +6.5%
clickbench_q08/duckdb:parquet 73690394 / 74821042 / -1.5% 92604363 / 90877793 / +1.9% 0.80 / 0.82 / -3.3%
clickbench_q09/duckdb:parquet 101990026 / 103332366 / -1.3% 118376202 / 122754070 / -3.6% 0.86 / 0.84 / +2.4%
clickbench_q10/duckdb:parquet 40927636 / 41560161 / -1.5% 53114559 / 55002592 / -3.4% 0.77 / 0.76 / +2.0%
clickbench_q11/duckdb:parquet 47006841 / 45724838 / +2.8% 57280488 / 60231402 / -4.9% 0.82 / 0.76 / +8.1%
clickbench_q12/duckdb:parquet 92883527 / 91777828 / +1.2% 107756432 / 106934718 / +0.8% 0.86 / 0.86 / +0.4%
clickbench_q13/duckdb:parquet 151792507 / 148332354 / +2.3% 171407648 / 165873065 / +3.3% 0.89 / 0.89 / -1.0%
clickbench_q14/duckdb:parquet 100953070 / 100346769 / +0.6% 114789747 / 117552307 / -2.4% 0.88 / 0.85 / +3.0%
clickbench_q15/duckdb:parquet 86208285 / 86527645 / -0.4% 102138837 / 99852499 / +2.3% 0.84 / 0.87 / -2.6%
clickbench_q16/duckdb:parquet 164602728 / 168926226 / -2.6% 177201027 / 177177165 / +0.0% 0.93 / 0.95 / -2.6%
clickbench_q17/duckdb:parquet 164827916 / 164465072 / +0.2% 180811435 / 177904538 / +1.6% 0.91 / 0.92 / -1.4%
clickbench_q18/duckdb:parquet 297096347 / 300518334 / -1.1% 321769706 / 314493112 / +2.3% 0.92 / 0.96 / -3.4%
clickbench_q19/duckdb:parquet 19853280 / 19470254 / +2.0% 26016967 / 26669014 / -2.4% 0.76 / 0.73 / +4.5%
clickbench_q20/duckdb:parquet 183243326 / 177258556 / +3.4% 225880177 / 234335540 / -3.6% 0.81 / 0.76 / +7.2%
clickbench_q21/duckdb:parquet 220694404 / 217798656 / +1.3% 268335744 / 271320584 / -1.1% 0.82 / 0.80 / +2.5%
clickbench_q22/duckdb:parquet 308523602 / 317366258 / -2.8% 358459538 / 348133485 / +3.0% 0.86 / 0.91 / -5.6%
clickbench_q23/duckdb:parquet 168142465 / 171043398 / -1.7% 250173587 / 235524445 / +6.2% 0.67 / 0.73 / -7.5%
clickbench_q24/duckdb:parquet 30206756 / 30905012 / -2.3% 43819929 / 41527769 / +5.5% 0.69 / 0.74 / -7.4%
clickbench_q25/duckdb:parquet 41747942 / 42430838 / -1.6% 63556993 / 56107957 / +13.3% 🔴 0.66 / 0.76 / -13.1%
clickbench_q26/duckdb:parquet 30118864 / 31840344 / -5.4% 45626041 / 47299495 / -3.5% 0.66 / 0.67 / -1.9%
clickbench_q27/duckdb:parquet 189944726 / 188504784 / +0.8% 224654640 / 226465744 / -0.8% 0.85 / 0.83 / +1.6%
clickbench_q28/duckdb:parquet 957359444 / 960093986 / -0.3% 951603400 / 957879645 / -0.7% 1.01 / 1.00 / +0.4%
clickbench_q29/duckdb:parquet 24155476 / 23924492 / +1.0% 30889424 / 31975787 / -3.4% 0.78 / 0.75 / +4.5%
clickbench_q30/duckdb:parquet 105390311 / 105888166 / -0.5% 125393215 / 125845254 / -0.4% 0.84 / 0.84 / -0.1%
clickbench_q31/duckdb:parquet 157726574 / 148207967 / +6.4% 171780743 / 198270696 / -13.4% 🟢 0.92 / 0.75 / +22.8%
clickbench_q32/duckdb:parquet 383908043 / 385790912 / -0.5% 404966575 / 421796378 / -4.0% 0.95 / 0.91 / +3.6%
clickbench_q33/duckdb:parquet 473466120 / 474894180 / -0.3% 483851539 / 456317563 / +6.0% 0.98 / 1.04 / -6.0%
clickbench_q34/duckdb:parquet 460632634 / 465853648 / -1.1% 449158257 / 461144430 / -2.6% 1.03 / 1.01 / +1.5%
clickbench_q35/duckdb:parquet 61037932 / 60829291 / +0.3% 74134486 / 75573915 / -1.9% 0.82 / 0.80 / +2.3%
clickbench_q36/duckdb:parquet 29704860 / 30033704 / -1.1% 35541636 / 35770816 / -0.6% 0.84 / 0.84 / -0.5%
clickbench_q37/duckdb:parquet 23073505 / 23164194 / -0.4% 29292561 / 30364634 / -3.5% 0.79 / 0.76 / +3.3%
clickbench_q38/duckdb:parquet 23454085 / 23714983 / -1.1% 29326042 / 30223977 / -3.0% 0.80 / 0.78 / +1.9%
clickbench_q39/duckdb:parquet 52260721 / 53434084 / -2.2% 59481237 / 60978515 / -2.5% 0.88 / 0.88 / +0.3%
clickbench_q40/duckdb:parquet 14496384 / 14951784 / -3.0% 20169479 / 20364597 / -1.0% 0.72 / 0.73 / -2.1%
clickbench_q41/duckdb:parquet 15731802 / 15830178 / -0.6% 21087081 / 20837510 / +1.2% 0.75 / 0.76 / -1.8%
clickbench_q42/duckdb:parquet 13771400 / 14595475 / -5.6% 20522538 / 21094363 / -2.7% 0.67 / 0.69 / -3.0%

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 18748c51 vs base 7d003295
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (+0.9%, low confidence)
Vortex (geomean): hot 1.009x ➖ · cold 1.014x ➖
Parquet (geomean): hot 1.007x ➖ · cold 1.011x ➖
Shifts: Parquet (control) +0.7% · Median polish +0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21137624 / 21247396 / -0.5% 39970901 / 38235324 / +4.5% 0.53 / 0.56 / -4.8%
tpcds_q02/datafusion:vortex-file-compressed 44612556 / 44090364 / +1.2% 66255581 / 66331492 / -0.1% 0.67 / 0.66 / +1.3%
tpcds_q03/datafusion:vortex-file-compressed 11198630 / 11020974 / +1.6% 29496300 / 28365629 / +4.0% 0.38 / 0.39 / -2.3%
tpcds_q04/datafusion:vortex-file-compressed 88183122 / 86459180 / +2.0% 117781188 / 121636553 / -3.2% 0.75 / 0.71 / +5.3%
tpcds_q05/datafusion:vortex-file-compressed 56642252 / 56504842 / +0.2% 78057158 / 77567340 / +0.6% 0.73 / 0.73 / -0.4%
tpcds_q06/datafusion:vortex-file-compressed 22989136 / 22780118 / +0.9% 42284050 / 42744867 / -1.1% 0.54 / 0.53 / +2.0%
tpcds_q07/datafusion:vortex-file-compressed 29322761 / 28727263 / +2.1% 54153622 / 51076338 / +6.0% 0.54 / 0.56 / -3.7%
tpcds_q08/datafusion:vortex-file-compressed 24189166 / 24774462 / -2.4% 45478886 / 45170925 / +0.7% 0.53 / 0.55 / -3.0%
tpcds_q09/datafusion:vortex-file-compressed 20818391 / 21187574 / -1.7% 37471084 / 37891980 / -1.1% 0.56 / 0.56 / -0.6%
tpcds_q10/datafusion:vortex-file-compressed 26907968 / 26971780 / -0.2% 48852606 / 48125348 / +1.5% 0.55 / 0.56 / -1.7%
tpcds_q11/datafusion:vortex-file-compressed 53648142 / 53521028 / +0.2% 83091054 / 81429501 / +2.0% 0.65 / 0.66 / -1.8%
tpcds_q12/datafusion:vortex-file-compressed 15160142 / 14923924 / +1.6% 33788215 / 33321638 / +1.4% 0.45 / 0.45 / +0.2%
tpcds_q13/datafusion:vortex-file-compressed 32426174 / 31386898 / +3.3% 56703493 / 57507192 / -1.4% 0.57 / 0.55 / +4.8%
tpcds_q14/datafusion:vortex-file-compressed 487202834 / 486339972 / +0.2% 546583659 / 542213665 / +0.8% 0.89 / 0.90 / -0.6%
tpcds_q15/datafusion:vortex-file-compressed 12415354 / 12435438 / -0.2% 34809379 / 33636138 / +3.5% 0.36 / 0.37 / -3.5%
tpcds_q16/datafusion:vortex-file-compressed 18538824 / 18573999 / -0.2% 39116975 / 39183107 / -0.2% 0.47 / 0.47 / -0.0%
tpcds_q17/datafusion:vortex-file-compressed 54500502 / 54792334 / -0.5% 79168707 / 77575216 / +2.1% 0.69 / 0.71 / -2.5%
tpcds_q18/datafusion:vortex-file-compressed 62989676 / 62592707 / +0.6% 85487102 / 85205804 / +0.3% 0.74 / 0.73 / +0.3%
tpcds_q19/datafusion:vortex-file-compressed 16296595 / 16555266 / -1.6% 39335407 / 38422113 / +2.4% 0.41 / 0.43 / -3.8%
tpcds_q20/datafusion:vortex-file-compressed 16266752 / 15940732 / +2.0% 37028881 / 36085111 / +2.6% 0.44 / 0.44 / -0.6%
tpcds_q21/datafusion:vortex-file-compressed 15336700 / 16307141 / -6.0% 40297124 / 38120361 / +5.7% 0.38 / 0.43 / -11.0%
tpcds_q22/datafusion:vortex-file-compressed 49186557 / 49030208 / +0.3% 76310335 / 73392575 / +4.0% 0.64 / 0.67 / -3.5%
tpcds_q23/datafusion:vortex-file-compressed 70451746 / 69869800 / +0.8% 97720954 / 95747858 / +2.1% 0.72 / 0.73 / -1.2%
tpcds_q24/datafusion:vortex-file-compressed 65653872 / 65021439 / +1.0% 90125673 / 86545148 / +4.1% 0.73 / 0.75 / -3.0%
tpcds_q25/datafusion:vortex-file-compressed 44708676 / 45747820 / -2.3% 74692618 / 75827713 / -1.5% 0.60 / 0.60 / -0.8%
tpcds_q26/datafusion:vortex-file-compressed 25455044 / 25953496 / -1.9% 48280000 / 46499921 / +3.8% 0.53 / 0.56 / -5.5%
tpcds_q27/datafusion:vortex-file-compressed 63135360 / 56885164 / +11.0% 🔴 82964541 / 81822951 / +1.4% 0.76 / 0.70 / +9.5%
tpcds_q28/datafusion:vortex-file-compressed 18591644 / 24067286 / -22.8% 🟢 39400988 / 41288829 / -4.6% 0.47 / 0.58 / -19.1%
tpcds_q29/datafusion:vortex-file-compressed 53353187 / 52975238 / +0.7% 77492534 / 77176780 / +0.4% 0.69 / 0.69 / +0.3%
tpcds_q30/datafusion:vortex-file-compressed 26618464 / 26016937 / +2.3% 44631174 / 43975432 / +1.5% 0.60 / 0.59 / +0.8%
tpcds_q31/datafusion:vortex-file-compressed 58420820 / 58112616 / +0.5% 84021712 / 83801173 / +0.3% 0.70 / 0.69 / +0.3%
tpcds_q32/datafusion:vortex-file-compressed 12339560 / 12507016 / -1.3% 29470200 / 30504635 / -3.4% 0.42 / 0.41 / +2.1%
tpcds_q33/datafusion:vortex-file-compressed 27368074 / 27830656 / -1.7% 50901566 / 50094209 / +1.6% 0.54 / 0.56 / -3.2%
tpcds_q34/datafusion:vortex-file-compressed 17657818 / 17470653 / +1.1% 38666512 / 37090618 / +4.2% 0.46 / 0.47 / -3.0%
tpcds_q35/datafusion:vortex-file-compressed 30165434 / 30103250 / +0.2% 54850455 / 53664367 / +2.2% 0.55 / 0.56 / -2.0%
tpcds_q36/datafusion:vortex-file-compressed 46865180 / 47692272 / -1.7% 70706045 / 66455658 / +6.4% 0.66 / 0.72 / -7.6%
tpcds_q37/datafusion:vortex-file-compressed 11617384 / 12251092 / -5.2% 31964910 / 32952789 / -3.0% 0.36 / 0.37 / -2.2%
tpcds_q38/datafusion:vortex-file-compressed 25946174 / 25863187 / +0.3% 47299667 / 46945576 / +0.8% 0.55 / 0.55 / -0.4%
tpcds_q39/datafusion:vortex-file-compressed 65134966 / 64164489 / +1.5% 91372988 / 88353399 / +3.4% 0.71 / 0.73 / -1.8%
tpcds_q40/datafusion:vortex-file-compressed 23070478 / 23359422 / -1.2% 43943990 / 42921828 / +2.4% 0.52 / 0.54 / -3.5%
tpcds_q41/datafusion:vortex-file-compressed 20686473 / 20578784 / +0.5% 33369981 / 33537543 / -0.5% 0.62 / 0.61 / +1.0%
tpcds_q42/datafusion:vortex-file-compressed 10970396 / 11045180 / -0.7% 27797243 / 25574025 / +8.7% 0.39 / 0.43 / -8.6%
tpcds_q43/datafusion:vortex-file-compressed 12640262 / 12551698 / +0.7% 31398166 / 32721873 / -4.0% 0.40 / 0.38 / +5.0%
tpcds_q44/datafusion:vortex-file-compressed 27793860 / 28749952 / -3.3% 49690377 / 52584700 / -5.5% 0.56 / 0.55 / +2.3%
tpcds_q45/datafusion:vortex-file-compressed 16157018 / 15793166 / +2.3% 35161817 / 33411180 / +5.2% 0.46 / 0.47 / -2.8%
tpcds_q46/datafusion:vortex-file-compressed 23786176 / 22917136 / +3.8% 48735131 / 46901502 / +3.9% 0.49 / 0.49 / -0.1%
tpcds_q47/datafusion:vortex-file-compressed 74451840 / 75128566 / -0.9% 106096395 / 103964923 / +2.1% 0.70 / 0.72 / -2.9%
tpcds_q48/datafusion:vortex-file-compressed 29022076 / 28754350 / +0.9% 53187603 / 54043453 / -1.6% 0.55 / 0.53 / +2.6%
tpcds_q49/datafusion:vortex-file-compressed 61204282 / 57798638 / +5.9% 79355339 / 78566636 / +1.0% 0.77 / 0.74 / +4.8%
tpcds_q50/datafusion:vortex-file-compressed 30363121 / 29751388 / +2.1% 51316743 / 51322059 / -0.0% 0.59 / 0.58 / +2.1%
tpcds_q51/datafusion:vortex-file-compressed 65652752 / 66265044 / -0.9% 89981456 / 88510022 / +1.7% 0.73 / 0.75 / -2.5%
tpcds_q52/datafusion:vortex-file-compressed 11408814 / 11518100 / -0.9% 29784033 / 28298464 / +5.2% 0.38 / 0.41 / -5.9%
tpcds_q53/datafusion:vortex-file-compressed 17918081 / 17797824 / +0.7% 38507361 / 40531710 / -5.0% 0.47 / 0.44 / +6.0%
tpcds_q54/datafusion:vortex-file-compressed 31647828 / 31530078 / +0.4% 54869880 / 54202997 / +1.2% 0.58 / 0.58 / -0.8%
tpcds_q55/datafusion:vortex-file-compressed 11059376 / 10836027 / +2.1% 26263965 / 26167187 / +0.4% 0.42 / 0.41 / +1.7%
tpcds_q56/datafusion:vortex-file-compressed 26762787 / 26426897 / +1.3% 49626641 / 46427261 / +6.9% 0.54 / 0.57 / -5.3%
tpcds_q57/datafusion:vortex-file-compressed 61762794 / 61055668 / +1.2% 87046086 / 87663167 / -0.7% 0.71 / 0.70 / +1.9%
tpcds_q58/datafusion:vortex-file-compressed 38331698 / 37953646 / +1.0% 62983461 / 61646741 / +2.2% 0.61 / 0.62 / -1.1%
tpcds_q59/datafusion:vortex-file-compressed 29869412 / 29464223 / +1.4% 52929183 / 54521212 / -2.9% 0.56 / 0.54 / +4.4%
tpcds_q60/datafusion:vortex-file-compressed 26600498 / 26021829 / +2.2% 48114650 / 46499021 / +3.5% 0.55 / 0.56 / -1.2%
tpcds_q61/datafusion:vortex-file-compressed 21370718 / 21218670 / +0.7% 44572354 / 44664975 / -0.2% 0.48 / 0.48 / +0.9%
tpcds_q62/datafusion:vortex-file-compressed 16391108 / 16316174 / +0.5% 34602968 / 34999586 / -1.1% 0.47 / 0.47 / +1.6%
tpcds_q63/datafusion:vortex-file-compressed 17793074 / 17630556 / +0.9% 39454970 / 39487853 / -0.1% 0.45 / 0.45 / +1.0%
tpcds_q64/datafusion:vortex-file-compressed 211939590 / 209783868 / +1.0% 254664425 / 250544915 / +1.6% 0.83 / 0.84 / -0.6%
tpcds_q65/datafusion:vortex-file-compressed 72080276 / 72639750 / -0.8% 95815900 / 94298966 / +1.6% 0.75 / 0.77 / -2.3%
tpcds_q66/datafusion:vortex-file-compressed 50294728 / 50184884 / +0.2% 74937668 / 72658599 / +3.1% 0.67 / 0.69 / -2.8%
tpcds_q67/datafusion:vortex-file-compressed 51005289 / 50337259 / +1.3% 83683980 / 83821511 / -0.2% 0.61 / 0.60 / +1.5%
tpcds_q68/datafusion:vortex-file-compressed 23519224 / 22994628 / +2.3% 48228937 / 45122886 / +6.9% 0.49 / 0.51 / -4.3%
tpcds_q69/datafusion:vortex-file-compressed 25097710 / 25507531 / -1.6% 48353419 / 48203011 / +0.3% 0.52 / 0.53 / -1.9%
tpcds_q70/datafusion:vortex-file-compressed 71633290 / 71255630 / +0.5% 95864674 / 96133984 / -0.3% 0.75 / 0.74 / +0.8%
tpcds_q71/datafusion:vortex-file-compressed 18214722 / 18036400 / +1.0% 41001828 / 40193111 / +2.0% 0.44 / 0.45 / -1.0%
tpcds_q72/datafusion:vortex-file-compressed 354072068 / 353633993 / +0.1% 404513329 / 395540017 / +2.3% 0.88 / 0.89 / -2.1%
tpcds_q73/datafusion:vortex-file-compressed 16348479 / 16405026 / -0.3% 39342987 / 34764172 / +13.2% 🔴 0.42 / 0.47 / -11.9%
tpcds_q74/datafusion:vortex-file-compressed 39780535 / 40527850 / -1.8% 67053969 / 68624150 / -2.3% 0.59 / 0.59 / +0.5%
tpcds_q75/datafusion:vortex-file-compressed 136889230 / 134354737 / +1.9% 168678092 / 164525242 / +2.5% 0.81 / 0.82 / -0.6%
tpcds_q76/datafusion:vortex-file-compressed 29353432 / 30008092 / -2.2% 51635351 / 46115348 / +12.0% 🔴 0.57 / 0.65 / -12.6%
tpcds_q77/datafusion:vortex-file-compressed 45476560 / 44107851 / +3.1% 67482087 / 67315068 / +0.2% 0.67 / 0.66 / +2.8%
tpcds_q78/datafusion:vortex-file-compressed 65353155 / 64112656 / +1.9% 95023788 / 93103864 / +2.1% 0.69 / 0.69 / -0.1%
tpcds_q79/datafusion:vortex-file-compressed 19930628 / 19895386 / +0.2% 44565630 / 41151734 / +8.3% 0.45 / 0.48 / -7.5%
tpcds_q80/datafusion:vortex-file-compressed 73399112 / 72413457 / +1.4% 99842027 / 100762334 / -0.9% 0.74 / 0.72 / +2.3%
tpcds_q81/datafusion:vortex-file-compressed 26080432 / 26107971 / -0.1% 44582679 / 44849056 / -0.6% 0.58 / 0.58 / +0.5%
tpcds_q82/datafusion:vortex-file-compressed 12440055 / 12040307 / +3.3% 34085522 / 33033599 / +3.2% 0.36 / 0.36 / +0.1%
tpcds_q83/datafusion:vortex-file-compressed 32073285 / 33031003 / -2.9% 51472432 / 50986735 / +1.0% 0.62 / 0.65 / -3.8%
tpcds_q84/datafusion:vortex-file-compressed 10202046 / 10156134 / +0.5% 26409898 / 25408454 / +3.9% 0.39 / 0.40 / -3.4%
tpcds_q85/datafusion:vortex-file-compressed 53603703 / 52890016 / +1.3% 79747536 / 79750289 / -0.0% 0.67 / 0.66 / +1.4%
tpcds_q86/datafusion:vortex-file-compressed 16077254 / 15661912 / +2.7% 34576005 / 33933998 / +1.9% 0.46 / 0.46 / +0.7%
tpcds_q87/datafusion:vortex-file-compressed 25534938 / 26237408 / -2.7% 47957444 / 48279982 / -0.7% 0.53 / 0.54 / -2.0%
tpcds_q88/datafusion:vortex-file-compressed 31018226 / 31158678 / -0.5% 52952977 / 52241925 / +1.4% 0.59 / 0.60 / -1.8%
tpcds_q89/datafusion:vortex-file-compressed 21333393 / 21158300 / +0.8% 43620581 / 42164418 / +3.5% 0.49 / 0.50 / -2.5%
tpcds_q90/datafusion:vortex-file-compressed 9895862 / 9893390 / +0.0% 25628902 / 24956492 / +2.7% 0.39 / 0.40 / -2.6%
tpcds_q91/datafusion:vortex-file-compressed 15484922 / 16209975 / -4.5% 36334819 / 35876138 / +1.3% 0.43 / 0.45 / -5.7%
tpcds_q92/datafusion:vortex-file-compressed 12929898 / 12691797 / +1.9% 28083869 / 27316525 / +2.8% 0.46 / 0.46 / -0.9%
tpcds_q93/datafusion:vortex-file-compressed 20471402 / 20271202 / +1.0% 42432510 / 40504254 / +4.8% 0.48 / 0.50 / -3.6%
tpcds_q94/datafusion:vortex-file-compressed 18596358 / 18100224 / +2.7% 36814963 / 36791590 / +0.1% 0.51 / 0.49 / +2.7%
tpcds_q95/datafusion:vortex-file-compressed 42272200 / 41908987 / +0.9% 62337970 / 63035606 / -1.1% 0.68 / 0.66 / +2.0%
tpcds_q96/datafusion:vortex-file-compressed 7576588 / 7599461 / -0.3% 24831784 / 24388421 / +1.8% 0.31 / 0.31 / -2.1%
tpcds_q97/datafusion:vortex-file-compressed 17029115 / 17468648 / -2.5% 37618246 / 37897903 / -0.7% 0.45 / 0.46 / -1.8%
tpcds_q98/datafusion:vortex-file-compressed 16463741 / 16160758 / +1.9% 37367694 / 36769551 / +1.6% 0.44 / 0.44 / +0.2%
tpcds_q99/datafusion:vortex-file-compressed 16235988 / 15896553 / +2.1% 35005342 / 35054843 / -0.1% 0.46 / 0.45 / +2.3%
datafusion / parquet / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 41315889 / 42323024 / -2.4% 62301170 / 62167552 / +0.2% 0.66 / 0.68 / -2.6%
tpcds_q02/datafusion:parquet 54501584 / 54634302 / -0.2% 69805314 / 68931021 / +1.3% 0.78 / 0.79 / -1.5%
tpcds_q03/datafusion:parquet 19232388 / 18937494 / +1.6% 31488755 / 30226864 / +4.2% 0.61 / 0.63 / -2.5%
tpcds_q04/datafusion:parquet 178250006 / 178537276 / -0.2% 205776412 / 204377092 / +0.7% 0.87 / 0.87 / -0.8%
tpcds_q05/datafusion:parquet 66847698 / 68339423 / -2.2% 86297341 / 89626252 / -3.7% 0.77 / 0.76 / +1.6%
tpcds_q06/datafusion:parquet 33906536 / 34073830 / -0.5% 48687423 / 48040459 / +1.3% 0.70 / 0.71 / -1.8%
tpcds_q07/datafusion:parquet 46436679 / 47279514 / -1.8% 67757736 / 67492240 / +0.4% 0.69 / 0.70 / -2.2%
tpcds_q08/datafusion:parquet 31400001 / 30978664 / +1.4% 49815980 / 47463436 / +5.0% 0.63 / 0.65 / -3.4%
tpcds_q09/datafusion:parquet 31313231 / 32079692 / -2.4% 44660388 / 42407362 / +5.3% 0.70 / 0.76 / -7.3%
tpcds_q10/datafusion:parquet 44597950 / 43359202 / +2.9% 60703913 / 57260219 / +6.0% 0.73 / 0.76 / -3.0%
tpcds_q11/datafusion:parquet 97580054 / 96343466 / +1.3% 121468592 / 128407881 / -5.4% 0.80 / 0.75 / +7.1%
tpcds_q12/datafusion:parquet 24281730 / 23762684 / +2.2% 36737953 / 35041248 / +4.8% 0.66 / 0.68 / -2.5%
tpcds_q13/datafusion:parquet 46724982 / 45863160 / +1.9% 67088239 / 69959489 / -4.1% 0.70 / 0.66 / +6.2%
tpcds_q14/datafusion:parquet 536152610 / 534685226 / +0.3% 579891356 / 581155170 / -0.2% 0.92 / 0.92 / +0.5%
tpcds_q15/datafusion:parquet 23734483 / 23879175 / -0.6% 37355027 / 38447800 / -2.8% 0.64 / 0.62 / +2.3%
tpcds_q16/datafusion:parquet 36739556 / 37358902 / -1.7% 51287547 / 51987585 / -1.3% 0.72 / 0.72 / -0.3%
tpcds_q17/datafusion:parquet 74517578 / 74377481 / +0.2% 96956479 / 99944899 / -3.0% 0.77 / 0.74 / +3.3%
tpcds_q18/datafusion:parquet 68142552 / 69956605 / -2.6% 90070075 / 91437924 / -1.5% 0.76 / 0.77 / -1.1%
tpcds_q19/datafusion:parquet 29219262 / 29599929 / -1.3% 43610413 / 44496032 / -2.0% 0.67 / 0.67 / +0.7%
tpcds_q20/datafusion:parquet 25180920 / 25172020 / +0.0% 39742500 / 36738849 / +8.2% 0.63 / 0.69 / -7.5%
tpcds_q21/datafusion:parquet 20067936 / 20161175 / -0.5% 32238408 / 31019661 / +3.9% 0.62 / 0.65 / -4.2%
tpcds_q22/datafusion:parquet 77456079 / 77065438 / +0.5% 89430269 / 88789523 / +0.7% 0.87 / 0.87 / -0.2%
tpcds_q23/datafusion:parquet 92634646 / 91759606 / +1.0% 114691498 / 113614438 / +0.9% 0.81 / 0.81 / +0.0%
tpcds_q24/datafusion:parquet 91111610 / 91469715 / -0.4% 116073590 / 113963762 / +1.9% 0.78 / 0.80 / -2.2%
tpcds_q25/datafusion:parquet 83027131 / 82895926 / +0.2% 106296650 / 99051432 / +7.3% 0.78 / 0.84 / -6.7%
tpcds_q26/datafusion:parquet 43884334 / 43379806 / +1.2% 61518916 / 59714418 / +3.0% 0.71 / 0.73 / -1.8%
tpcds_q27/datafusion:parquet 74020326 / 75949427 / -2.5% 98629902 / 95153011 / +3.7% 0.75 / 0.80 / -6.0%
tpcds_q28/datafusion:parquet 28735239 / 28080910 / +2.3% 44190580 / 43820377 / +0.8% 0.65 / 0.64 / +1.5%
tpcds_q29/datafusion:parquet 75850336 / 74547488 / +1.7% 101674694 / 98168281 / +3.6% 0.75 / 0.76 / -1.8%
tpcds_q30/datafusion:parquet 45716950 / 42359528 / +7.9% 61414240 / 59224927 / +3.7% 0.74 / 0.72 / +4.1%
tpcds_q31/datafusion:parquet 81040041 / 80591695 / +0.6% 99364186 / 98411369 / +1.0% 0.82 / 0.82 / -0.4%
tpcds_q32/datafusion:parquet 26701670 / 26759266 / -0.2% 39665078 / 40869200 / -2.9% 0.67 / 0.65 / +2.8%
tpcds_q33/datafusion:parquet 37609244 / 38331364 / -1.9% 51378486 / 53057601 / -3.2% 0.73 / 0.72 / +1.3%
tpcds_q34/datafusion:parquet 24384312 / 24119576 / +1.1% 36433399 / 36116084 / +0.9% 0.67 / 0.67 / +0.2%
tpcds_q35/datafusion:parquet 50848890 / 50539320 / +0.6% 66428863 / 62393773 / +6.5% 0.77 / 0.81 / -5.5%
tpcds_q36/datafusion:parquet 52226204 / 51985548 / +0.5% 74447927 / 69645871 / +6.9% 0.70 / 0.75 / -6.0%
tpcds_q37/datafusion:parquet 21590318 / 21211435 / +1.8% 35015402 / 33516794 / +4.5% 0.62 / 0.63 / -2.6%
tpcds_q38/datafusion:parquet 43730340 / 44727916 / -2.2% 61375364 / 61392535 / -0.0% 0.71 / 0.73 / -2.2%
tpcds_q39/datafusion:parquet 67341506 / 68397865 / -1.5% 87753191 / 84441146 / +3.9% 0.77 / 0.81 / -5.3%
tpcds_q40/datafusion:parquet 31234772 / 28529526 / +9.5% 51161725 / 50350596 / +1.6% 0.61 / 0.57 / +7.7%
tpcds_q41/datafusion:parquet 20054824 / 20037238 / +0.1% 32899222 / 31946202 / +3.0% 0.61 / 0.63 / -2.8%
tpcds_q42/datafusion:parquet 18158678 / 18152394 / +0.0% 30747040 / 29622707 / +3.8% 0.59 / 0.61 / -3.6%
tpcds_q43/datafusion:parquet 19510168 / 19384748 / +0.6% 33045472 / 32407769 / +2.0% 0.59 / 0.60 / -1.3%
tpcds_q44/datafusion:parquet 36230611 / 35819128 / +1.1% 51381027 / 51199622 / +0.4% 0.71 / 0.70 / +0.8%
tpcds_q45/datafusion:parquet 27651486 / 27845488 / -0.7% 41043752 / 40709892 / +0.8% 0.67 / 0.68 / -1.5%
tpcds_q46/datafusion:parquet 28599138 / 28672764 / -0.3% 46733111 / 45491324 / +2.7% 0.61 / 0.63 / -2.9%
tpcds_q47/datafusion:parquet 96925642 / 98308898 / -1.4% 120249717 / 119679687 / +0.5% 0.81 / 0.82 / -1.9%
tpcds_q48/datafusion:parquet 42397830 / 41763765 / +1.5% 60401155 / 59394128 / +1.7% 0.70 / 0.70 / -0.2%
tpcds_q49/datafusion:parquet 73353315 / 70657194 / +3.8% 99994729 / 93864992 / +6.5% 0.73 / 0.75 / -2.5%
tpcds_q50/datafusion:parquet 47310687 / 46683484 / +1.3% 66270527 / 66124586 / +0.2% 0.71 / 0.71 / +1.1%
tpcds_q51/datafusion:parquet 75752900 / 74992194 / +1.0% 94874273 / 96024531 / -1.2% 0.80 / 0.78 / +2.2%
tpcds_q52/datafusion:parquet 18394999 / 18490580 / -0.5% 30612182 / 29767530 / +2.8% 0.60 / 0.62 / -3.3%
tpcds_q53/datafusion:parquet 22580980 / 22147842 / +2.0% 38486250 / 38449690 / +0.1% 0.59 / 0.58 / +1.9%
tpcds_q54/datafusion:parquet 52560784 / 53750920 / -2.2% 69894905 / 69045068 / +1.2% 0.75 / 0.78 / -3.4%
tpcds_q55/datafusion:parquet 18195619 / 18060316 / +0.7% 29603701 / 31683821 / -6.6% 0.61 / 0.57 / +7.8%
tpcds_q56/datafusion:parquet 41136756 / 41319510 / -0.4% 55680086 / 56412811 / -1.3% 0.74 / 0.73 / +0.9%
tpcds_q57/datafusion:parquet 100315946 / 100717816 / -0.4% 120245592 / 120619646 / -0.3% 0.83 / 0.84 / -0.1%
tpcds_q58/datafusion:parquet 64984830 / 65186250 / -0.3% 83733632 / 84133301 / -0.5% 0.78 / 0.77 / +0.2%
tpcds_q59/datafusion:parquet 49016750 / 47393314 / +3.4% 64531886 / 64203550 / +0.5% 0.76 / 0.74 / +2.9%
tpcds_q60/datafusion:parquet 41216760 / 41481541 / -0.6% 56016757 / 56932116 / -1.6% 0.74 / 0.73 / +1.0%
tpcds_q61/datafusion:parquet 35000964 / 36834760 / -5.0% 51741621 / 50627096 / +2.2% 0.68 / 0.73 / -7.0%
tpcds_q62/datafusion:parquet 25129879 / 25011848 / +0.5% 37857586 / 37738504 / +0.3% 0.66 / 0.66 / +0.2%
tpcds_q63/datafusion:parquet 22072608 / 22493850 / -1.9% 38820391 / 38609303 / +0.5% 0.57 / 0.58 / -2.4%
tpcds_q64/datafusion:parquet 287089656 / 288934782 / -0.6% 324904811 / 326417734 / -0.5% 0.88 / 0.89 / -0.2%
tpcds_q65/datafusion:parquet 125676004 / 123014874 / +2.2% 132800239 / 132495215 / +0.2% 0.95 / 0.93 / +1.9%
tpcds_q66/datafusion:parquet 61293853 / 58759118 / +4.3% 77767697 / 78226108 / -0.6% 0.79 / 0.75 / +4.9%
tpcds_q67/datafusion:parquet 68712623 / 68687320 / +0.0% 92934948 / 91567205 / +1.5% 0.74 / 0.75 / -1.4%
tpcds_q68/datafusion:parquet 29380368 / 29204756 / +0.6% 47561466 / 46554019 / +2.2% 0.62 / 0.63 / -1.5%
tpcds_q69/datafusion:parquet 43900772 / 43337652 / +1.3% 58318596 / 58212600 / +0.2% 0.75 / 0.74 / +1.1%
tpcds_q70/datafusion:parquet 79869116 / 82951338 / -3.7% 97747437 / 97116937 / +0.6% 0.82 / 0.85 / -4.3%
tpcds_q71/datafusion:parquet 26285872 / 25273358 / +4.0% 39332106 / 36613745 / +7.4% 0.67 / 0.69 / -3.2%
tpcds_q72/datafusion:parquet 528923464 / 522600670 / +1.2% 540137517 / 569404526 / -5.1% 0.98 / 0.92 / +6.7%
tpcds_q73/datafusion:parquet 23458978 / 23653240 / -0.8% 35975750 / 35173200 / +2.3% 0.65 / 0.67 / -3.0%
tpcds_q74/datafusion:parquet 69416028 / 70561269 / -1.6% 87089182 / 87889416 / -0.9% 0.80 / 0.80 / -0.7%
tpcds_q75/datafusion:parquet 152600097 / 151883672 / +0.5% 179762329 / 175222435 / +2.6% 0.85 / 0.87 / -2.1%
tpcds_q76/datafusion:parquet 33738738 / 33837656 / -0.3% 46981483 / 47554021 / -1.2% 0.72 / 0.71 / +0.9%
tpcds_q77/datafusion:parquet 57042274 / 55687992 / +2.4% 75112050 / 74121769 / +1.3% 0.76 / 0.75 / +1.1%
tpcds_q78/datafusion:parquet 85931521 / 84391474 / +1.8% 121276845 / 118434998 / +2.4% 0.71 / 0.71 / -0.6%
tpcds_q79/datafusion:parquet 27044552 / 26924800 / +0.4% 42014687 / 42166340 / -0.4% 0.64 / 0.64 / +0.8%
tpcds_q80/datafusion:parquet 81080592 / 80099048 / +1.2% 112247521 / 109868853 / +2.2% 0.72 / 0.73 / -0.9%
tpcds_q81/datafusion:parquet 38902280 / 38161358 / +1.9% 51659636 / 50769180 / +1.8% 0.75 / 0.75 / +0.2%
tpcds_q82/datafusion:parquet 22785382 / 22414337 / +1.7% 35921164 / 34436940 / +4.3% 0.63 / 0.65 / -2.5%
tpcds_q83/datafusion:parquet 58788143 / 57003923 / +3.1% 73797637 / 74567059 / -1.0% 0.80 / 0.76 / +4.2%
tpcds_q84/datafusion:parquet 28607303 / 26200254 / +9.2% 42134684 / 38463374 / +9.5% 0.68 / 0.68 / -0.3%
tpcds_q85/datafusion:parquet 78706534 / 79747654 / -1.3% 101301813 / 104546975 / -3.1% 0.78 / 0.76 / +1.9%
tpcds_q86/datafusion:parquet 21104028 / 20720100 / +1.9% 33442992 / 32422906 / +3.1% 0.63 / 0.64 / -1.3%
tpcds_q87/datafusion:parquet 45438184 / 44587374 / +1.9% 60475666 / 57691595 / +4.8% 0.75 / 0.77 / -2.8%
tpcds_q88/datafusion:parquet 37512950 / 37700522 / -0.5% 51746620 / 51657809 / +0.2% 0.72 / 0.73 / -0.7%
tpcds_q89/datafusion:parquet 25591740 / 25638292 / -0.2% 41816598 / 39814400 / +5.0% 0.61 / 0.64 / -5.0%
tpcds_q90/datafusion:parquet 15703556 / 14853660 / +5.7% 26962428 / 26527924 / +1.6% 0.58 / 0.56 / +4.0%
tpcds_q91/datafusion:parquet 32395797 / 32234844 / +0.5% 46375564 / 46254423 / +0.3% 0.70 / 0.70 / +0.2%
tpcds_q92/datafusion:parquet 26503954 / 27177100 / -2.5% 39712619 / 40136237 / -1.1% 0.67 / 0.68 / -1.4%
tpcds_q93/datafusion:parquet 26595930 / 27216446 / -2.3% 45501181 / 46769714 / -2.7% 0.58 / 0.58 / +0.4%
tpcds_q94/datafusion:parquet 35120792 / 35251465 / -0.4% 49700138 / 50000662 / -0.6% 0.71 / 0.71 / +0.2%
tpcds_q95/datafusion:parquet 63699106 / 64472404 / -1.2% 77266940 / 79327030 / -2.6% 0.82 / 0.81 / +1.4%
tpcds_q96/datafusion:parquet 13046861 / 12845820 / +1.6% 24744521 / 23746920 / +4.2% 0.53 / 0.54 / -2.5%
tpcds_q97/datafusion:parquet 35814066 / 35258332 / +1.6% 50607806 / 49192809 / +2.9% 0.71 / 0.72 / -1.3%
tpcds_q98/datafusion:parquet 24387474 / 24700499 / -1.3% 37781614 / 37646210 / +0.4% 0.65 / 0.66 / -1.6%
tpcds_q99/datafusion:parquet 29984200 / 29613506 / +1.3% 42553436 / 41968146 / +1.4% 0.70 / 0.71 / -0.1%
duckdb / vortex-file-compressed / ns (1.017x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15903732 / 16076378 / -1.1% 25034298 / 25028786 / +0.0% 0.64 / 0.64 / -1.1%
tpcds_q02/duckdb:vortex-file-compressed 17094124 / 17279736 / -1.1% 22987026 / 21817236 / +5.4% 0.74 / 0.79 / -6.1%
tpcds_q03/duckdb:vortex-file-compressed 7244910 / 7023164 / +3.2% 15976210 / 16095547 / -0.7% 0.45 / 0.44 / +3.9%
tpcds_q04/duckdb:vortex-file-compressed 47454900 / 46198276 / +2.7% 58582956 / 56956439 / +2.9% 0.81 / 0.81 / -0.1%
tpcds_q05/duckdb:vortex-file-compressed 23254898 / 22987976 / +1.2% 32509129 / 32514988 / -0.0% 0.72 / 0.71 / +1.2%
tpcds_q06/duckdb:vortex-file-compressed 24638854 / 24239094 / +1.6% 38422970 / 37789122 / +1.7% 0.64 / 0.64 / -0.0%
tpcds_q07/duckdb:vortex-file-compressed 13061044 / 13553384 / -3.6% 23702055 / 24847086 / -4.6% 0.55 / 0.55 / +1.0%
tpcds_q08/duckdb:vortex-file-compressed 17547986 / 17318341 / +1.3% 25460818 / 25220875 / +1.0% 0.69 / 0.69 / +0.4%
tpcds_q09/duckdb:vortex-file-compressed 17994258 / 19066666 / -5.6% 27517151 / 29614356 / -7.1% 0.65 / 0.64 / +1.6%
tpcds_q10/duckdb:vortex-file-compressed 27944510 / 28018016 / -0.3% 40857829 / 40680515 / +0.4% 0.68 / 0.69 / -0.7%
tpcds_q11/duckdb:vortex-file-compressed 38359448 / 36890912 / +4.0% 47104402 / 45620094 / +3.3% 0.81 / 0.81 / +0.7%
tpcds_q12/duckdb:vortex-file-compressed 10338454 / 10278028 / +0.6% 17579025 / 16771455 / +4.8% 0.59 / 0.61 / -4.0%
tpcds_q13/duckdb:vortex-file-compressed 20877602 / 20906638 / -0.1% 33950556 / 33154275 / +2.4% 0.61 / 0.63 / -2.5%
tpcds_q14/duckdb:vortex-file-compressed 56662354 / 55944386 / +1.3% 69361807 / 66603662 / +4.1% 0.82 / 0.84 / -2.7%
tpcds_q15/duckdb:vortex-file-compressed 11032586 / 11350335 / -2.8% 17657330 / 18482249 / -4.5% 0.62 / 0.61 / +1.7%
tpcds_q16/duckdb:vortex-file-compressed 24464856 / 24651036 / -0.8% 35157621 / 35553276 / -1.1% 0.70 / 0.69 / +0.4%
tpcds_q17/duckdb:vortex-file-compressed 24579697 / 24371086 / +0.9% 36680323 / 36379364 / +0.8% 0.67 / 0.67 / +0.0%
tpcds_q18/duckdb:vortex-file-compressed 31890852 / 31577772 / +1.0% 42152879 / 42103490 / +0.1% 0.76 / 0.75 / +0.9%
tpcds_q19/duckdb:vortex-file-compressed 77624344 / 76725514 / +1.2% 88863387 / 88895989 / -0.0% 0.87 / 0.86 / +1.2%
tpcds_q20/duckdb:vortex-file-compressed 11147302 / 11102766 / +0.4% 19314098 / 18133176 / +6.5% 0.58 / 0.61 / -5.7%
tpcds_q21/duckdb:vortex-file-compressed 10183820 / 9749551 / +4.5% 22800538 / 21725356 / +4.9% 0.45 / 0.45 / -0.5%
tpcds_q22/duckdb:vortex-file-compressed 18163133 / 17828182 / +1.9% 30863022 / 29472377 / +4.7% 0.59 / 0.60 / -2.7%
tpcds_q23/duckdb:vortex-file-compressed 42269706 / 37846052 / +11.7% 🔴 52188370 / 51520060 / +1.3% 0.81 / 0.73 / +10.3%
tpcds_q24/duckdb:vortex-file-compressed 26630254 / 26276276 / +1.3% 36931027 / 36779359 / +0.4% 0.72 / 0.71 / +0.9%
tpcds_q25/duckdb:vortex-file-compressed 23378483 / 23347144 / +0.1% 35910033 / 35121241 / +2.2% 0.65 / 0.66 / -2.1%
tpcds_q26/duckdb:vortex-file-compressed 12709290 / 12916484 / -1.6% 20603987 / 21722613 / -5.1% 0.62 / 0.59 / +3.7%
tpcds_q27/duckdb:vortex-file-compressed 15884290 / 16096004 / -1.3% 26388242 / 26592626 / -0.8% 0.60 / 0.61 / -0.6%
tpcds_q28/duckdb:vortex-file-compressed 14398508 / 15315316 / -6.0% 26215778 / 25366688 / +3.3% 0.55 / 0.60 / -9.0%
tpcds_q29/duckdb:vortex-file-compressed 23230590 / 22667036 / +2.5% 34782299 / 35263271 / -1.4% 0.67 / 0.64 / +3.9%
tpcds_q30/duckdb:vortex-file-compressed 16420344 / 16389708 / +0.2% 24033192 / 24613461 / -2.4% 0.68 / 0.67 / +2.6%
tpcds_q31/duckdb:vortex-file-compressed 18444168 / 17616690 / +4.7% 26602294 / 26683654 / -0.3% 0.69 / 0.66 / +5.0%
tpcds_q32/duckdb:vortex-file-compressed 11740156 / 11669074 / +0.6% 20942435 / 21224782 / -1.3% 0.56 / 0.55 / +2.0%
tpcds_q33/duckdb:vortex-file-compressed 19365426 / 19109514 / +1.3% 28664602 / 28643469 / +0.1% 0.68 / 0.67 / +1.3%
tpcds_q34/duckdb:vortex-file-compressed 12780442 / 13096906 / -2.4% 22456835 / 22767966 / -1.4% 0.57 / 0.58 / -1.1%
tpcds_q35/duckdb:vortex-file-compressed 29109537 / 28468640 / +2.3% 39346071 / 38124566 / +3.2% 0.74 / 0.75 / -0.9%
tpcds_q36/duckdb:vortex-file-compressed 14308428 / 13922197 / +2.8% 24169537 / 24123293 / +0.2% 0.59 / 0.58 / +2.6%
tpcds_q37/duckdb:vortex-file-compressed 9683978 / 9539404 / +1.5% 24383487 / 23542539 / +3.6% 0.40 / 0.41 / -2.0%
tpcds_q38/duckdb:vortex-file-compressed 24418290 / 24531030 / -0.5% 33153115 / 32395370 / +2.3% 0.74 / 0.76 / -2.7%
tpcds_q39/duckdb:vortex-file-compressed 19718484 / 19035836 / +3.6% 33412870 / 32256653 / +3.6% 0.59 / 0.59 / +0.0%
tpcds_q40/duckdb:vortex-file-compressed 15105778 / 13983120 / +8.0% 21199846 / 21084011 / +0.5% 0.71 / 0.66 / +7.4%
tpcds_q41/duckdb:vortex-file-compressed 18821098 / 18760396 / +0.3% 25946468 / 25660193 / +1.1% 0.73 / 0.73 / -0.8%
tpcds_q42/duckdb:vortex-file-compressed 7170498 / 6886317 / +4.1% 16207559 / 15772925 / +2.8% 0.44 / 0.44 / +1.3%
tpcds_q43/duckdb:vortex-file-compressed 9814185 / 9709192 / +1.1% 18945067 / 19035040 / -0.5% 0.52 / 0.51 / +1.6%
tpcds_q44/duckdb:vortex-file-compressed 13015968 / 12496017 / +4.2% 24503112 / 24380189 / +0.5% 0.53 / 0.51 / +3.6%
tpcds_q45/duckdb:vortex-file-compressed 23672578 / 23488696 / +0.8% 30462258 / 31020749 / -1.8% 0.78 / 0.76 / +2.6%
tpcds_q46/duckdb:vortex-file-compressed 19179076 / 19319872 / -0.7% 27667022 / 27782833 / -0.4% 0.69 / 0.70 / -0.3%
tpcds_q47/duckdb:vortex-file-compressed 34883868 / 34779066 / +0.3% 44740265 / 45700365 / -2.1% 0.78 / 0.76 / +2.5%
tpcds_q48/duckdb:vortex-file-compressed 23477389 / 23324324 / +0.7% 36077313 / 36078411 / -0.0% 0.65 / 0.65 / +0.7%
tpcds_q49/duckdb:vortex-file-compressed 19270876 / 19081593 / +1.0% 29966811 / 30321355 / -1.2% 0.64 / 0.63 / +2.2%
tpcds_q50/duckdb:vortex-file-compressed 17107430 / 16700122 / +2.4% 28003679 / 26837610 / +4.3% 0.61 / 0.62 / -1.8%
tpcds_q51/duckdb:vortex-file-compressed 68757562 / 48712282 / +41.2% 🔴 78635862 / 58727612 / +33.9% 🔴 0.87 / 0.83 / +5.4%
tpcds_q52/duckdb:vortex-file-compressed 7297970 / 7100510 / +2.8% 16437334 / 15876047 / +3.5% 0.44 / 0.45 / -0.7%
tpcds_q53/duckdb:vortex-file-compressed 11469300 / 11422900 / +0.4% 21443741 / 21081455 / +1.7% 0.53 / 0.54 / -1.3%
tpcds_q54/duckdb:vortex-file-compressed 21030387 / 20531252 / +2.4% 31958402 / 30294051 / +5.5% 0.66 / 0.68 / -2.9%
tpcds_q55/duckdb:vortex-file-compressed 6998550 / 6937278 / +0.9% 15852840 / 15657189 / +1.2% 0.44 / 0.44 / -0.4%
tpcds_q56/duckdb:vortex-file-compressed 18342494 / 18066199 / +1.5% 28668223 / 29070454 / -1.4% 0.64 / 0.62 / +3.0%
tpcds_q57/duckdb:vortex-file-compressed 25865412 / 26043042 / -0.7% 34416198 / 34698420 / -0.8% 0.75 / 0.75 / +0.1%
tpcds_q58/duckdb:vortex-file-compressed 20692348 / 20388299 / +1.5% 31025726 / 30968451 / +0.2% 0.67 / 0.66 / +1.3%
tpcds_q59/duckdb:vortex-file-compressed 22471202 / 19412962 / +15.8% 🔴 27192374 / 27112686 / +0.3% 0.83 / 0.72 / +15.4%
tpcds_q60/duckdb:vortex-file-compressed 18872456 / 18815120 / +0.3% 29347669 / 29209511 / +0.5% 0.64 / 0.64 / -0.2%
tpcds_q61/duckdb:vortex-file-compressed 27619714 / 25166464 / +9.7% 34160951 / 33643428 / +1.5% 0.81 / 0.75 / +8.1%
tpcds_q62/duckdb:vortex-file-compressed 11511536 / 11651822 / -1.2% 18349033 / 18378193 / -0.2% 0.63 / 0.63 / -1.0%
tpcds_q63/duckdb:vortex-file-compressed 11219136 / 11043064 / +1.6% 19921550 / 20018617 / -0.5% 0.56 / 0.55 / +2.1%
tpcds_q64/duckdb:vortex-file-compressed 50083008 / 50281318 / -0.4% 65070302 / 65797023 / -1.1% 0.77 / 0.76 / +0.7%
tpcds_q65/duckdb:vortex-file-compressed 14228778 / 13158815 / +8.1% 23080524 / 23899493 / -3.4% 0.62 / 0.55 / +12.0%
tpcds_q66/duckdb:vortex-file-compressed 28845849 / 30337061 / -4.9% 35850077 / 35397164 / +1.3% 0.80 / 0.86 / -6.1%
tpcds_q67/duckdb:vortex-file-compressed 58325700 / 58149282 / +0.3% 67628714 / 68234450 / -0.9% 0.86 / 0.85 / +1.2%
tpcds_q68/duckdb:vortex-file-compressed 19111073 / 19113108 / -0.0% 27570680 / 27909717 / -1.2% 0.69 / 0.68 / +1.2%
tpcds_q69/duckdb:vortex-file-compressed 23906402 / 23265520 / +2.8% 38469965 / 37062835 / +3.8% 0.62 / 0.63 / -1.0%
tpcds_q70/duckdb:vortex-file-compressed 16968152 / 16052110 / +5.7% 26958158 / 26858534 / +0.4% 0.63 / 0.60 / +5.3%
tpcds_q71/duckdb:vortex-file-compressed 13354820 / 13288558 / +0.5% 23745121 / 23961761 / -0.9% 0.56 / 0.55 / +1.4%
tpcds_q72/duckdb:vortex-file-compressed 51905750 / 51956494 / -0.1% 63722273 / 62628817 / +1.7% 0.81 / 0.83 / -1.8%
tpcds_q73/duckdb:vortex-file-compressed 11747980 / 11973750 / -1.9% 21279217 / 21439110 / -0.7% 0.55 / 0.56 / -1.1%
tpcds_q74/duckdb:vortex-file-compressed 28200880 / 26189692 / +7.7% 35727510 / 34724197 / +2.9% 0.79 / 0.75 / +4.7%
tpcds_q75/duckdb:vortex-file-compressed 28845108 / 27631701 / +4.4% 38777817 / 38344617 / +1.1% 0.74 / 0.72 / +3.2%
tpcds_q76/duckdb:vortex-file-compressed 12902788 / 12833340 / +0.5% 23239661 / 22794189 / +2.0% 0.56 / 0.56 / -1.4%
tpcds_q77/duckdb:vortex-file-compressed 21465472 / 20684868 / +3.8% 32974233 / 32076236 / +2.8% 0.65 / 0.64 / +0.9%
tpcds_q78/duckdb:vortex-file-compressed 43097968 / 43172744 / -0.2% 53565664 / 54919661 / -2.5% 0.80 / 0.79 / +2.4%
tpcds_q79/duckdb:vortex-file-compressed 13118736 / 13146035 / -0.2% 22308400 / 22371086 / -0.3% 0.59 / 0.59 / +0.1%
tpcds_q80/duckdb:vortex-file-compressed 37078080 / 36578230 / +1.4% 50024150 / 49535476 / +1.0% 0.74 / 0.74 / +0.4%
tpcds_q81/duckdb:vortex-file-compressed 21436392 / 21534387 / -0.5% 29391688 / 29566329 / -0.6% 0.73 / 0.73 / +0.1%
tpcds_q82/duckdb:vortex-file-compressed 9790636 / 9915802 / -1.3% 25885918 / 24075307 / +7.5% 0.38 / 0.41 / -8.2%
tpcds_q83/duckdb:vortex-file-compressed 17710320 / 17370129 / +2.0% 25313627 / 24304401 / +4.2% 0.70 / 0.71 / -2.1%
tpcds_q84/duckdb:vortex-file-compressed 16223976 / 15763826 / +2.9% 23540602 / 22788093 / +3.3% 0.69 / 0.69 / -0.4%
tpcds_q85/duckdb:vortex-file-compressed 24697515 / 24331780 / +1.5% 38038246 / 36706515 / +3.6% 0.65 / 0.66 / -2.1%
tpcds_q86/duckdb:vortex-file-compressed 9936610 / 9745788 / +2.0% 16138248 / 16017679 / +0.8% 0.62 / 0.61 / +1.2%
tpcds_q87/duckdb:vortex-file-compressed 25834203 / 26111389 / -1.1% 34510118 / 33705368 / +2.4% 0.75 / 0.77 / -3.4%
tpcds_q88/duckdb:vortex-file-compressed 31847634 / 30330985 / +5.0% 37768338 / 38200450 / -1.1% 0.84 / 0.79 / +6.2%
tpcds_q89/duckdb:vortex-file-compressed 12212018 / 12217526 / -0.0% 22178789 / 21385601 / +3.7% 0.55 / 0.57 / -3.6%
tpcds_q90/duckdb:vortex-file-compressed 8306088 / 8103213 / +2.5% 16311717 / 14973880 / +8.9% 0.51 / 0.54 / -5.9%
tpcds_q91/duckdb:vortex-file-compressed 14960460 / 14448528 / +3.5% 22023757 / 21575854 / +2.1% 0.68 / 0.67 / +1.4%
tpcds_q92/duckdb:vortex-file-compressed 12096315 / 12210660 / -0.9% 20353724 / 20341659 / +0.1% 0.59 / 0.60 / -1.0%
tpcds_q93/duckdb:vortex-file-compressed 10744472 / 10404297 / +3.3% 22553616 / 23758589 / -5.1% 0.48 / 0.44 / +8.8%
tpcds_q94/duckdb:vortex-file-compressed 21990698 / 21848751 / +0.6% 31968464 / 31842505 / +0.4% 0.69 / 0.69 / +0.3%
tpcds_q95/duckdb:vortex-file-compressed 62708970 / 62591494 / +0.2% 72084858 / 72084395 / +0.0% 0.87 / 0.87 / +0.2%
tpcds_q96/duckdb:vortex-file-compressed 6928042 / 6695542 / +3.5% 15227513 / 14875915 / +2.4% 0.45 / 0.45 / +1.1%
tpcds_q97/duckdb:vortex-file-compressed 23187176 / 23464301 / -1.2% 32079393 / 32934393 / -2.6% 0.72 / 0.71 / +1.5%
tpcds_q98/duckdb:vortex-file-compressed 11935531 / 11485862 / +3.9% 21609977 / 20406389 / +5.9% 0.55 / 0.56 / -1.9%
tpcds_q99/duckdb:vortex-file-compressed 14585738 / 14469990 / +0.8% 22398103 / 22154722 / +1.1% 0.65 / 0.65 / -0.3%
duckdb / parquet / ns (1.009x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24398504 / 23852150 / +2.3% 31061932 / 30834823 / +0.7% 0.79 / 0.77 / +1.5%
tpcds_q02/duckdb:parquet 17963294 / 17813101 / +0.8% 24147633 / 23661193 / +2.1% 0.74 / 0.75 / -1.2%
tpcds_q03/duckdb:parquet 9739124 / 9730104 / +0.1% 15629111 / 15882166 / -1.6% 0.62 / 0.61 / +1.7%
tpcds_q04/duckdb:parquet 117702622 / 117103776 / +0.5% 125398286 / 125515120 / -0.1% 0.94 / 0.93 / +0.6%
tpcds_q05/duckdb:parquet 28507960 / 28276414 / +0.8% 32916625 / 33419325 / -1.5% 0.87 / 0.85 / +2.4%
tpcds_q06/duckdb:parquet 27870904 / 26304292 / +6.0% 36367953 / 35238412 / +3.2% 0.77 / 0.75 / +2.7%
tpcds_q07/duckdb:parquet 33206412 / 33100890 / +0.3% 38710385 / 39416713 / -1.8% 0.86 / 0.84 / +2.1%
tpcds_q08/duckdb:parquet 19789192 / 19844364 / -0.3% 26118268 / 26100388 / +0.1% 0.76 / 0.76 / -0.3%
tpcds_q09/duckdb:parquet 27125962 / 26761914 / +1.4% 30699748 / 30327503 / +1.2% 0.88 / 0.88 / +0.1%
tpcds_q10/duckdb:parquet 32789200 / 32568156 / +0.7% 41144673 / 40208029 / +2.3% 0.80 / 0.81 / -1.6%
tpcds_q11/duckdb:parquet 68866967 / 69433615 / -0.8% 76394101 / 76232815 / +0.2% 0.90 / 0.91 / -1.0%
tpcds_q12/duckdb:parquet 14039180 / 14029524 / +0.1% 19127681 / 19173364 / -0.2% 0.73 / 0.73 / +0.3%
tpcds_q13/duckdb:parquet 30418704 / 33276716 / -8.6% 40634433 / 39290604 / +3.4% 0.75 / 0.85 / -11.6%
tpcds_q14/duckdb:parquet 64235611 / 63867359 / +0.6% 69071203 / 67692583 / +2.0% 0.93 / 0.94 / -1.4%
tpcds_q15/duckdb:parquet 16715596 / 16493439 / +1.3% 22474404 / 22382314 / +0.4% 0.74 / 0.74 / +0.9%
tpcds_q16/duckdb:parquet 30375132 / 30025484 / +1.2% 37405561 / 37159602 / +0.7% 0.81 / 0.81 / +0.5%
tpcds_q17/duckdb:parquet 34595049 / 34234108 / +1.1% 40085535 / 39580673 / +1.3% 0.86 / 0.86 / -0.2%
tpcds_q18/duckdb:parquet 47749808 / 47085205 / +1.4% 54881405 / 54196762 / +1.3% 0.87 / 0.87 / +0.1%
tpcds_q19/duckdb:parquet 19524922 / 18926267 / +3.2% 26147850 / 25665516 / +1.9% 0.75 / 0.74 / +1.3%
tpcds_q20/duckdb:parquet 15045797 / 14886630 / +1.1% 19720753 / 19526429 / +1.0% 0.76 / 0.76 / +0.1%
tpcds_q21/duckdb:parquet 10661692 / 10257661 / +3.9% 17111708 / 16845267 / +1.6% 0.62 / 0.61 / +2.3%
tpcds_q22/duckdb:parquet 20827754 / 20584272 / +1.2% 26712609 / 26647417 / +0.2% 0.78 / 0.77 / +0.9%
tpcds_q23/duckdb:parquet 43239407 / 42710044 / +1.2% 48091369 / 49502616 / -2.9% 0.90 / 0.86 / +4.2%
tpcds_q24/duckdb:parquet 30416072 / 30728505 / -1.0% 36903580 / 36097864 / +2.2% 0.82 / 0.85 / -3.2%
tpcds_q25/duckdb:parquet 30689760 / 30461338 / +0.7% 37623684 / 36428373 / +3.3% 0.82 / 0.84 / -2.5%
tpcds_q26/duckdb:parquet 29203758 / 28821420 / +1.3% 35251853 / 34857928 / +1.1% 0.83 / 0.83 / +0.2%
tpcds_q27/duckdb:parquet 34601130 / 34363016 / +0.7% 41293323 / 42337048 / -2.5% 0.84 / 0.81 / +3.2%
tpcds_q28/duckdb:parquet 25990606 / 26739715 / -2.8% 36086209 / 32045454 / +12.6% 🔴 0.72 / 0.83 / -13.7%
tpcds_q29/duckdb:parquet 32450040 / 32013452 / +1.4% 39389976 / 39504084 / -0.3% 0.82 / 0.81 / +1.7%
tpcds_q30/duckdb:parquet 35726210 / 35450708 / +0.8% 45092499 / 44119719 / +2.2% 0.79 / 0.80 / -1.4%
tpcds_q31/duckdb:parquet 36091489 / 35677916 / +1.2% 42723336 / 42583433 / +0.3% 0.84 / 0.84 / +0.8%
tpcds_q32/duckdb:parquet 14223331 / 14102332 / +0.9% 21405015 / 20399383 / +4.9% 0.66 / 0.69 / -3.9%
tpcds_q33/duckdb:parquet 23291629 / 23393406 / -0.4% 29272140 / 29258331 / +0.0% 0.80 / 0.80 / -0.5%
tpcds_q34/duckdb:parquet 17046863 / 16847006 / +1.2% 24204005 / 23831386 / +1.6% 0.70 / 0.71 / -0.4%
tpcds_q35/duckdb:parquet 35363642 / 35160966 / +0.6% 44703690 / 43216754 / +3.4% 0.79 / 0.81 / -2.8%
tpcds_q36/duckdb:parquet 39691014 / 40528370 / -2.1% 48214766 / 48206036 / +0.0% 0.82 / 0.84 / -2.1%
tpcds_q37/duckdb:parquet 12724940 / 12536556 / +1.5% 19635663 / 19338033 / +1.5% 0.65 / 0.65 / -0.0%
tpcds_q38/duckdb:parquet 29718168 / 29604896 / +0.4% 34181936 / 34725271 / -1.6% 0.87 / 0.85 / +2.0%
tpcds_q39/duckdb:parquet 23513234 / 22951978 / +2.4% 30129221 / 29790464 / +1.1% 0.78 / 0.77 / +1.3%
tpcds_q40/duckdb:parquet 16001224 / 15762304 / +1.5% 21595241 / 21264040 / +1.6% 0.74 / 0.74 / -0.0%
tpcds_q41/duckdb:parquet 11900784 / 11778012 / +1.0% 18002123 / 17873512 / +0.7% 0.66 / 0.66 / +0.3%
tpcds_q42/duckdb:parquet 9578100 / 9452001 / +1.3% 15405075 / 15903657 / -3.1% 0.62 / 0.59 / +4.6%
tpcds_q43/duckdb:parquet 11982942 / 12021493 / -0.3% 18107670 / 17791433 / +1.8% 0.66 / 0.68 / -2.1%
tpcds_q44/duckdb:parquet 21215326 / 21206214 / +0.0% 29968155 / 28037543 / +6.9% 0.71 / 0.76 / -6.4%
tpcds_q45/duckdb:parquet 21115697 / 20654280 / +2.2% 27995531 / 28030506 / -0.1% 0.75 / 0.74 / +2.4%
tpcds_q46/duckdb:parquet 38485785 / 34979178 / +10.0% 🔴 44267879 / 43702533 / +1.3% 0.87 / 0.80 / +8.6%
tpcds_q47/duckdb:parquet 34569456 / 35881100 / -3.7% 41553971 / 41912668 / -0.9% 0.83 / 0.86 / -2.8%
tpcds_q48/duckdb:parquet 30938862 / 28464106 / +8.7% 37056665 / 37075104 / -0.0% 0.83 / 0.77 / +8.7%
tpcds_q49/duckdb:parquet 30212746 / 29716134 / +1.7% 36486012 / 36020069 / +1.3% 0.83 / 0.82 / +0.4%
tpcds_q50/duckdb:parquet 20149830 / 19233764 / +4.8% 25821217 / 25510294 / +1.2% 0.78 / 0.75 / +3.5%
tpcds_q51/duckdb:parquet 53392553 / 51793932 / +3.1% 60769518 / 59627006 / +1.9% 0.88 / 0.87 / +1.1%
tpcds_q52/duckdb:parquet 9641176 / 9604489 / +0.4% 15588653 / 15965584 / -2.4% 0.62 / 0.60 / +2.8%
tpcds_q53/duckdb:parquet 13924344 / 14799949 / -5.9% 21007602 / 20698810 / +1.5% 0.66 / 0.72 / -7.3%
tpcds_q54/duckdb:parquet 24870328 / 24601857 / +1.1% 32186944 / 31995731 / +0.6% 0.77 / 0.77 / +0.5%
tpcds_q55/duckdb:parquet 9538257 / 9518885 / +0.2% 15289092 / 14945950 / +2.3% 0.62 / 0.64 / -2.0%
tpcds_q56/duckdb:parquet 24871888 / 25819527 / -3.7% 30639554 / 30505955 / +0.4% 0.81 / 0.85 / -4.1%
tpcds_q57/duckdb:parquet 30822425 / 30324176 / +1.6% 36201510 / 36067900 / +0.4% 0.85 / 0.84 / +1.3%
tpcds_q58/duckdb:parquet 24306287 / 23658999 / +2.7% 29843547 / 29989993 / -0.5% 0.81 / 0.79 / +3.2%
tpcds_q59/duckdb:parquet 22945826 / 22715550 / +1.0% 29008671 / 28516381 / +1.7% 0.79 / 0.80 / -0.7%
tpcds_q60/duckdb:parquet 27824581 / 28772644 / -3.3% 32699946 / 31547871 / +3.7% 0.85 / 0.91 / -6.7%
tpcds_q61/duckdb:parquet 25134160 / 22654250 / +10.9% 🔴 29843443 / 28799872 / +3.6% 0.84 / 0.79 / +7.1%
tpcds_q62/duckdb:parquet 12944384 / 12587796 / +2.8% 17855039 / 18021569 / -0.9% 0.72 / 0.70 / +3.8%
tpcds_q63/duckdb:parquet 13232500 / 13327499 / -0.7% 20192562 / 19546299 / +3.3% 0.66 / 0.68 / -3.9%
tpcds_q64/duckdb:parquet 70353876 / 70047448 / +0.4% 81457111 / 80302790 / +1.4% 0.86 / 0.87 / -1.0%
tpcds_q65/duckdb:parquet 19821502 / 20217172 / -2.0% 25666456 / 25529908 / +0.5% 0.77 / 0.79 / -2.5%
tpcds_q66/duckdb:parquet 33544247 / 32952929 / +1.8% 38244739 / 37975195 / +0.7% 0.88 / 0.87 / +1.1%
tpcds_q67/duckdb:parquet 61076726 / 60710902 / +0.6% 67737404 / 67548199 / +0.3% 0.90 / 0.90 / +0.3%
tpcds_q68/duckdb:parquet 28100793 / 28193414 / -0.3% 37103530 / 36648542 / +1.2% 0.76 / 0.77 / -1.6%
tpcds_q69/duckdb:parquet 25839508 / 25565886 / +1.1% 34487817 / 34370575 / +0.3% 0.75 / 0.74 / +0.7%
tpcds_q70/duckdb:parquet 19474958 / 18994991 / +2.5% 27461758 / 27165944 / +1.1% 0.71 / 0.70 / +1.4%
tpcds_q71/duckdb:parquet 17107510 / 16996013 / +0.7% 24079446 / 24069617 / +0.0% 0.71 / 0.71 / +0.6%
tpcds_q72/duckdb:parquet 53950480 / 52914300 / +2.0% 60322060 / 60799384 / -0.8% 0.89 / 0.87 / +2.8%
tpcds_q73/duckdb:parquet 16121554 / 17123004 / -5.8% 21754911 / 21429990 / +1.5% 0.74 / 0.80 / -7.3%
tpcds_q74/duckdb:parquet 84356142 / 84352839 / +0.0% 90910838 / 91483682 / -0.6% 0.93 / 0.92 / +0.6%
tpcds_q75/duckdb:parquet 43339522 / 44422710 / -2.4% 50754066 / 49328071 / +2.9% 0.85 / 0.90 / -5.2%
tpcds_q76/duckdb:parquet 18653978 / 18969841 / -1.7% 24015655 / 23318519 / +3.0% 0.78 / 0.81 / -4.5%
tpcds_q77/duckdb:parquet 25994307 / 24522716 / +6.0% 31104505 / 31658383 / -1.7% 0.84 / 0.77 / +7.9%
tpcds_q78/duckdb:parquet 78349507 / 77443056 / +1.2% 85182599 / 85745445 / -0.7% 0.92 / 0.90 / +1.8%
tpcds_q79/duckdb:parquet 23607464 / 22094180 / +6.8% 28907803 / 28669882 / +0.8% 0.82 / 0.77 / +6.0%
tpcds_q80/duckdb:parquet 38364470 / 36054931 / +6.4% 44311820 / 43586910 / +1.7% 0.87 / 0.83 / +4.7%
tpcds_q81/duckdb:parquet 36446013 / 36021944 / +1.2% 45142344 / 44763260 / +0.8% 0.81 / 0.80 / +0.3%
tpcds_q82/duckdb:parquet 13598416 / 13228790 / +2.8% 20543480 / 20475320 / +0.3% 0.66 / 0.65 / +2.5%
tpcds_q83/duckdb:parquet 20505983 / 20072742 / +2.2% 25348988 / 24907704 / +1.8% 0.81 / 0.81 / +0.4%
tpcds_q84/duckdb:parquet 22947644 / 22687839 / +1.1% 29229563 / 28838461 / +1.4% 0.79 / 0.79 / -0.2%
tpcds_q85/duckdb:parquet 32309772 / 32285298 / +0.1% 40055999 / 39467220 / +1.5% 0.81 / 0.82 / -1.4%
tpcds_q86/duckdb:parquet 11785606 / 11767439 / +0.2% 16976196 / 17070648 / -0.6% 0.69 / 0.69 / +0.7%
tpcds_q87/duckdb:parquet 31690580 / 31088622 / +1.9% 36000000 / 35090607 / +2.6% 0.88 / 0.89 / -0.6%
tpcds_q88/duckdb:parquet 38685260 / 37963096 / +1.9% 42432752 / 43231823 / -1.8% 0.91 / 0.88 / +3.8%
tpcds_q89/duckdb:parquet 14284378 / 16159594 / -11.6% 🟢 21489932 / 21289657 / +0.9% 0.66 / 0.76 / -12.4%
tpcds_q90/duckdb:parquet 10355873 / 9877285 / +4.8% 15265928 / 14985604 / +1.9% 0.68 / 0.66 / +2.9%
tpcds_q91/duckdb:parquet 21165182 / 20841364 / +1.6% 28528206 / 28278317 / +0.9% 0.74 / 0.74 / +0.7%
tpcds_q92/duckdb:parquet 15621802 / 15477478 / +0.9% 22026984 / 22010990 / +0.1% 0.71 / 0.70 / +0.9%
tpcds_q93/duckdb:parquet 14180638 / 14143470 / +0.3% 20407782 / 20201736 / +1.0% 0.69 / 0.70 / -0.7%
tpcds_q94/duckdb:parquet 25558968 / 25283519 / +1.1% 32639158 / 32712192 / -0.2% 0.78 / 0.77 / +1.3%
tpcds_q95/duckdb:parquet 44018252 / 43956673 / +0.1% 50209481 / 49236862 / +2.0% 0.88 / 0.89 / -1.8%
tpcds_q96/duckdb:parquet 8148958 / 8173010 / -0.3% 14009539 / 13773953 / +1.7% 0.58 / 0.59 / -2.0%
tpcds_q97/duckdb:parquet 27541996 / 27736471 / -0.7% 34461969 / 33798251 / +2.0% 0.80 / 0.82 / -2.6%
tpcds_q98/duckdb:parquet 16475433 / 16453228 / +0.1% 23039774 / 23265185 / -1.0% 0.72 / 0.71 / +1.1%
tpcds_q99/duckdb:parquet 18860965 / 18754106 / +0.6% 24599359 / 24643634 / -0.2% 0.77 / 0.76 / +0.8%

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 18748c51 vs base 7d003295
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.6%
Engines: DataFusion No clear signal (-1.6%, low confidence) · DuckDB No clear signal (-5.5%, low confidence)
Vortex (geomean): hot 0.967x ➖ · cold 0.959x ➖
Parquet (geomean): hot 1.003x ➖ · cold 1.018x ➖
Shifts: Parquet (control) +0.3% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.986x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 90970164 / 91927179 / -1.0% 153930484 / 152931225 / +0.7% 0.59 / 0.60 / -1.7%
tpch_q02/datafusion:vortex-file-compressed 64906437 / 64459457 / +0.7% 96228057 / 94341774 / +2.0% 0.67 / 0.68 / -1.3%
tpch_q03/datafusion:vortex-file-compressed 63801602 / 62973188 / +1.3% 119991318 / 124205118 / -3.4% 0.53 / 0.51 / +4.9%
tpch_q04/datafusion:vortex-file-compressed 34539187 / 34382565 / +0.5% 72241583 / 73445672 / -1.6% 0.48 / 0.47 / +2.1%
tpch_q05/datafusion:vortex-file-compressed 115121739 / 117870958 / -2.3% 166781581 / 186876488 / -10.8% 🟢 0.69 / 0.63 / +9.4%
tpch_q06/datafusion:vortex-file-compressed 10182826 / 10354894 / -1.7% 59108832 / 57611018 / +2.6% 0.17 / 0.18 / -4.2%
tpch_q07/datafusion:vortex-file-compressed 133057392 / 133462336 / -0.3% 186466341 / 193091747 / -3.4% 0.71 / 0.69 / +3.2%
tpch_q08/datafusion:vortex-file-compressed 138768933 / 143881173 / -3.6% 208948897 / 226087783 / -7.6% 0.66 / 0.64 / +4.4%
tpch_q09/datafusion:vortex-file-compressed 177975014 / 182927140 / -2.7% 241434887 / 271317983 / -11.0% 🟢 0.74 / 0.67 / +9.3%
tpch_q10/datafusion:vortex-file-compressed 69970622 / 70214312 / -0.3% 136316350 / 133074456 / +2.4% 0.51 / 0.53 / -2.7%
tpch_q11/datafusion:vortex-file-compressed 42792560 / 43385373 / -1.4% 70406729 / 68915306 / +2.2% 0.61 / 0.63 / -3.5%
tpch_q12/datafusion:vortex-file-compressed 34347931 / 35298848 / -2.7% 81688989 / 80719515 / +1.2% 0.42 / 0.44 / -3.8%
tpch_q13/datafusion:vortex-file-compressed 48082826 / 48773432 / -1.4% 79039113 / 80415648 / -1.7% 0.61 / 0.61 / +0.3%
tpch_q14/datafusion:vortex-file-compressed 21587936 / 21387378 / +0.9% 88773513 / 85138888 / +4.3% 0.24 / 0.25 / -3.2%
tpch_q15/datafusion:vortex-file-compressed 35397960 / 33968373 / +4.2% 92120411 / 90308123 / +2.0% 0.38 / 0.38 / +2.2%
tpch_q16/datafusion:vortex-file-compressed 36628928 / 37506751 / -2.3% 66060609 / 67445416 / -2.1% 0.55 / 0.56 / -0.3%
tpch_q17/datafusion:vortex-file-compressed 173122111 / 178339209 / -2.9% 217810610 / 230493104 / -5.5% 0.79 / 0.77 / +2.7%
tpch_q18/datafusion:vortex-file-compressed 199318963 / 204931038 / -2.7% 266191710 / 274943699 / -3.2% 0.75 / 0.75 / +0.5%
tpch_q19/datafusion:vortex-file-compressed 25967785 / 29714890 / -12.6% 🟢 86437013 / 89709712 / -3.6% 0.30 / 0.33 / -9.3%
tpch_q20/datafusion:vortex-file-compressed 61762576 / 60264945 / +2.5% 120413010 / 114344360 / +5.3% 0.51 / 0.53 / -2.7%
tpch_q21/datafusion:vortex-file-compressed 178345119 / 178308704 / +0.0% 236720971 / 252308111 / -6.2% 0.75 / 0.71 / +6.6%
tpch_q22/datafusion:vortex-file-compressed 25207764 / 25501952 / -1.2% 53970180 / 52519228 / +2.8% 0.47 / 0.49 / -3.8%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87413778 / 87642853 / -0.3% 127443073 / 122984934 / +3.6% 0.69 / 0.71 / -3.8%
tpch_q02/datafusion:parquet 174214511 / 173697706 / +0.3% 199407158 / 204168135 / -2.3% 0.87 / 0.85 / +2.7%
tpch_q03/datafusion:parquet 134894485 / 135151719 / -0.2% 180046869 / 180608900 / -0.3% 0.75 / 0.75 / +0.1%
tpch_q04/datafusion:parquet 57694685 / 57215942 / +0.8% 92907171 / 86662584 / +7.2% 0.62 / 0.66 / -5.9%
tpch_q05/datafusion:parquet 166537893 / 166808415 / -0.2% 227318817 / 222099140 / +2.4% 0.73 / 0.75 / -2.5%
tpch_q06/datafusion:parquet 36529345 / 36634623 / -0.3% 75509710 / 74017883 / +2.0% 0.48 / 0.49 / -2.3%
tpch_q07/datafusion:parquet 217108379 / 215122936 / +0.9% 277056878 / 264974973 / +4.6% 0.78 / 0.81 / -3.5%
tpch_q08/datafusion:parquet 218467887 / 217567525 / +0.4% 280326117 / 282702134 / -0.8% 0.78 / 0.77 / +1.3%
tpch_q09/datafusion:parquet 308094814 / 308598865 / -0.2% 380886667 / 369887696 / +3.0% 0.81 / 0.83 / -3.0%
tpch_q10/datafusion:parquet 312195572 / 311492428 / +0.2% 376663000 / 367258630 / +2.6% 0.83 / 0.85 / -2.3%
tpch_q11/datafusion:parquet 126950878 / 127077840 / -0.1% 149994347 / 150579327 / -0.4% 0.85 / 0.84 / +0.3%
tpch_q12/datafusion:parquet 82658144 / 82578884 / +0.1% 118903179 / 117949492 / +0.8% 0.70 / 0.70 / -0.7%
tpch_q13/datafusion:parquet 211001018 / 210867946 / +0.1% 242749584 / 239025138 / +1.6% 0.87 / 0.88 / -1.5%
tpch_q14/datafusion:parquet 85927773 / 85673762 / +0.3% 187441720 / 187342195 / +0.1% 0.46 / 0.46 / +0.2%
tpch_q15/datafusion:parquet 106211287 / 106133621 / +0.1% 153979126 / 153870857 / +0.1% 0.69 / 0.69 / +0.0%
tpch_q16/datafusion:parquet 95140814 / 94926038 / +0.2% 120038127 / 116732172 / +2.8% 0.79 / 0.81 / -2.5%
tpch_q17/datafusion:parquet 214537847 / 213729165 / +0.4% 265417761 / 261583620 / +1.5% 0.81 / 0.82 / -1.1%
tpch_q18/datafusion:parquet 270581811 / 268279729 / +0.9% 312162576 / 313417604 / -0.4% 0.87 / 0.86 / +1.3%
tpch_q19/datafusion:parquet 108557817 / 108555469 / +0.0% 165843492 / 164062392 / +1.1% 0.65 / 0.66 / -1.1%
tpch_q20/datafusion:parquet 186258300 / 185957527 / +0.2% 241116038 / 239381281 / +0.7% 0.77 / 0.78 / -0.6%
tpch_q21/datafusion:parquet 244018894 / 241099349 / +1.2% 313020849 / 308602429 / +1.4% 0.78 / 0.78 / -0.2%
tpch_q22/datafusion:parquet 150457414 / 149656687 / +0.5% 175268859 / 172983714 / +1.3% 0.86 / 0.87 / -0.8%
duckdb / vortex-file-compressed / ns (0.948x ➖, 4↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 31811018 / 33635848 / -5.4% 61211670 / 70669291 / -13.4% 🟢 0.52 / 0.48 / +9.2%
tpch_q02/duckdb:vortex-file-compressed 28117980 / 28184988 / -0.2% 43574032 / 42309746 / +3.0% 0.65 / 0.67 / -3.1%
tpch_q03/duckdb:vortex-file-compressed 49257944 / 53185643 / -7.4% 91663476 / 104868120 / -12.6% 🟢 0.54 / 0.51 / +6.0%
tpch_q04/duckdb:vortex-file-compressed 50866401 / 52086544 / -2.3% 79645181 / 91629210 / -13.1% 🟢 0.64 / 0.57 / +12.4%
tpch_q05/duckdb:vortex-file-compressed 68649331 / 69096400 / -0.6% 107969756 / 110554147 / -2.3% 0.64 / 0.63 / +1.7%
tpch_q06/duckdb:vortex-file-compressed 12050663 / 15828127 / -23.9% 🟢 44561597 / 52020574 / -14.3% 🟢 0.27 / 0.30 / -11.1%
tpch_q07/duckdb:vortex-file-compressed 55356511 / 54634878 / +1.3% 108064406 / 106980648 / +1.0% 0.51 / 0.51 / +0.3%
tpch_q08/duckdb:vortex-file-compressed 87850672 / 87602045 / +0.3% 129156706 / 133705811 / -3.4% 0.68 / 0.66 / +3.8%
tpch_q09/duckdb:vortex-file-compressed 98394554 / 101922502 / -3.5% 153355963 / 156627696 / -2.1% 0.64 / 0.65 / -1.4%
tpch_q10/duckdb:vortex-file-compressed 94470034 / 95990698 / -1.6% 138488434 / 150710063 / -8.1% 0.68 / 0.64 / +7.1%
tpch_q11/duckdb:vortex-file-compressed 12814633 / 13563517 / -5.5% 28435270 / 29141981 / -2.4% 0.45 / 0.47 / -3.2%
tpch_q12/duckdb:vortex-file-compressed 42113346 / 45600874 / -7.6% 74483251 / 81979084 / -9.1% 0.57 / 0.56 / +1.6%
tpch_q13/duckdb:vortex-file-compressed 69860301 / 71387235 / -2.1% 89562281 / 103062305 / -13.1% 🟢 0.78 / 0.69 / +12.6%
tpch_q14/duckdb:vortex-file-compressed 26407455 / 28213368 / -6.4% 70125270 / 74022446 / -5.3% 0.38 / 0.38 / -1.2%
tpch_q15/duckdb:vortex-file-compressed 21033036 / 25090186 / -16.2% 🟢 57631476 / 61863402 / -6.8% 0.36 / 0.41 / -10.0%
tpch_q16/duckdb:vortex-file-compressed 45708123 / 49048126 / -6.8% 56148351 / 58853771 / -4.6% 0.81 / 0.83 / -2.3%
tpch_q17/duckdb:vortex-file-compressed 32850151 / 35489929 / -7.4% 64257853 / 68853209 / -6.7% 0.51 / 0.52 / -0.8%
tpch_q18/duckdb:vortex-file-compressed 103687376 / 102221518 / +1.4% 118715707 / 120771771 / -1.7% 0.87 / 0.85 / +3.2%
tpch_q19/duckdb:vortex-file-compressed 24128378 / 28187932 / -14.4% 🟢 73189609 / 75749405 / -3.4% 0.33 / 0.37 / -11.4%
tpch_q20/duckdb:vortex-file-compressed 37528405 / 42122763 / -10.9% 🟢 81970357 / 92769454 / -11.6% 🟢 0.46 / 0.45 / +0.8%
tpch_q21/duckdb:vortex-file-compressed 88650404 / 95877464 / -7.5% 132113117 / 146601814 / -9.9% 0.67 / 0.65 / +2.6%
tpch_q22/duckdb:vortex-file-compressed 39203970 / 32840958 / +19.4% 🔴 50324494 / 48746156 / +3.2% 0.78 / 0.67 / +15.6%
duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67763594 / 67599647 / +0.2% 88384502 / 87853925 / +0.6% 0.77 / 0.77 / -0.4%
tpch_q02/duckdb:parquet 87120424 / 87335189 / -0.2% 97465846 / 97610472 / -0.1% 0.89 / 0.89 / -0.1%
tpch_q03/duckdb:parquet 110416663 / 110254834 / +0.1% 144676248 / 141617397 / +2.2% 0.76 / 0.78 / -2.0%
tpch_q04/duckdb:parquet 76695649 / 76311587 / +0.5% 99561279 / 97077527 / +2.6% 0.77 / 0.79 / -2.0%
tpch_q05/duckdb:parquet 122857087 / 124241877 / -1.1% 157834862 / 154777056 / +2.0% 0.78 / 0.80 / -3.0%
tpch_q06/duckdb:parquet 35409443 / 35433863 / -0.1% 62766281 / 55514372 / +13.1% 🔴 0.56 / 0.64 / -11.6%
tpch_q07/duckdb:parquet 117687611 / 116515426 / +1.0% 154677333 / 154082550 / +0.4% 0.76 / 0.76 / +0.6%
tpch_q08/duckdb:parquet 147055607 / 151046815 / -2.6% 194293041 / 191779212 / +1.3% 0.76 / 0.79 / -3.9%
tpch_q09/duckdb:parquet 236995591 / 235788454 / +0.5% 282911243 / 280072999 / +1.0% 0.84 / 0.84 / -0.5%
tpch_q10/duckdb:parquet 314154743 / 313875353 / +0.1% 342423841 / 336103399 / +1.9% 0.92 / 0.93 / -1.8%
tpch_q11/duckdb:parquet 43786280 / 43606254 / +0.4% 51439925 / 50480563 / +1.9% 0.85 / 0.86 / -1.5%
tpch_q12/duckdb:parquet 71860718 / 70610211 / +1.8% 91928111 / 90356570 / +1.7% 0.78 / 0.78 / +0.0%
tpch_q13/duckdb:parquet 293548534 / 291504598 / +0.7% 311179813 / 307672578 / +1.1% 0.94 / 0.95 / -0.4%
tpch_q14/duckdb:parquet 102774546 / 102019094 / +0.7% 139433943 / 133784745 / +4.2% 0.74 / 0.76 / -3.3%
tpch_q15/duckdb:parquet 57525646 / 57658054 / -0.2% 85710357 / 85710384 / -0.0% 0.67 / 0.67 / -0.2%
tpch_q16/duckdb:parquet 100971775 / 100545748 / +0.4% 108805956 / 107804617 / +0.9% 0.93 / 0.93 / -0.5%
tpch_q17/duckdb:parquet 81425499 / 83249255 / -2.2% 116151835 / 113716280 / +2.1% 0.70 / 0.73 / -4.2%
tpch_q18/duckdb:parquet 159987996 / 153891960 / +4.0% 172082243 / 169067961 / +1.8% 0.93 / 0.91 / +2.1%
tpch_q19/duckdb:parquet 98911122 / 97317756 / +1.6% 134150154 / 127628551 / +5.1% 0.74 / 0.76 / -3.3%
tpch_q20/duckdb:parquet 147152513 / 146821350 / +0.2% 186397485 / 181081472 / +2.9% 0.79 / 0.81 / -2.6%
tpch_q21/duckdb:parquet 252477494 / 252240967 / +0.1% 277758366 / 281410390 / -1.3% 0.91 / 0.90 / +1.4%
tpch_q22/duckdb:parquet 168394117 / 168265903 / +0.1% 180142158 / 178583297 / +0.9% 0.93 / 0.94 / -0.8%

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 18748c51 vs base 7d003295
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +6.4%
Engines: DataFusion No clear signal (+5.1%, low confidence) · DuckDB No clear signal (+7.6%, low confidence)
Vortex (geomean): hot 1.070x ➖ · cold 1.018x ➖
Parquet (geomean): hot 1.006x ➖ · cold 1.036x ➖
Shifts: Parquet (control) +0.6% · Median polish +1.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.063x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6038790 / 6146428 / -1.8% 19545395 / 20762435 / -5.9% 0.31 / 0.30 / +4.4%
fineweb_q01/datafusion:vortex-file-compressed 8799788 / 9176894 / -4.1% 39204397 / 39929431 / -1.8% 0.22 / 0.23 / -2.3%
fineweb_q02/datafusion:vortex-file-compressed 11595781 / 11156568 / +3.9% 43988375 / 39873646 / +10.3% 🔴 0.26 / 0.28 / -5.8%
fineweb_q03/datafusion:vortex-file-compressed 25916820 / 17910252 / +44.7% 🔴 129070796 / 109263279 / +18.1% 🔴 0.20 / 0.16 / +22.5%
fineweb_q04/datafusion:vortex-file-compressed 66420048 / 65085618 / +2.1% 150992938 / 148937266 / +1.4% 0.44 / 0.44 / +0.7%
fineweb_q05/datafusion:vortex-file-compressed 63652310 / 62229160 / +2.3% 147336352 / 141987296 / +3.8% 0.43 / 0.44 / -1.4%
fineweb_q06/datafusion:vortex-file-compressed 16123744 / 17961812 / -10.2% 🟢 114329599 / 105307889 / +8.6% 0.14 / 0.17 / -17.3%
fineweb_q07/datafusion:vortex-file-compressed 16652148 / 17680416 / -5.8% 115751497 / 107978674 / +7.2% 0.14 / 0.16 / -12.1%
fineweb_q08/datafusion:vortex-file-compressed 11053559 / 7975267 / +38.6% 🔴 29237719 / 27772047 / +5.3% 0.38 / 0.29 / +31.7%
datafusion / parquet / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9706924 / 9303958 / +4.3% 35204094 / 33403895 / +5.4% 0.28 / 0.28 / -1.0%
fineweb_q01/datafusion:parquet 73948550 / 74993567 / -1.4% 179837494 / 152936389 / +17.6% 🔴 0.41 / 0.49 / -16.1%
fineweb_q02/datafusion:parquet 75178538 / 74211041 / +1.3% 168694543 / 160492419 / +5.1% 0.45 / 0.46 / -3.6%
fineweb_q03/datafusion:parquet 74140490 / 73830646 / +0.4% 152797648 / 150853494 / +1.3% 0.49 / 0.49 / -0.9%
fineweb_q04/datafusion:parquet 82952958 / 81621790 / +1.6% 159776129 / 152618398 / +4.7% 0.52 / 0.53 / -2.9%
fineweb_q05/datafusion:parquet 81542312 / 82285412 / -0.9% 169316962 / 153566225 / +10.3% 🔴 0.48 / 0.54 / -10.1%
fineweb_q06/datafusion:parquet 76407700 / 76381166 / +0.0% 176513616 / 162217293 / +8.8% 0.43 / 0.47 / -8.1%
fineweb_q07/datafusion:parquet 76139000 / 73435936 / +3.7% 166293825 / 156761669 / +6.1% 0.46 / 0.47 / -2.3%
fineweb_q08/datafusion:parquet 72979297 / 72095371 / +1.2% 155245161 / 154520130 / +0.5% 0.47 / 0.47 / +0.8%
duckdb / vortex-file-compressed / ns (1.077x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2117045 / 2067494 / +2.4% 7397877 / 8174770 / -9.5% 0.29 / 0.25 / +13.1%
fineweb_q01/duckdb:vortex-file-compressed 9023704 / 7822610 / +15.4% 🔴 25890170 / 26106803 / -0.8% 0.35 / 0.30 / +16.3%
fineweb_q02/duckdb:vortex-file-compressed 9917826 / 9309606 / +6.5% 30233713 / 30447070 / -0.7% 0.33 / 0.31 / +7.3%
fineweb_q03/duckdb:vortex-file-compressed 23686752 / 19216738 / +23.3% 🔴 95680507 / 94181125 / +1.6% 0.25 / 0.20 / +21.3%
fineweb_q04/duckdb:vortex-file-compressed 71189636 / 65257482 / +9.1% 115615863 / 107135751 / +7.9% 0.62 / 0.61 / +1.1%
fineweb_q05/duckdb:vortex-file-compressed 69128210 / 64990359 / +6.4% 115635335 / 104338817 / +10.8% 🔴 0.60 / 0.62 / -4.0%
fineweb_q06/duckdb:vortex-file-compressed 18086238 / 18589388 / -2.7% 90494735 / 92047798 / -1.7% 0.20 / 0.20 / -1.0%
fineweb_q07/duckdb:vortex-file-compressed 18562747 / 18903267 / -1.8% 89726531 / 90729531 / -1.1% 0.21 / 0.21 / -0.7%
fineweb_q08/duckdb:vortex-file-compressed 5172915 / 4575650 / +13.1% 🔴 10739223 / 12778561 / -16.0% 🟢 0.48 / 0.36 / +34.5%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23582842 / 24137664 / -2.3% 28276717 / 27750887 / +1.9% 0.83 / 0.87 / -4.1%
fineweb_q01/duckdb:parquet 53661303 / 54965820 / -2.4% 75358587 / 71417631 / +5.5% 0.71 / 0.77 / -7.5%
fineweb_q02/duckdb:parquet 57512506 / 58103550 / -1.0% 75691173 / 71031685 / +6.6% 0.76 / 0.82 / -7.1%
fineweb_q03/duckdb:parquet 120866801 / 118369256 / +2.1% 178234194 / 180795681 / -1.4% 0.68 / 0.65 / +3.6%
fineweb_q04/duckdb:parquet 164412214 / 162588140 / +1.1% 206148811 / 209302471 / -1.5% 0.80 / 0.78 / +2.7%
fineweb_q05/duckdb:parquet 162714117 / 160206199 / +1.6% 191511159 / 196780193 / -2.7% 0.85 / 0.81 / +4.4%
fineweb_q06/duckdb:parquet 88731718 / 88302629 / +0.5% 148890215 / 150580177 / -1.1% 0.60 / 0.59 / +1.6%
fineweb_q07/duckdb:parquet 92795562 / 91124350 / +1.8% 145447724 / 143756855 / +1.2% 0.64 / 0.63 / +0.7%
fineweb_q08/duckdb:parquet 29001156 / 29311255 / -1.1% 30463318 / 30694140 / -0.8% 0.95 / 0.95 / -0.3%

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 18748c51 vs base 7d003295
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.0%
Engines: DataFusion No clear signal (-1.7%, low confidence) · DuckDB No clear signal (-2.3%, low confidence)
Vortex (geomean): hot 0.980x ➖ · cold 0.980x ➖
Parquet (geomean): hot 1.000x ➖ · cold 0.990x ➖
Shifts: Parquet (control) +0.0% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.983x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15819831 / 16684415 / -5.2% 42740532 / 45672802 / -6.4% 0.37 / 0.37 / +1.3%
tpch_q02/datafusion:vortex-file-compressed 16698423 / 16844280 / -0.9% 35296649 / 36923253 / -4.4% 0.47 / 0.46 / +3.7%
tpch_q03/datafusion:vortex-file-compressed 19538223 / 19845551 / -1.5% 48452962 / 47684891 / +1.6% 0.40 / 0.42 / -3.1%
tpch_q04/datafusion:vortex-file-compressed 10370969 / 10034715 / +3.4% 35674647 / 36853932 / -3.2% 0.29 / 0.27 / +6.8%
tpch_q05/datafusion:vortex-file-compressed 36755745 / 36864536 / -0.3% 69633446 / 66275949 / +5.1% 0.53 / 0.56 / -5.1%
tpch_q06/datafusion:vortex-file-compressed 4531933 / 6300079 / -28.1% 🟢 25693965 / 27891676 / -7.9% 0.18 / 0.23 / -21.9%
tpch_q07/datafusion:vortex-file-compressed 51674979 / 51426046 / +0.5% 80409611 / 82384588 / -2.4% 0.64 / 0.62 / +3.0%
tpch_q08/datafusion:vortex-file-compressed 52488650 / 51952257 / +1.0% 79894370 / 86045966 / -7.1% 0.66 / 0.60 / +8.8%
tpch_q09/datafusion:vortex-file-compressed 47119452 / 47007119 / +0.2% 78746945 / 80662800 / -2.4% 0.60 / 0.58 / +2.7%
tpch_q10/datafusion:vortex-file-compressed 17082248 / 17325667 / -1.4% 49451946 / 52209527 / -5.3% 0.35 / 0.33 / +4.1%
tpch_q11/datafusion:vortex-file-compressed 14211327 / 14151709 / +0.4% 33346616 / 33767822 / -1.2% 0.43 / 0.42 / +1.7%
tpch_q12/datafusion:vortex-file-compressed 18519554 / 18140729 / +2.1% 43313294 / 44934978 / -3.6% 0.43 / 0.40 / +5.9%
tpch_q13/datafusion:vortex-file-compressed 19141926 / 19488503 / -1.8% 37846300 / 42429985 / -10.8% 🟢 0.51 / 0.46 / +10.1%
tpch_q14/datafusion:vortex-file-compressed 14461243 / 14653984 / -1.3% 38074267 / 39501548 / -3.6% 0.38 / 0.37 / +2.4%
tpch_q15/datafusion:vortex-file-compressed 18681928 / 18908222 / -1.2% 44441179 / 45690210 / -2.7% 0.42 / 0.41 / +1.6%
tpch_q16/datafusion:vortex-file-compressed 18382281 / 18078174 / +1.7% 41460947 / 40367153 / +2.7% 0.44 / 0.45 / -1.0%
tpch_q17/datafusion:vortex-file-compressed 28261529 / 28455329 / -0.7% 58261451 / 57896635 / +0.6% 0.49 / 0.49 / -1.3%
tpch_q18/datafusion:vortex-file-compressed 35395461 / 35596044 / -0.6% 58536524 / 59809296 / -2.1% 0.60 / 0.60 / +1.6%
tpch_q19/datafusion:vortex-file-compressed 9793205 / 10072907 / -2.8% 36802152 / 41112267 / -10.5% 🟢 0.27 / 0.25 / +8.6%
tpch_q20/datafusion:vortex-file-compressed 20565852 / 20059491 / +2.5% 44751281 / 46401404 / -3.6% 0.46 / 0.43 / +6.3%
tpch_q21/datafusion:vortex-file-compressed 38885763 / 38891037 / -0.0% 71570691 / 71950395 / -0.5% 0.54 / 0.54 / +0.5%
tpch_q22/datafusion:vortex-file-compressed 10964983 / 10715278 / +2.3% 30237095 / 30748564 / -1.7% 0.36 / 0.35 / +4.1%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72005728 / 71810801 / +0.3% 88580496 / 88366315 / +0.2% 0.81 / 0.81 / +0.0%
tpch_q02/datafusion:parquet 76021355 / 74899176 / +1.5% 93584707 / 93034321 / +0.6% 0.81 / 0.81 / +0.9%
tpch_q03/datafusion:parquet 81970751 / 81832078 / +0.2% 101220876 / 105719135 / -4.3% 0.81 / 0.77 / +4.6%
tpch_q04/datafusion:parquet 39319404 / 39520189 / -0.5% 58247851 / 63186021 / -7.8% 0.68 / 0.63 / +7.9%
tpch_q05/datafusion:parquet 110841993 / 109733676 / +1.0% 137181043 / 141424637 / -3.0% 0.81 / 0.78 / +4.1%
tpch_q06/datafusion:parquet 31558372 / 31202132 / +1.1% 48866408 / 48128642 / +1.5% 0.65 / 0.65 / -0.4%
tpch_q07/datafusion:parquet 112894785 / 113006019 / -0.1% 139644985 / 139607633 / +0.0% 0.81 / 0.81 / -0.1%
tpch_q08/datafusion:parquet 117039500 / 117913452 / -0.7% 144163086 / 146097776 / -1.3% 0.81 / 0.81 / +0.6%
tpch_q09/datafusion:parquet 137749684 / 137557339 / +0.1% 165002952 / 171741557 / -3.9% 0.83 / 0.80 / +4.2%
tpch_q10/datafusion:parquet 103344427 / 103418438 / -0.1% 130451644 / 131136560 / -0.5% 0.79 / 0.79 / +0.5%
tpch_q11/datafusion:parquet 62083526 / 61237832 / +1.4% 82339956 / 82254617 / +0.1% 0.75 / 0.74 / +1.3%
tpch_q12/datafusion:parquet 63596630 / 63738266 / -0.2% 86868435 / 85666385 / +1.4% 0.73 / 0.74 / -1.6%
tpch_q13/datafusion:parquet 142956810 / 143191276 / -0.2% 164406339 / 163426767 / +0.6% 0.87 / 0.88 / -0.8%
tpch_q14/datafusion:parquet 47311167 / 47673923 / -0.8% 68795400 / 71344440 / -3.6% 0.69 / 0.67 / +2.9%
tpch_q15/datafusion:parquet 73761353 / 74430717 / -0.9% 92966658 / 97067640 / -4.2% 0.79 / 0.77 / +3.5%
tpch_q16/datafusion:parquet 43158147 / 43358602 / -0.5% 60696335 / 64677264 / -6.2% 0.71 / 0.67 / +6.1%
tpch_q17/datafusion:parquet 124422637 / 124128220 / +0.2% 146295132 / 150644762 / -2.9% 0.85 / 0.82 / +3.2%
tpch_q18/datafusion:parquet 120555170 / 120950044 / -0.3% 142718018 / 146722231 / -2.7% 0.84 / 0.82 / +2.5%
tpch_q19/datafusion:parquet 57110120 / 56451714 / +1.2% 80634418 / 83675374 / -3.6% 0.71 / 0.67 / +5.0%
tpch_q20/datafusion:parquet 77905617 / 78268986 / -0.5% 102074675 / 106433135 / -4.1% 0.76 / 0.74 / +3.8%
tpch_q21/datafusion:parquet 113394220 / 113610876 / -0.2% 138499832 / 139347651 / -0.6% 0.82 / 0.82 / +0.4%
tpch_q22/datafusion:parquet 51239268 / 51653423 / -0.8% 66223583 / 70861056 / -6.5% 0.77 / 0.73 / +6.1%
duckdb / vortex-file-compressed / ns (0.977x ➖, 3↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9267436 / 9295091 / -0.3% 20923385 / 20911811 / +0.1% 0.44 / 0.44 / -0.4%
tpch_q02/duckdb:vortex-file-compressed 15009231 / 15180001 / -1.1% 25330494 / 24884492 / +1.8% 0.59 / 0.61 / -2.9%
tpch_q03/duckdb:vortex-file-compressed 18241109 / 18973977 / -3.9% 34346948 / 35322386 / -2.8% 0.53 / 0.54 / -1.1%
tpch_q04/duckdb:vortex-file-compressed 11966731 / 12268094 / -2.5% 25451184 / 26999093 / -5.7% 0.47 / 0.45 / +3.5%
tpch_q05/duckdb:vortex-file-compressed 19858422 / 20119554 / -1.3% 35482356 / 36519578 / -2.8% 0.56 / 0.55 / +1.6%
tpch_q06/duckdb:vortex-file-compressed 4416948 / 4732691 / -6.7% 14604614 / 14423759 / +1.3% 0.30 / 0.33 / -7.8%
tpch_q07/duckdb:vortex-file-compressed 21611546 / 24938861 / -13.3% 🟢 38410069 / 37822266 / +1.6% 0.56 / 0.66 / -14.7%
tpch_q08/duckdb:vortex-file-compressed 20856809 / 21215210 / -1.7% 37235061 / 39439714 / -5.6% 0.56 / 0.54 / +4.1%
tpch_q09/duckdb:vortex-file-compressed 21911278 / 22109211 / -0.9% 40460217 / 37943365 / +6.6% 0.54 / 0.58 / -7.1%
tpch_q10/duckdb:vortex-file-compressed 22236804 / 23104351 / -3.8% 38643424 / 39742353 / -2.8% 0.58 / 0.58 / -1.0%
tpch_q11/duckdb:vortex-file-compressed 8272593 / 8138096 / +1.7% 17367306 / 17590888 / -1.3% 0.48 / 0.46 / +3.0%
tpch_q12/duckdb:vortex-file-compressed 12680433 / 14670245 / -13.6% 🟢 25050683 / 27249726 / -8.1% 0.51 / 0.54 / -6.0%
tpch_q13/duckdb:vortex-file-compressed 20245840 / 19414637 / +4.3% 30596558 / 32745986 / -6.6% 0.66 / 0.59 / +11.6%
tpch_q14/duckdb:vortex-file-compressed 13117858 / 11358287 / +15.5% 🔴 25868939 / 23439478 / +10.4% 🔴 0.51 / 0.48 / +4.6%
tpch_q15/duckdb:vortex-file-compressed 8189792 / 8496411 / -3.6% 19818803 / 21803845 / -9.1% 0.41 / 0.39 / +6.0%
tpch_q16/duckdb:vortex-file-compressed 16643647 / 16737240 / -0.6% 23743959 / 23249444 / +2.1% 0.70 / 0.72 / -2.6%
tpch_q17/duckdb:vortex-file-compressed 11402496 / 12798199 / -10.9% 🟢 26892459 / 27476138 / -2.1% 0.42 / 0.47 / -9.0%
tpch_q18/duckdb:vortex-file-compressed 23761495 / 24444056 / -2.8% 35506042 / 34605001 / +2.6% 0.67 / 0.71 / -5.3%
tpch_q19/duckdb:vortex-file-compressed 12777090 / 12242387 / +4.4% 28518150 / 27321096 / +4.4% 0.45 / 0.45 / -0.0%
tpch_q20/duckdb:vortex-file-compressed 13565838 / 14198111 / -4.5% 29934097 / 30613203 / -2.2% 0.45 / 0.46 / -2.3%
tpch_q21/duckdb:vortex-file-compressed 34779853 / 37513583 / -7.3% 56747426 / 57434365 / -1.2% 0.61 / 0.65 / -6.2%
tpch_q22/duckdb:vortex-file-compressed 17964699 / 16794767 / +7.0% 27603526 / 26714487 / +3.3% 0.65 / 0.63 / +3.5%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47523744 / 47713751 / -0.4% 54242955 / 54084103 / +0.3% 0.88 / 0.88 / -0.7%
tpch_q02/duckdb:parquet 48161035 / 48224444 / -0.1% 55565437 / 55714996 / -0.3% 0.87 / 0.87 / +0.1%
tpch_q03/duckdb:parquet 60394662 / 60411322 / -0.0% 68737846 / 68499474 / +0.3% 0.88 / 0.88 / -0.4%
tpch_q04/duckdb:parquet 34731012 / 34751229 / -0.1% 42710199 / 42839095 / -0.3% 0.81 / 0.81 / +0.2%
tpch_q05/duckdb:parquet 67039831 / 67216064 / -0.3% 77110448 / 78023594 / -1.2% 0.87 / 0.86 / +0.9%
tpch_q06/duckdb:parquet 21809389 / 21600736 / +1.0% 27460946 / 27532060 / -0.3% 0.79 / 0.78 / +1.2%
tpch_q07/duckdb:parquet 63844503 / 64009753 / -0.3% 73651071 / 72612659 / +1.4% 0.87 / 0.88 / -1.7%
tpch_q08/duckdb:parquet 75679333 / 75729672 / -0.1% 86566653 / 86627797 / -0.1% 0.87 / 0.87 / +0.0%
tpch_q09/duckdb:parquet 107649519 / 108082547 / -0.4% 119154940 / 119726697 / -0.5% 0.90 / 0.90 / +0.1%
tpch_q10/duckdb:parquet 105800203 / 105422661 / +0.4% 118494375 / 118223333 / +0.2% 0.89 / 0.89 / +0.1%
tpch_q11/duckdb:parquet 29375203 / 29487429 / -0.4% 34621811 / 35046831 / -1.2% 0.85 / 0.84 / +0.8%
tpch_q12/duckdb:parquet 37249815 / 37036591 / +0.6% 43935140 / 44088601 / -0.3% 0.85 / 0.84 / +0.9%
tpch_q13/duckdb:parquet 174611654 / 174749048 / -0.1% 181511774 / 181614974 / -0.1% 0.96 / 0.96 / -0.0%
tpch_q14/duckdb:parquet 42413938 / 42338974 / +0.2% 51656647 / 51391948 / +0.5% 0.82 / 0.82 / -0.3%
tpch_q15/duckdb:parquet 32667279 / 32573623 / +0.3% 40972682 / 40853174 / +0.3% 0.80 / 0.80 / -0.0%
tpch_q16/duckdb:parquet 47428219 / 47004841 / +0.9% 52790257 / 52463150 / +0.6% 0.90 / 0.90 / +0.3%
tpch_q17/duckdb:parquet 47945483 / 47912588 / +0.1% 57562615 / 57157007 / +0.7% 0.83 / 0.84 / -0.6%
tpch_q18/duckdb:parquet 74188425 / 73826186 / +0.5% 81430224 / 80298399 / +1.4% 0.91 / 0.92 / -0.9%
tpch_q19/duckdb:parquet 48082365 / 49004788 / -1.9% 58469748 / 54829747 / +6.6% 0.82 / 0.89 / -8.0%
tpch_q20/duckdb:parquet 63306961 / 63388451 / -0.1% 74011726 / 74118595 / -0.1% 0.86 / 0.86 / +0.0%
tpch_q21/duckdb:parquet 106580752 / 106358138 / +0.2% 115901217 / 115179019 / +0.6% 0.92 / 0.92 / -0.4%
tpch_q22/duckdb:parquet 50467897 / 50199071 / +0.5% 58844032 / 58494416 / +0.6% 0.86 / 0.86 / -0.1%

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 18748c51 vs base 7d003295
Vortex (geomean): hot 0.995x ➖ · cold 1.048x ➖


datafusion / vortex-file-compressed / ns (0.995x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44110976 / 44204513 / -0.2% 86684249 / 84609357 / +2.5% 0.51 / 0.52 / -2.6%
polarsignals_q01/datafusion:vortex-file-compressed 53294345 / 55315833 / -3.7% 108718706 / 137774969 / -21.1% 🟢 0.49 / 0.40 / +22.1%
polarsignals_q02/datafusion:vortex-file-compressed 12228973 / 11703954 / +4.5% 47843305 / 39043849 / +22.5% 🔴 0.26 / 0.30 / -14.7%
polarsignals_q03/datafusion:vortex-file-compressed 54865774 / 54205547 / +1.2% 112711961 / 108991592 / +3.4% 0.49 / 0.50 / -2.1%
polarsignals_q04/datafusion:vortex-file-compressed 9223284 / 9043823 / +2.0% 38822410 / 36583135 / +6.1% 0.24 / 0.25 / -3.9%
polarsignals_q05/datafusion:vortex-file-compressed 11395552 / 11225243 / +1.5% 42868991 / 39068477 / +9.7% 0.27 / 0.29 / -7.5%
polarsignals_q06/datafusion:vortex-file-compressed 23060982 / 22862067 / +0.9% 53439523 / 50499459 / +5.8% 0.43 / 0.45 / -4.7%
polarsignals_q07/datafusion:vortex-file-compressed 10565517 / 10652726 / -0.8% 39728195 / 37025691 / +7.3% 0.27 / 0.29 / -7.6%
polarsignals_q08/datafusion:vortex-file-compressed 98489392 / 110351782 / -10.7% 🟢 163561958 / 151651403 / +7.9% 0.60 / 0.73 / -17.2%
polarsignals_q09/datafusion:vortex-file-compressed 10074292 / 9954551 / +1.2% 37971788 / 34715411 / +9.4% 0.27 / 0.29 / -7.5%

@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 29, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 29, 2026
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>
Benchmark commit_id records the runtime checkout. Verify the source revision and executable SHA-256 from each build artifact independently, and preserve the runtime checkout in the comparison manifest.

Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>
Give each admitted planning root its own IO session so retiring one root preserves pending reads of other roots. Bound default per-partition chunk streams by the workers left per engine partition, while retaining explicit per-thread overrides. Exercise delayed payload reads, startup ranges and sparse selections with inline execution.

Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>
Retain failures and incomplete coverage explicitly while comparing the remaining complete query pairs. Bound individual query processes, skip failed queries on later rounds, and use dedicated NVMe paths for input and spill files. Exercise process failures and timeouts through real subprocesses.

Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>
Drive the partition through one owned task when engine partitions already fill the workers. Defer that task until startup work has drained, and retain independent IO sessions for admitted roots. Avoid the repeated CPU-task handoffs of the previous inline path.

Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>
Redirect the normal data and target directories to local NVMe instead of changing the workspace root and supplying a local URL override. ClickBench generation uses its default cache path; both generators and benchmark binaries now share that path while downloads and spill files remain on NVMe.

Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>
Keep filter and IO work in large chunks while returning stored scan pieces directly for conversion. Avoid gathering filtered scan results into a chunked array and copying across stored boundaries. Keep bounded gathering for filtered random-access work. Verify filtered and unfiltered stored boundaries and array equality across three layout strategies.

Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>
Retain the previous per-worker chunk overlap after measurements showed that limiting each partition to one stream regressed Q6, Q15 and ClickBench. Keep independent IO sessions and the single-task path for explicit inline execution.

Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>
Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>
Avoid constructing a hash map of every file segment before a narrow scan can read. Ordered locations share their existing storage and use binary search; unordered tables retain indexed lookup and duplicate ranges keep their last segment ID.

Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>
Slice oversized encoded output pieces before Arrow conversion, retaining the scan work and read window while bounding decoded values and downstream casts. Cover filtered and unfiltered inline and overlapping scans with exact output verification.

Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>
Allow 900 seconds for a seven-iteration SF50 process, retaining the 300-second limit for other cases and the 180-minute job budget. Continue to report failed or timed-out queries as incomplete.

Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>
Reuse source-verified native artifacts on Graviton4 for serial V1/V2 TPC-H Q13 and ClickBench Q19 metrics and Samply profiles. Resolve names on the runner after checking GNU build IDs, retaining every sample and stack table.

Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>
Retain stored boundaries for wide and variable-width conversions while bounding projected rows up to 16 bytes to 65536 rows. This keeps the narrow aggregate working-set benefit without the measured wide TPC-H Q1 regression.

Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>
For dense scans with one static predicate, project each completed piece within the existing I/O session instead of waiting for the full filter window. Keep the combined-mask path for multiple predicates, dynamic bounds and sparse demand. A gated-read regression fails before the change and verifies early output plus the complete result after it.

Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>
The guarded seven-query comparison was inconclusive overall and Q13 was 1.7% slower than the preserved V2 baseline. Keep the existing combined-mask handoff; early-output correctness alone does not justify this performance experiment. The ClickBench attempt never started because the shared host remained busy.

Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>
Align narrow unfiltered byte partitions to 65536-row boundaries before preparing scan plans. This reduces repeated setup on small dimensions while preserving exact row coverage. Keep filtered and wide partitions on the existing 8192-row grid. Extend cold/warm repartition coverage to 30000 and 150000 rows.

Use four reversed rounds and eleven iterations outside SF50 to resolve the sub-percent differences seen in the previous Actions comparison. SF50 retains two rounds of seven iterations and its 900-second process limit.

Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs mentioned this pull request Nov 9, 2026
16 of 25 tasks

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant