Skip to content

COMP: Fix release-5.4 Azure CI disk, Windows Python, and Python version - #7172

Open
hjmjohnson wants to merge 4 commits into
InsightSoftwareConsortium:release-5.4from
hjmjohnson:comp-rel54-azure-free-disk
Open

hjmjohnson wants to merge 4 commits into
InsightSoftwareConsortium:release-5.4from
hjmjohnson:comp-rel54-azure-free-disk

Conversation

@hjmjohnson

@hjmjohnson hjmjohnson commented Nov 14, 2026 •

Copy link
Copy Markdown
Member

Fix the release-5.4 Azure CI failures that are unrelated to #7170: ITK.Linux.Python runs out of disk while saving its ccache after all tests pass, and ITK.Windows.Python fails before configuring because it calls Visual Studio 2019's vcvars64.bat on a windows-2022 image. Each commit backports an existing fix from main; no new jobs or features.

Commits and evidence
Commit main source Evidence on release-5.4
Free disk space in the Linux Python job 0f19708, c7a707d All 173 tests pass, then "Post-job: ccache" fails with tar: ... No space left on device at 95% disk use, on PRs and on release-5.4 pushes.
(same commit) rename the ccache key none, 5.4 only main's Linux Python pipeline also saves under ccache | rel54, so release-5.4 restored a 3.6 GB cache built on main.
Fail Linux dependency installs on first error 2c99f46 Without set -e, an apt failure surfaces later as ccache: command not found.
Use the VS 2022 environment in Windows Python b4ca025 (vcvars hunk) "The system cannot find the path specified." then CMAKE_CXX_COMPILER not set.
Use Python 3.11 in the Azure jobs 74e226c, c02c450 3.8 and 3.9 are no longer cached on ubuntu-22.04, macos-15, or windows-2022; every run downloads 3.9 anonymously with a GitHub rate-limit warning.
Considered and left out
  • macos-15 runners and Node.js 24 action versions: in COMP: Fix release-5.4 CI for the retired macos-14 runner and Node.js 20 actions #7170.
  • Lane restructuring, Debug and C++20 lanes, ExternalData cache redesign, doxygen, perf benchmark, scorecard, labeler v1, pre-commit workflow: features or restructuring.
  • ccache caps on macOS, Windows, and Batch, and -j 2 memory limits: no disk or memory failures seen on release-5.4 yet.
  • AzurePipelinesLinux.yml reports no ITK.Linux status on release-5.4; it gets only the set -e and Python changes, for consistency.
  • main's duplicate ccache | rel54 steps, which also let release-5.4 restore main's caches in the other pipelines, are removed on main by COMP: Remove release-5.4 ccache steps merged into main CI #7174.
Testing

CI configuration only; this PR's own Azure runs are the test. pre-commit run --all-files passes.

AI assistance
  • Tool: Claude Code (claude-opus-5-5)
  • Contribution: read the failing Azure logs, compared the release-5.4 and main CI files, and made the edits

@github-actions github-actions Bot added type:Compiler Compiler support or related warnings type:Infrastructure Infrastructure/ecosystem related changes, such as CMake or buildbots type:Testing Ensure that the purpose of a class is met/the results on a wide set of test cases are correct labels Nov 14, 2026
@hjmjohnson
hjmjohnson force-pushed the comp-rel54-azure-free-disk branch from ebdcf95 to 55d71b7 Compare November 14, 2026 13:55
@hjmjohnson

Copy link
Copy Markdown
Member Author

Force-push = plain rebase onto release-5.4 to pick up #7170 (macos-15 runners), which fixes the macOS, macOS-Python, and Pixi-Cxx (macos-14) failures; no content changes (range-diff all =).

@greptile-apps

greptile-apps Bot commented Nov 14, 2026 •

Copy link
Copy Markdown
Contributor

RetriggerView in GreptileConfidence Score: 5/5

[Medium impact] The PR appears safe to merge.

Summary

This PR updates the release-5.4 Azure jobs to address disk space, Windows compiler setup, and Python availability.

  • Azure CI jobs request Python 3.11 across runner platforms.
  • The Linux Python job clears disk space before Azure saves its cache.
  • Linux dependency installs stop at the first failed command.
  • The Windows Python job loads Visual Studio 2022 tools before its tests.

No actionable issues found. Azure jobs were not run locally.

Reviews (2) · Last reviewed commit: "COMP: Use Python 3.11 in the release-5.4..." · Reviewed by Greptile

@hjmjohnson

Copy link
Copy Markdown
Member Author

Force-push 55d71b78bb→dbe2f1dab9 is a rebase only, onto release-5.4 after #7165 merged; all four commits are unchanged (range-diff =).

@hjmjohnson
hjmjohnson force-pushed the comp-rel54-azure-free-disk branch from 55d71b7 to dbe2f1d Compare November 14, 2026 23:44
The post-job ccache save fails with "No space left on device" at 95%
disk use, after the build and all tests pass. Remove unused
preinstalled software first, cap ccache at 8G with age-based eviction,
and delete the build tree before the cache is saved.

Backport of 0f19708 and c7a707d from main.

Also rename the cache key, which has no main counterpart: main's Linux
Python pipeline also saves under "ccache | rel54", so release-5.4
restored a 3.6 GB cache built from main on every run.
Without set -e, an apt-get failure is masked by a later successful pip
install, and the job fails much later with "ccache: command not found".

Backport of 2c99f46 from main.
The job runs on windows-2022, which has no Visual Studio 2019, so the
vcvars64.bat call fails with "The system cannot find the path
specified" and CMake stops with "CMAKE_CXX_COMPILER not set".
ITK.Windows.Python has failed this way on every recent release-5.4
commit. Use the path AzurePipelinesWindows.yml already uses.

Backport of the vcvars change in b4ca025 from main.
The hosted ubuntu-22.04, macos-15, and windows-2022 images no longer
cache Python 3.8 or 3.9, so every run downloads 3.9 from
actions/python-versions anonymously ("You should provide GitHub token
... anonymous download limit"). Python 3.11 is cached on all three
images.

Backport of 74e226c and c02c450 from main.
@hjmjohnson
hjmjohnson force-pushed the comp-rel54-azure-free-disk branch from dbe2f1d to e8b132d Compare November 14, 2026 23:48
@hjmjohnson hjmjohnson changed the title COMP: Fix release-5.4 Azure CI disk space and Windows Python environment COMP: Fix release-5.4 Azure CI disk, Windows Python, and Python version Nov 14, 2026
@hjmjohnson

Copy link
Copy Markdown
Member Author

Force-push dbe2f1dab9→e8b132d11f changes only two commit messages (same tree, same base): the disk-space commit now says the cache-key rename has no main counterpart, and the Python 3.11 commit drops an irrelevant note about wheels.

@hjmjohnson

Copy link
Copy Markdown
Member Author

@greptileai review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

type:Compiler Compiler support or related warnings type:Infrastructure Infrastructure/ecosystem related changes, such as CMake or buildbots type:Testing Ensure that the purpose of a class is met/the results on a wide set of test cases are correct

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant