Repository navigation
[ambient-context] Daily Ambient Context Optimizer - 2026-10-18 #69991
Copy link
Copy link
Closed as not planned
Description
Executive Summary
- Runs sampled: 4 (reduced data: downloaded logs contain no
api-proxy-logs/event*.jsonlorcopilot-session-stateevents, so first-request text could not be extracted; first-callinput_tokensfromtoken_usage.jsonlis used as a proxy; no Python text analysis was possible). - Workflows: 3 (Daily Cache Strategy Analyzer, Daily Go Test Parallelizer, Smoke Copilot Routed Steering x2).
- First-call input tokens: 18125 / 13175 / 3 (routing classifier). Median ≈ 13.2k, p95 ≈ 18.1k.
- Conclusion: dominant cost is working-set rebuild across turns (WSRF 22-84), not first-request size. Cache Strategy Analyzer re-sends a 16 KB prompt plus growing context over 53 calls (5.67M cumulative input tokens, peak 188k).
Highest-Leverage Changes
- daily-cache-strategy-analyzer.md (16 KB): move Phase 2/3 detection and data gathering into deterministic
steps:so the agent gets compact JSON findings; inline templates (~lines 320-450) are already on-demand skills. Impact: high. Manual review. Keep >=60% of current size. - Smoke Copilot Routed Steering: WSRF 80-84 over 92-96 invocations with peak only ~28k. Bound turns / scenario to stop resending context (~2.3M tokens/run). Impact: high. Manual review.
- daily-go-test-parallelizer.md (4.3 KB): move file selection and safety grep into
steps:so the main agent starts with one file (WSRF 22.8, 35 calls, peak 63k). Impact: medium. Safe to try. - Summarise large
logs/audittool outputs via file paths rather than inline results; caching works (cache_read equals prior input), so waste is tool-output accumulation. Impact: medium.
CI-Validation Checklist for Implementing Agents
- Run
make recompilefor every modified.github/workflows/*.mdfile — zero compilation errors required - Confirm no target workflow file is reduced by more than 40% of its current character count
- Run
make agent-report-progressbefore the final commit and confirm it passes - Check the
blocked_fileslist in/tmp/gh-aw/ambient-context/closed-pr-targets.json— do not re-attempt changes to any file in a closed ambient-context optimization PR from the last 14 days - Include a smoke-test result or dry-run output in the PR description for every changed workflow spec
- Document all generated
.lock.ymlchanges in the PR body - Do not submit as a draft PR
Key Metrics
| Metric | Value |
|---|---|
| Sampled runs | 4 |
| Distinct workflows | 3 |
| Median first-call input tokens | ~13.2k |
| P95 first-call input tokens | ~18.1k |
| Largest sampled request | 18125 tokens (Daily Cache Strategy Analyzer) |
| Merged optimizer PRs (7d) | 0 |
| Closed optimizer PRs (7d) | 1 |
| Optimizer PR close-rate (7d) | n/a (1 settled PR < 3; auto-pause false) |
| WSRF (audited runs) | 30.2 cache analyzer; 83.7 / 80.4 smoke steering; 22.8 go-test-parallelizer (from run_summary; audit tool not run) |
<b>Per-Run First-Request Metrics</b>
| Run | Workflow | Conclusion | First input tokens | Calls | Peak input | Cumulative input | WSRF |
|---|---|---|---|---|---|---|---|
| 39154568172 | Daily Cache Strategy Analyzer | success | 18125 | 53 | 187718 | 5.67M | 30.2 |
| 39148388768 | Smoke Copilot Routed Steering | failure | 3 (routing) | 96 | 28285 | 2.37M | 83.7 |
| 39152981591 | Smoke Copilot Routed Steering | success | 3 (routing) | 92 | 28768 | 2.31M | 80.4 |
| 39154765378 | Daily Go Test Parallelizer | success | 13175 | 35 | 63579 | 1.45M | 22.8 |
<b>Repeated Ambient Context Signals</b>
- Not measurable from text; artifacts lacked first-request payloads. Ensure api-proxy event logs are uploaded for sampling.
- daily-cache-strategy-analyzer.md has 2 inline skill blocks (~130 lines) and imports
shared/aw-logs-24h-fetch-setup.mdandshared/meta-analysis-base.md. - Both reviewed non-smoke workflows already set
cli-proxy: true.
<b>Deterministic Analysis Output</b>
No Python text analysis could be run (no request text). Metrics come from run_summary.json working_set and usage/agent/token_usage.jsonl.
Recommendations by Category
Workflow Markdown
- Items 1 and 3: move data gathering/detection to
steps:; useagentic-workflowsMCP tools rather than rawgh awprose.
Skills
- Item 1: keep templates as on-demand skills; avoid duplicating them in Important Guidelines.
Agents
- Items 2 and 4: bound turns for smoke steering; keep sub-agent batches small as in go-test-parallelizer.
References
Generated by 🌫️ Daily Ambient Context Optimizer · copilot · auto · 25.5 AIC · ⌖ 0.764 AIC · ⊞ 12.6K · ◷
- expires on Oct 25, 2026, 11:50 AM UTC-08:00
Reactions are currently unavailable
Activity
github-actions commentedon Oct 19, 2026
This issue is being closed as outdated. A newer issue has been created: #70357
View newer issue
This action was performed automatically by the
Daily Ambient Context Optimizerworkflow.