Repository navigation
fix(codex): repair cache identity, quota handling, and usage accounting - #27
Merged
Merged
Conversation
dannote
added a commit
to mikehostetler/llm_proxy
that referenced
this pull request
Sep 29, 2026
0.2.1 already used ReqLLM from Hex, so the temporary Git pin from elixir-vibe#27 and its removal are not release-visible. Record the Codex fixes from elixir-vibe#27 that landed after 0.2.1, and fold stream error projection into the streaming entry since ReqLLM streaming did not exist before.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Repair the Codex path and usage accounting without changing storage, deployment architecture, or historical counters:
prompt_cache_keyand metadata session/thread identities, scoped to the authenticated API key.dannote/req_llm@69f488da53fdd81452092cbaa5c05cdd4799f24bfor the upstream Codex wire compatibility fixes: fix(codex): preserve session and prompt cache identity across transports agentjido/req_llm#996.resets_atvalues for model-token cooldown/retry delay.:finchand:connect_options, which raised before network dispatch.The required Igniter 0.8.4 security update follows the fresh upstream ReqLLM dependency constraint. No historical rows or lifetime counters are rewritten.
Verification
MIX_ENV=test mix ci: passed, including 504 tests (9 excluded), compile, formatting, strict Credo, Dialyzer, duplication budget, and architecture checks.Follow-up
Replace the temporary Git dependency once the upstream compatibility fix is released and validated. Session-aware connection reuse and turn-state propagation are separate work; this change does not introduce cross-request WebSocket sharing. Improved proxy accounting does not establish that private provider quota consumption has improved.