Skip to content

feat(trace): audit model calls across routes - #973

Merged
KB (KB-syntheticsciences) merged 3 commits into
mainfrom
feat/call-audit-phase-2
Oct 10, 2026
Merged

KB (KB-syntheticsciences) merged 3 commits into
mainfrom
feat/call-audit-phase-2

Conversation

@KB-syntheticsciences

Copy link
Copy Markdown
Collaborator

Summary

  • capture bounded provider response IDs for managed, BYOK, and ChatGPT/Codex subscription calls
  • retain each provider request ID on its exact step and consented model.response trace
  • add openscience debug audit for content-free local call identities across a session and its workers
  • regenerate the public SDK and document the command and privacy behavior

Verification

  • bun run check:fast
  • 44 focused provider, step-link, audit, and usage-logging tests
  • bun run test:sdk (31 passed)
  • docs validation and tests (7 passed)

Companion server audit: https://github.com/synthetic-sciences/atlas/pull/383

@vercel

vercel Bot commented Oct 10, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
openscience Ready Ready Preview Oct 10, 2026 10:27am UTC

Request Review

@KB-syntheticsciences

Copy link
Copy Markdown
Collaborator Author

Local live Codex validation completed with the existing ChatGPT OAuth login and openai-codex/gpt-6.1-sol. The test exposed and fixed two gaps: OpenAI error responses use x-oai-request-id, and internal message-summary calls were present in telemetry but absent from the local audit. The local content-free call ledger now retains internal/background calls and de-duplicates visible step records. A final live session produced two local audit calls whose HTTP call IDs and provider resp IDs exactly matched the two model.response telemetry records.

@KB-syntheticsciences
KB (KB-syntheticsciences) merged commit a7b9fa3 into main Oct 10, 2026
10 checks passed

This branch was successfully deployed

1 active deployment
Preview — 5461ed7e Deployed Oct 10, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant