Skip to content

docs(ai-llm-proxy): add sidecar README - #557

Open
LukasHirt wants to merge 1 commit into
mainfrom
docs/ai-llm-proxy-readme
Open

docs(ai-llm-proxy): add sidecar README#557
LukasHirt wants to merge 1 commit into
mainfrom
docs/ai-llm-proxy-readme

Conversation

@LukasHirt

Copy link
Copy Markdown
Collaborator

Summary

  • Adds packages/ai-llm-proxy/README.md, the sidecar's first README, documenting its request flow, the single supported route (POST /v1/chat/completions), the same-origin requirement (with a Traefik and a generic nginx example), the full env var table, and a troubleshooting table mapping each error response to its cause.
  • Links it from the root README's Documentation section.

Why

Fixes #556. ai-llm-proxy had no README of its own. Its same-origin enforcement (Origin must match OCIS_URL) and its single-route scope (no models-list endpoint) were undocumented, so pointing an extension's llm.endpoint straight at the proxy's own host:port produced confusing 404/403 responses that looked like a broken extension rather than a config issue.

Test plan

  • Docs-only change; no code paths touched.
  • Reviewed rendered Markdown locally for correctness against packages/ai-llm-proxy/src/index.ts (route matching, origin check, env var defaults).

… requirement

Fixes #556. The ai-llm-proxy sidecar had no README of its own; its
same-origin requirement, single supported route, and error meanings
were undocumented, which led to confusing 404/403 responses when
users pointed extensions at the proxy directly instead of through a
same-origin reverse proxy.

Signed-off-by: Lukas Hirt <info@hirt.cz>
@LukasHirt
LukasHirt requested a review from a team as a code owner August 20, 2026 13:29
@kw-security

kw-security commented Aug 20, 2026

Copy link
Copy Markdown

Snyk checks have passed. No issues have been found so far.

Status Scan Engine Critical High Medium Low Total (0)
Open Source Security 0 0 0 0 0 issues
Licenses 0 0 0 0 0 issues
Code Security 0 0 0 0 0 issues

💻 Catch issues earlier using the plugins for VS Code, JetBrains IDEs, Visual Studio, and Eclipse.

@LukasHirt LukasHirt self-assigned this Aug 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

AI proxy may be buggy

2 participants