feat(chat-completions): server-side fan-out for n>1 choices - #4841

Merged

lvhan028 merged 9 commits into

InternLM:mainfrom

lvhan028:feat/chat-n-completions

Aug 21, 2026

Commits on Aug 14, 2026

feat(chat): support n>1 via server-side fan-out

lvhan028
and
claude
committed
9bdc2c1
fix(chat): fan-out session leak, explicit session_id crash, sibling cancellation

lvhan028
and
claude
committed
ffcadc4
refactor(chat): isolate multi-choice fan-out lifecycle
lvhan028
committed
4db830d
perf(chat): batch ready fan-out stream chunks
lvhan028
committed
07c3b0c
docs(chat): document fan-out helpers
lvhan028
committed
8110e02
fix ut
lvhan028
committed
e5ade8b
fix(chat): aggregate reasoning tokens for n choices
lvhan028
committed
f525848

Commits on Aug 20, 2026

fix according to reviewer comments
lvhan028
committed
55ce69e

Commits on Aug 21, 2026

fix(test): align streaming failure with async generation
lvhan028
committed
02dde79