Skip to content

Add server performance benchmarks and CI regression checks - #82

Open
ViTeXFTW wants to merge 1 commit into
devfrom
t3code/add-server-performance-benchmarks
Open

Add server performance benchmarks and CI regression checks#82
ViTeXFTW wants to merge 1 commit into
devfrom
t3code/add-server-performance-benchmarks

Conversation

@ViTeXFTW

Copy link
Copy Markdown
Owner

Summary

  • Add synthetic and real-corpus server latency benchmarks covering startup, diagnostics, completion, semantic tokens, and edit bursts.
  • Add Criterion analysis benchmarks for workspace indexing, reference completion, and ranged semantic tokens.
  • Add CI workflows and threshold-based performance reporting for pull requests and corpus runs.
  • Remove the obsolete VS Code preview enable setting.

Tests

  • Added automated benchmark execution in CI.
  • Added scripts/check-performance.py for regression thresholds and absolute latency ceilings.
  • Relevant local test commands were documented in CONTRIBUTING.md.

Checklist

  • I kept the change focused.
  • I ran the relevant checks or explained why they were skipped.
  • I did not commit generated artifacts, game source, corpus data, or secrets.

- Add Criterion and real-server latency benchmarks
- Compare base/head performance in CI with warning and failure thresholds
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant