Skip to content

Calibrate performance benchmarks - #369

Merged
satyakigh merged 1 commit into
mainfrom
perf
Sep 4, 2026
Merged

Calibrate performance benchmarks#369
satyakigh merged 1 commit into
mainfrom
perf

Conversation

@satyakigh

@satyakigh satyakigh commented Sep 4, 2026

Copy link
Copy Markdown
Collaborator

Description

The required performance check failed before measurement when GitHub scheduled ubuntu-latest on an unrecognized CPU. The latest failure used INTEL(R) XEON(R) PLATINUM 8573C; other recent runs encountered Intel 8370C and AMD EPYC 9V45.

Previously, an unknown CPU caused exit code 2 before any performance results or candidate baseline were written.

This change preserves the hard, two-sided absolute-baseline model:

  • Derives deterministic CPU-specific profile names from the detected CPU model.
  • Adds an Intel Xeon Platinum 8573C hard baseline using GitHub-hosted runner measurements.
  • For an unknown CPU, collects nine independent samples for all 38 cases and uploads:
  • performance-results.json
  • performance-results.md
  • A CPU-enforced performance-candidate-baseline.json
  • Keeps the unknown-CPU check failed until its candidate is reviewed and checked in.
  • Removes the generic variable-hardware GitHub profile, preventing accidental comparisons between unlike machines.
  • Validates every checked-in GitHub profile has the same cases, gates, and thresholds.

@satyakigh
satyakigh merged commit aaad961 into main Sep 4, 2026
3 checks passed
@satyakigh
satyakigh deleted the perf branch September 4, 2026 01:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant