Skip to content

Conversation

@GuillaumeLagrange
Copy link
Contributor

  1. Add an stdin mode for the exec-harness, which allows running multiple commands. Commands are passed as JSON through stdin when invoking exec harness with exec-harness -
  2. Fix behavior of exec harness in walltime when executing different benchmarks
  3. Parse targets from codspeed.yaml when running codspeed run without arguments, and pass them to the exec-harness

There was some imprecision with the different markers that were not
visible before, but now we have support to run multiple markers, we
handle warmup runs better.

Now, for each benchmark that is ran
1. We start perf monitorning and send SampleStart marker
2. We perform warmup rounds without sending BenchmarkStart and
   BenchmarkEnd markers
3. If we're in the "long warmup single run" edge case, we retroactively
   send the BenchmarkStart and BenchmarkStop markers
4. Else, we perform the measured rounds while sending the markers

This fixes flamegraph generation.
@codspeed-hq
Copy link

codspeed-hq bot commented Jan 18, 2026

Merging this PR will not alter performance

✅ 4 untouched benchmarks


Comparing cod-1906-define-exec-targets-in-codspeedyaml (08878c1) with main (8a39cf5)

Open in CodSpeed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants