v4.12.1

Compare Source

Release Notes

In this release, we've focused on improving the local user experience.
We've revamped the output of the cli to provide tailed logs while the benchmarks are being executed, and polished a bit the display of results after your run.

We also added support to run multiple modes in a single command invocation, both for local and CI runs!
For instance, that means you can now do
codspeed run --mode simulation --mode memory --mode walltime -- cargo codspeed run

Last but not least, you can now define entrypoints in your project config

# codspeed.yml
# List of commands that are run when running `codspeed run` without further arguments
benchmarks:
  - name: My ls command
    # Mutually exclusive with entrypoint
    # Expects a command that will run a benchmark for an arbitrary command
    exec: ls -al /usr/bin
   
  - name: My pytest-codspeed benchmark
    # Mutually exclusive with exec
    # Expects a command that will run a benchmark program that is using a codspeed integration
    entrypoint: pytest --codspeed src

Fix a bug where memory profiling with codspeed exec for binaries that use statically-linked allocators (e.g. jemalloc in Rust). Previously, we reported incorrect memory usage because it didn't attach to the statically linked allocators.

Details

🚀 Features

• Set NODE_OPTIONS to get perf map from node by @​GuillaumeLagrange in #​267
• Disable node instrospection for exec-harness by @​GuillaumeLagrange
• Support CODSPEED_MEMTRACK_BINARIES for static allocator discovery by @​not-matthias
• Gracefully handle logs from the runner while rolling buffer is active by @​GuillaumeLagrange
• Add --show-full-output to bypass the new rolling buffer by @​GuillaumeLagrange
• Add a spinner while waiting for results by @​GuillaumeLagrange
• Clean up group headers and emoji usage, make the executor title not dim after run by @​GuillaumeLagrange
• Add rolling buffer to display logs from executors by @​GuillaumeLagrange
• Polish impact reporting and upload feedback by @​art049
• Add color-coded metrics to benchmark result tables by @​art049
• Enhance local logger with richer visual hierarchy by @​art049
• Style the ASCII banner with CodSpeed orange by @​GuillaumeLagrange
• Enforce CodSpeed CLI as single source of truth for all measurements by @​art049
• Add optimize and setup-harness skills by @​art049
• Add the cursor plugin by @​art049
• Check if user is logged in before doing a local run by @​GuillaumeLagrange in #​263
• Skip respository resolve with --skip-upload by @​GuillaumeLagrange
• Use an enum and fix schema for entry/entrypoint by @​GuillaumeLagrange in #​260
• Accept a mix of entrypoint and exec targets in project config by @​GuillaumeLagrange
• Introduce OrchestratorConfig and ExecutorConfig by @​GuillaumeLagrange
• Unify run_part_id suffix computation between ci providers and local by @​GuillaumeLagrange
• Add the claude plugin by @​art049
• Add local_data to upload metadata by @​GuillaumeLagrange
• Use repositoryOverview resolver rather than repository by @​GuillaumeLagrange

🐛 Bug Fixes

• Use fp unwinding mode when running go test by @​GuillaumeLagrange in #​269
• Improve error message when no benchmarks are found by @​GuillaumeLagrange in #​264

🏗️ Refactor

• Extract shared test helpers for compile and track by @​not-matthias
• Pass extra env via config instead of unsafe set_var by @​not-matthias
• Remove the closure argument to poll in favor of polling options by @​GuillaumeLagrange
• Move EXEC_HARNESS_VERSION and EXEC_HARNESS_COMMAND to orchestrator mod by @​GuillaumeLagrange
• Flatten orchestrator execution loop over (command, mode) pairs by @​GuillaumeLagrange
• Introduce Orchestrator to support multi-mode execution by @​GuillaumeLagrange in #​259
• Consolidate poll_results into upload module by @​GuillaumeLagrange

📚 Documentation

• docs: add documentation about multiple modes in a single run by @​GuillaumeLagrange in #​195

🧪 Testing

• Add spawn wrapper integration test for static allocator discovery by @​not-matthias in #​266

⚙️ Internals

• Bump linux-perf-data to use upstream version by @​GuillaumeLagrange in #​271
• Remove lazy_static in favor of LazyLock by @​GuillaumeLagrange in #​265
• Rename skill directories with codspeed prefix by @​art049
• Move architecture docs out of this repo by @​GuillaumeLagrange in #​262
• Typo in plugin description by @​art049
• Bump memtrack version
• chore: bump runner version to 4.12.0 by @​github-actions[bot] in #​194
• chore: bump runner version to 4.12.1 by @​github-actions[bot] in #​196

Install codspeed-runner 4.12.1

Install prebuilt binaries via shell script

curl --proto '=https' --tlsv1.2 -LsSf https://github.com/CodSpeedHQ/codspeed/releases/download/v4.12.1/codspeed-runner-installer.sh | sh

Download codspeed-runner 4.12.1

Full Runner Changelog: https://github.com/CodSpeedHQ/codspeed/blob/main/CHANGELOG.md

Full Changelog: CodSpeedHQ/action@v4.11.1...v4.12.1

v5.0.4

Compare Source

v4.34.1

Compare Source

• Downgrade default CodeQL bundle version to 2.24.3 due to issues with a small percentage of Actions and JavaScript analyses. #​3762

v4.34.0

Compare Source

• Added an experimental change which disables TRAP caching when improved incremental analysis is enabled, since improved incremental analysis supersedes TRAP caching. This will improve performance and reduce Actions cache usage. We expect to roll this change out to everyone in March. #​3569
• We are rolling out improved incremental analysis to C/C++ analyses that use build mode none. We expect this rollout to be complete by the end of April 2026. #​3584
• Update default CodeQL bundle version to 2.25.0. #​3585

v4.33.0

Compare Source

• Upcoming change: Starting April 2026, the CodeQL Action will skip collecting file coverage information on pull requests to improve analysis performance. File coverage information will still be computed on non-PR analyses. Pull request analyses will log a warning about this upcoming change. #​3562

  To opt out of this change:

  • Repositories owned by an organization: Create a custom repository property with the name github-codeql-file-coverage-on-prs and the type "True/false", then set this property to true in the repository's settings. For more information, see Managing custom properties for repositories in your organization. Alternatively, if you are using an advanced setup workflow, you can set the CODEQL_ACTION_FILE_COVERAGE_ON_PRS environment variable to true in your workflow.
  • User-owned repositories using default setup: Switch to an advanced setup workflow and set the CODEQL_ACTION_FILE_COVERAGE_ON_PRS environment variable to true in your workflow.
  • User-owned repositories using advanced setup: Set the CODEQL_ACTION_FILE_COVERAGE_ON_PRS environment variable to true in your workflow.

• Fixed a bug which caused the CodeQL Action to fail loading repository properties if a "Multi select" repository property was configured for the repository. #​3557

• The CodeQL Action now loads custom repository properties on GitHub Enterprise Server, enabling the customization of features such as github-codeql-disable-overlay that was previously only available on GitHub.com. #​3559

• Once private package registries can be configured with OIDC-based authentication for organizations, the CodeQL Action will now be able to accept such configurations. #​3563

• Fixed the retry mechanism for database uploads. Previously this would fail with the error "Response body object should not be disturbed or locked". #​3564

• A warning is now emitted if the CodeQL Action detects a repository property whose name suggests that it relates to the CodeQL Action, but which is not one of the properties recognised by the current version of the CodeQL Action. #​3570

v2.69.6

Compare Source

Initial release