Skip to content

[test] Run benchmarks in Azure Pipelines when approved#23895

Merged
eps1lon merged 8 commits intomui:nextfrom
eps1lon:test/benchmark-compareable
Dec 9, 2020
Merged

[test] Run benchmarks in Azure Pipelines when approved#23895
eps1lon merged 8 commits intomui:nextfrom
eps1lon:test/benchmark-compareable

Conversation

@eps1lon
Copy link
Member

@eps1lon eps1lon commented Dec 8, 2020

So that every member can update/inspect the results.

Example run: https://dev.azure.com/mui-org/Material-UI/_build/results?buildId=19952&view=results
How to run:

  1. Click on the "Details" link of the azure pipelines check of a GitHub PR
  2. Continue to the build on dev.azure.com
  3. "Run new"
  4. Variables
  5. Use benchmark for command
  6. Run
  7. The result will be available as a pipeline artifact

benchmark run

why CircleCI is not viable

Might prevent dependabot from automatically merging. If that happens I'll try a different approach (e.g. webhooks, uncommenting lines in the CI config etc.)
Update: Yep, CircleCI approvals are not viable for github: https://ideas.circleci.com/cloud-feature-requests/p/show-overall-all-checks-have-passed-status-in-github-even-on-builds-with-incompl
Update2: I have no idea how to even look at the approved job. It immediately went green and the link for the job (from github) just points to the full pipeline: https://circleci.com/workflow-run/ab4615e9-b491-49d8-aaf5-5ea082c5a3ec?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-workflow-link

@mui-pr-bot
Copy link

mui-pr-bot commented Dec 8, 2020

No bundle size changes

Generated by 🚫 dangerJS against afc9bfb

@eps1lon eps1lon changed the title [test] Run benchmarks in CircleCI when approved [test] Run benchmarks in Azure Pipelines when approved Dec 8, 2020
@eps1lon eps1lon requested a review from mnajdova December 8, 2020 19:22
@eps1lon eps1lon marked this pull request as ready for review December 8, 2020 19:30
Copy link
Member

@mnajdova mnajdova left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚀 thanks for adding this :)

@eps1lon eps1lon merged commit 5264e1a into mui:next Dec 9, 2020
@eps1lon eps1lon deleted the test/benchmark-compareable branch December 9, 2020 10:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants