Skip to content

Conversation

@kenzieschmoll
Copy link
Member

@kenzieschmoll kenzieschmoll commented Nov 26, 2024

Re-enables DevTools tests after the changes were made in flutter/devtools#8552 to reduce the number of tests running on each flutter commit.

Timing breakdown:

  • [2 min] setup.sh (getting pub packages and generating mocks for DevTools tests - required to run tests)
  • [1 min] running "update" for DevTools packages (flutter packages get && dart fix --apply - standard for all flutter customer tests)
  • [4 min] analyze.sh (running dart analyze over DevTools code - also standard practice for flutter customer tests)
  • [8 min] running a subset of DevTools tests that are dependent upon the Flutter framework and are likely to catch breakages

If this is still too long, one thing we could try is to run the analyze.sh script in a different test registry entry. The shard containing the DevTools test (linux shard 1) is still faster than linux shard 2, so reducing the time further may not be necessary since it will not improve the overall speed of the flutter customer test.

EDIT: the analysis of the DevTools codebase was moved into its own registry entry to speed up performance.

@kenzieschmoll kenzieschmoll requested a review from Piinks November 26, 2024 00:10
@kenzieschmoll kenzieschmoll removed the request for review from Piinks November 26, 2024 16:44
@kenzieschmoll kenzieschmoll marked this pull request as draft November 26, 2024 16:44
@kenzieschmoll kenzieschmoll requested a review from Piinks November 26, 2024 21:02
@kenzieschmoll kenzieschmoll marked this pull request as ready for review November 26, 2024 21:02
Copy link
Contributor

@Piinks Piinks left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

one thing we could try is to run the analyze.sh script in a different test registry entry

This is a great idea. Can we do this?

Piinks
Piinks previously approved these changes Dec 2, 2024
Copy link
Contributor

@Piinks Piinks left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM thank you!

Copy link
Contributor

@Piinks Piinks left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@kenzieschmoll kenzieschmoll merged commit 75c7f78 into flutter:main Dec 2, 2024
12 checks passed
@kenzieschmoll kenzieschmoll deleted the dt-tests branch December 2, 2024 21:07
@Piinks
Copy link
Contributor

Piinks commented Dec 2, 2024

Devtools tests immediately failed after being re-enabled here. Reverting to fix the flutter/flutter build.

Piinks added a commit that referenced this pull request Dec 2, 2024
Piinks added a commit that referenced this pull request Dec 2, 2024
@kenzieschmoll
Copy link
Member Author

Devtools tests immediately failed after being re-enabled here. Reverting to fix the flutter/flutter build.

Do you have a link to the failure?

@Piinks
Copy link
Contributor

Piinks commented Dec 2, 2024

kenzieschmoll added a commit that referenced this pull request Dec 3, 2024
victoreronmosele pushed a commit to victoreronmosele/tests that referenced this pull request Feb 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants