Skip to content

feat(infra): Bump backend test sharding #105083

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
rbro112 wants to merge 2 commits into from
Closed

feat(infra): Bump backend test sharding #105083

rbro112 wants to merge 2 commits into from

Conversation

@rbro112
Copy link
Member

@rbro112 rbro112 commented Dec 16, 2025 •
edited
Loading

Bumps by 3 shards to 25. Should get test time slightly down

@rbro112 rbro112 requested a review from a team as a code owner December 16, 2025 19:59
@rbro112 rbro112 mentioned this pull request Dec 16, 2025
Merged
@rbro112 rbro112 changed the title Bump backend test sharding feat(infra): Bump backend test sharding Dec 16, 2025
@rbro112 Graphite App
Copy link
Member Author

rbro112 commented Dec 16, 2025 •
edited
Loading

This stack of pull requests is managed by Graphite. Learn more about stacking.

@github-actions github-actions bot added the Scope: Backend Automatically applied to PRs that change backend components label Dec 16, 2025
sentry[bot]
sentry bot reviewed Dec 16, 2025
View reviewed changes
.github/workflows/backend.yml
MATRIX_INSTANCE_TOTAL: 32
TEST_GROUP_STRATEGY: roundrobin

steps:

This comment was marked as outdated.

Sign in to view

Base automatically changed from ryan/increase_backend_test_sharding to master December 16, 2025 20:29
@rbro112 rbro112 force-pushed the ryan/bump_backend_test_sharding branch from 57f1f93 to ae5c652 Compare December 16, 2025 22:54
@codecov
Copy link

codecov bot commented Dec 16, 2025 •
edited
Loading

❌ 4 Tests Failed:

Tests completed Failed Passed Skipped
30694 4 30690 242
View the top 3 failed test(s) by shortest run time 
tests.sentry.testutils.thread_leaks.test_pytest.TestSentryCapture::test_capture_event_allowlisted
Stack Traces | 0.503s run time 
#x1B[1m#x1B[.../testutils/thread_leaks/test_pytest.py#x1B[0m:154: in test_capture_event_allowlisted
    assert event["level"] == "info"  # allowlisted
#x1B[1m#x1B[31mE   AssertionError: assert 'warning' == 'info'#x1B[0m
#x1B[1m#x1B[31mE     #x1B[0m
#x1B[1m#x1B[31mE     - info#x1B[0m
#x1B[1m#x1B[31mE     + warning#x1B[0m
tests.sentry.testutils.thread_leaks.test_pytest.TestSentryCapture::test_capture_event_strict_no_allowlist
Stack Traces | 0.511s run time 
#x1B[1m#x1B[.../testutils/thread_leaks/test_pytest.py#x1B[0m:54: in test_capture_event_strict_no_allowlist
    assert event["level"] == "error"  # strict=True, no allowlist
#x1B[1m#x1B[31mE   AssertionError: assert 'warning' == 'error'#x1B[0m
#x1B[1m#x1B[31mE     #x1B[0m
#x1B[1m#x1B[31mE     - error#x1B[0m
#x1B[1m#x1B[31mE     + warning#x1B[0m
tests.sentry.discover.test_dataset_split.DiscoverSavedQueryDatasetSplitTestCase::test_unhandled_filter_sets_error_events_dataset
Stack Traces | 3.48s run time 
#x1B[1m#x1B[.../sentry/discover/test_dataset_split.py#x1B[0m:626: in test_unhandled_filter_sets_error_events_dataset
    assert error_query.dataset_source == DatasetSourcesTypes.FORCED.value
#x1B[1m#x1B[31mE   AssertionError: assert 1 == 3#x1B[0m
#x1B[1m#x1B[31mE    +  where 1 = <DiscoverSavedQuery at 0x7f4488fc4320: id=6, organization_id=4557295182086145, created_by_id=None, name=''>.dataset_source#x1B[0m
#x1B[1m#x1B[31mE    +  and   3 = <DatasetSourcesTypes.FORCED: 3>.value#x1B[0m
#x1B[1m#x1B[31mE    +    where <DatasetSourcesTypes.FORCED: 3> = DatasetSourcesTypes.FORCED#x1B[0m
View the full list of 1 ❄️ flaky test(s) 
tests.sentry.eventstream.test_item_helpers.ItemHelpersTest::test_encode_attributes_with_tags

Flake rate in main: 64.29% (Passed 5 times, Failed 9 times)

Stack Traces | 1.82s run time 
#x1B[1m#x1B[.../sentry/eventstream/test_item_helpers.py#x1B[0m:125: in test_encode_attributes_with_tags
    assert result["tag_keys"] == AnyValue(
#x1B[1m#x1B[31mE   assert array_value {\n  values {\n    string_value: "tags[environment]"\n  }\n  values {\n    string_value: "tags[release]"\n  }\n  values {\n    string_value: "tags[level]"\n  }\n}\n == array_value {\n  values {\n    string_value: "tags[environment]"\n  }\n  values {\n    string_value: "tags[level]"\n  }\n  values {\n    string_value: "tags[release]"\n  }\n}\n#x1B[0m
#x1B[1m#x1B[31mE    +  where array_value {\n  values {\n    string_value: "tags[environment]"\n  }\n  values {\n    string_value: "tags[level]"\n  }\n  values {\n    string_value: "tags[release]"\n  }\n}\n = AnyValue(array_value=values {\n  string_value: "tags[environment]"\n}\nvalues {\n  string_value: "tags[level]"\n}\nvalues {\n  string_value: "tags[release]"\n}\n)#x1B[0m
#x1B[1m#x1B[31mE    +    where values {\n  string_value: "tags[environment]"\n}\nvalues {\n  string_value: "tags[level]"\n}\nvalues {\n  string_value: "tags[release]"\n}\n = ArrayValue(values=[string_value: "tags[environment]"\n, string_value: "tags[level]"\n, string_value: "tags[release]"\n])#x1B[0m

To view more test analytics, go to the Test Analytics Dashboard
📋 Got 3 mins? Take this short survey to help us improve Test Analytics.

@getsantry
Copy link
Contributor

getsantry bot commented Jan 7, 2026

This pull request has gone three weeks without activity. In another week, I will close it.

But! If you comment or otherwise update it, I will reset the clock, and if you add the label WIP, I will leave it alone unless WIP is removed ... forever!

"A weed is but an unloved flower." ― Ella Wheeler Wilcox 🥀

@getsantry getsantry bot added the Stale label Jan 7, 2026
@rbro112 rbro112 closed this Jan 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@sentry sentry[bot] sentry[bot] left review comments

@joshuarli joshuarli joshuarli approved these changes

Assignees

No one assigned

Labels

Scope: Backend Automatically applied to PRs that change backend components Stale

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@rbro112 @joshuarli