Skip to content

Conversation

@mayagbarnes
Copy link
Collaborator

@mayagbarnes mayagbarnes commented Nov 18, 2022

📚 Context

I've noticed 3 specs fail on the 'before all' hook lately - See Flaky Tests section of Notion doc for addtl. details
Screen Shot 2022-11-18 at 11 53 52 AM

Based on the videos, they are failing in loadApp, which checks that the script is no longer running via the StatusWidget with a 10000 millisecond timeout. This doesn't seem to be enough time for some of the scripts in the CI runner, so I added a longer timeout to allow the script to finish running.

  • What kind of change does this PR introduce?
    • Other, please describe: Flaky CI Tests

Contribution License Agreement

By submitting this pull request you agree that all contributions to this project are made under the Apache 2.0 license.

Copy link
Collaborator

@vdonato vdonato left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

We could alternatively increase the timeout to 20s everywhere since it shouldn't slow down tests that take less time, but I don't have a strong opinion either way

@mayagbarnes mayagbarnes added the security-assessment-completed Security assessment has been completed for PR label Nov 19, 2022
@mayagbarnes mayagbarnes changed the title [WIP] Update loadApp command for custom timeout Update loadApp command for custom timeout Nov 19, 2022
@mayagbarnes mayagbarnes marked this pull request as ready for review November 19, 2022 00:48
@mayagbarnes mayagbarnes changed the title Update loadApp command for custom timeout Update loadApp command timeout Nov 19, 2022
@mayagbarnes mayagbarnes merged commit 4c4f7cd into develop Nov 21, 2022
@mayagbarnes mayagbarnes deleted the cy-command branch November 21, 2022 08:54
tconkling added a commit to tconkling/streamlit that referenced this pull request Nov 21, 2022
# By Abhik Lodh (1) and others
# Via GitHub
* develop:
  memo_test/singleton_test: ensure ScriptRunCtx exists (streamlit#5739)
  Update loadApp command timeout (streamlit#5731)
  Allow emojis with variant selectors to be validated (streamlit#5583)

# Conflicts:
#	lib/tests/streamlit/runtime/caching/cache_data_api_test.py
#	lib/tests/streamlit/runtime/caching/cache_resource_api_test.py
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

security-assessment-completed Security assessment has been completed for PR

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants