Skip to content

TST: bump hash for failing mpldev image test#16722

Merged
pllim merged 1 commit intoastropy:mainfrom
neutrinoceros:tst/bump_mpldev_image_hash
Jul 15, 2024
Merged

TST: bump hash for failing mpldev image test#16722
pllim merged 1 commit intoastropy:mainfrom
neutrinoceros:tst/bump_mpldev_image_hash

Conversation

@neutrinoceros
Copy link
Contributor

Description

Fix a failing image comparison test (the hash changed somehow but the image itself didn't, at least not in any human visible way)
example logs

  • By checking this box, the PR author has requested that maintainers do NOT use the "Squash and Merge" button. Maintainers should respect this when possible; however, the final decision is at the discretion of the maintainer that merges the PR.

@github-actions
Copy link
Contributor

Thank you for your contribution to Astropy! 🌌 This checklist is meant to remind the package maintainers who will review this pull request of some common things to look for.

  • Do the proposed changes actually accomplish desired goals?
  • Do the proposed changes follow the Astropy coding guidelines?
  • Are tests added/updated as required? If so, do they follow the Astropy testing guidelines?
  • Are docs added/updated as required? If so, do they follow the Astropy documentation guidelines?
  • Is rebase and/or squash necessary? If so, please provide the author with appropriate instructions. Also see instructions for rebase and squash.
  • Did the CI pass? If no, are the failures related? If you need to run daily and weekly cron jobs as part of the PR, please apply the "Extra CI" label. Codestyle issues can be fixed by the bot.
  • Is a change log needed? If yes, did the change log check pass? If no, add the "no-changelog-entry-needed" label. If this is a manual backport, use the "skip-changelog-checks" label unless special changelog handling is necessary.
  • Is this a big PR that makes a "What's new?" entry worthwhile and if so, is (1) a "what's new" entry included in this PR and (2) the "whatsnew-needed" label applied?
  • At the time of adding the milestone, if the milestone set requires a backport to release branch(es), apply the appropriate "backport-X.Y.x" label(s) before merge.

@github-actions
Copy link
Contributor

👋 Thank you for your draft pull request! Do you know that you can use [ci skip] or [skip ci] in your commit messages to skip running continuous integration tests until you are ready?

@neutrinoceros neutrinoceros marked this pull request as ready for review July 14, 2024 14:18
@@ -1,5 +1,5 @@
{

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

{ "astropy.visualization.wcsaxes.tests.test_frame.TestFrame.test_custom_frame": "d79ed179997672de0a929aedee3c2ac590e04b544558808ac9bace8937a60275", "astropy.visualization.wcsaxes.tests.test_frame.TestFrame.test_update_clip_path_rectangular": "30e13643c770a26b2707745143f50a735daa6f37a6a8258e733ae35338a4a1bb", "astropy.visualization.wcsaxes.tests.test_frame.TestFrame.test_update_clip_path_nonrectangular": "37de34740cef2897effc9de5e6726ef3955a3449d0fa6a929350301500557b8e", "astropy.visualization.wcsaxes.tests.test_frame.TestFrame.test_update_clip_path_change_wcs": "c68e961f0a21cc0dcc43c523cee1c564d94bd96c795f976d51e5198fc52f83cc" }

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry I don't get what you're suggesting here

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Update the Baseline Image
Open a terminal on system.

Navigate to the directory containing the test results:
cd /home/circleci/project/results/astropy.visualization.wcsaxes.tests.test_frame.TestFrame.test_custom_frame/
Rerun the tests to verify everything works:
pytest --pyargs astropy

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah, I think I see what's confusing here:
Image generation is not 100% platform portable, but at the same time we cannot tolerate any level of difference between reference images and the ones we get from CI. As a consequence, we can't run image tests locally. I think this is why you're seeing differences on your side, but CI is the only authority in this context.

Copy link

@Eventhorizon32 Eventhorizon32 Jul 15, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

oh! I think I got it
Consider using a Docker container that mimics the CI environment for local development. This can help reduce discrepancies between local runs and CI, though it may not completely eliminate differences in image generation.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@astrofrog and @Cadair set this up, so maybe they can comment from the infrastructure side.

@@ -1,5 +1,5 @@
{

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Update the Baseline Image
Open a terminal on system.

Navigate to the directory containing the test results:
cd /home/circleci/project/results/astropy.visualization.wcsaxes.tests.test_frame.TestFrame.test_custom_frame/
Rerun the tests to verify everything works:
pytest --pyargs astropy

@pllim
Copy link
Member

pllim commented Jul 15, 2024

Hmm why is this not showing on the CI run for main? Though that was 3 days ago, let me rerun -- https://app.circleci.com/pipelines/github/astropy/astropy?branch=main

Copy link
Member

@pllim pllim left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK the rerun failed, but green here, so let's get this in. Thanks!

@pllim pllim merged commit 9b351c9 into astropy:main Jul 15, 2024
meeseeksmachine pushed a commit to meeseeksmachine/astropy that referenced this pull request Jul 15, 2024
@neutrinoceros neutrinoceros deleted the tst/bump_mpldev_image_hash branch July 15, 2024 14:54
pllim added a commit that referenced this pull request Jul 15, 2024
…722-on-v6.1.x

Backport PR #16722 on branch v6.1.x (TST: bump hash for failing mpldev image test)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants