Skip to content

chore(ci): Enhance CI with workflow_dispatch for targeted debugging and testing (#8822)#8826

Merged
Nusnus merged 2 commits intocelery:mainfrom
50-Course:8822-gh-workflow-dispatch-action
Jan 30, 2024
Merged

chore(ci): Enhance CI with workflow_dispatch for targeted debugging and testing (#8822)#8826
Nusnus merged 2 commits intocelery:mainfrom
50-Course:8822-gh-workflow-dispatch-action

Conversation

@50-Course
Copy link
Contributor

Description

This patch introduces workflow_dispatch trigger into CI, to allow for more manual and targeted control of running independent pipelines during CI debugging or test environments.

A solution to help developers run isolated workflows from their CLI, in case of failure.

At the moment, the implementation respects strong defaults according to the events documentation

Fixes #8822

@Nusnus Nusnus self-requested a review January 30, 2024 09:20
… and testing (celery#8822)

This patch introduces `workflow_dispatch` trigger into CI, to allow for more manual and targeted
control of running independent pipelines during CI debugging or test environments.

A solution to help developers run isolated workflows from their CLI, in case of failure.

At the moment, the implmentation respects strong defaults according to the events documentation:
https://docs.github.com/en/actions/using-workflows/events-that-trigger-workflows#providing-inputs
@Nusnus Nusnus force-pushed the 8822-gh-workflow-dispatch-action branch from 440a7b0 to 7c8772e Compare January 30, 2024 10:58
@codecov
Copy link

codecov bot commented Jan 30, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (eff0b2f) 81.25% compared to head (7c8772e) 81.25%.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #8826      +/-   ##
==========================================
- Coverage   81.25%   81.25%   -0.01%     
==========================================
  Files         149      149              
  Lines       18553    18553              
  Branches     3166     3166              
==========================================
- Hits        15076    15075       -1     
  Misses       3191     3191              
- Partials      286      287       +1     
Flag Coverage Δ
unittests 81.23% <ø> (-0.01%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@50-Course
Copy link
Contributor Author

At this point the runners are stressed, give it some break and rerun failing workflows - should pass!

image

@Nusnus Nusnus added the CI label Jan 30, 2024
@Nusnus Nusnus added this to the 5.4 milestone Jan 30, 2024
@Nusnus
Copy link
Member

Nusnus commented Jan 30, 2024

Exception ignored in: <function AsyncResult.__del__ at 0x7f8a63cf4040>
Traceback (most recent call last):
  File "/home/runner/work/celery/celery/celery/result.py", line 417, in __del__
    self.backend.remove_pending_result(self)
  File "/home/runner/work/celery/celery/celery/backends/asynchronous.py", line 208, in remove_pending_result
    self.on_result_fulfilled(result)
  File "/home/runner/work/celery/celery/celery/backends/asynchronous.py", line 216, in on_result_fulfilled
    self.result_consumer.cancel_for(result.id)
  File "/home/runner/work/celery/celery/celery/backends/redis.py", line 184, in cancel_for
    self._pubsub.unsubscribe(key)
  File "/opt/hostedtoolcache/Python/3.9.18/x64/lib/python3.9/contextlib.py", line 137, in __exit__
    self.gen.throw(typ, value, traceback)
  File "/home/runner/work/celery/celery/celery/backends/redis.py", line 130, in reconnect_on_error
    self._ensure(self._reconnect_pubsub, ())
  File "/home/runner/work/celery/celery/celery/backends/redis.py", line 384, in ensure
    return retry_over_time(
  File "/home/runner/work/celery/celery/.tox/3.9-smoke/lib/python3.9/site-packages/kombu/utils/functional.py", line 318, in retry_over_time
    return fun(*args, **kwargs)
  File "/home/runner/work/celery/celery/celery/backends/redis.py", line 117, in _reconnect_pubsub
    self._pubsub.connection = self._pubsub.connection_pool.get_connection(
  File "/home/runner/work/celery/celery/.tox/3.9-smoke/lib/python3.9/site-packages/redis/connection.py", line 1086, in get_connection
    connection.connect()
  File "/home/runner/work/celery/celery/.tox/3.9-smoke/lib/python3.9/site-packages/redis/connection.py", line 270, in connect
    raise ConnectionError(self._error_message(e))
redis.exceptions.ConnectionError: Error 111 connecting to localhost:32882. Connection refused.

When the smoke tests start hanging its due to some instability with the Redis container.
We’ll have to live with it for now - I’ve stopped the workflow and will restart it now.

But this PR is as good as merged.

@Nusnus Nusnus merged commit 1b01fe7 into celery:main Jan 30, 2024
@Nusnus
Copy link
Member

Nusnus commented Jan 30, 2024

@50-Course as an Admin I am not sure this affects my UI.
Can you please share a screenshot of the new change?

Maybe after rebasing on main the other PR with the failing pypy run - I wonder what that change looks like :)

@50-Course 50-Course deleted the 8822-gh-workflow-dispatch-action branch January 31, 2024 01:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

Add workflow_dispatch event to CI for granular workflow control

2 participants