Skip to content

Add CLI command to remove all queues from Celery worker#56195

Merged
jscheffl merged 1 commit into
apache:mainfrom
dheerajturaga:feature/celery-remove-all-queues
Sep 30, 2025
Merged

Add CLI command to remove all queues from Celery worker#56195
jscheffl merged 1 commit into
apache:mainfrom
dheerajturaga:feature/celery-remove-all-queues

Conversation

@dheerajturaga

@dheerajturaga dheerajturaga commented Sep 29, 2025

Copy link
Copy Markdown
Member

Implement command that unsubscribes a Celery worker from all its active queues. This complements the existing command by providing a bulk operation for queue management. Idea is to quickly move a worker out from service without actually shutting it down. Intent is to create a similar effect as Edge Executor's Maintenance Mode

image

cc: @jscheffl

  Implement  command that unsubscribes
  a Celery worker from all its active queues. This complements the existing
   command by providing a bulk operation for queue management.

@jscheffl jscheffl left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Interesting feature! Looks good and valid for me.

Would it be a use case as well to add a list of queues again as batch to restore after maintenance?

@dheerajturaga

dheerajturaga commented Sep 30, 2025

Copy link
Copy Markdown
Member Author

Interesting feature! Looks good and valid for me.

Would it be a use case as well to add a list of queues again as batch to restore after maintenance?

We already have a add-queues method that takes a comma separated queue.

@jscheffl jscheffl merged commit 964997a into apache:main Sep 30, 2025
78 checks passed
dabla pushed a commit to dabla/airflow that referenced this pull request Oct 12, 2025
Implement  command that unsubscribes
  a Celery worker from all its active queues. This complements the existing
   command by providing a bulk operation for queue management.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants