Celery 5 custom inspect commands doesn't work in the CLI #6608
Description
Checklist
- I have verified that the issue exists against the
masterbranch of Celery. - This has already been asked to the discussion group first.
- I have read the relevant section in the
contribution guide
on reporting bugs. - I have checked the issues list
for similar or identical bug reports. - I have checked the pull requests list
for existing proposed fixes. - I have checked the commit log
to find out if the bug was already fixed in the master branch. - I have included all related issues and possible duplicate issues
in this issue (If there are none, check this box anyway).
Mandatory Debugging Information
- I have included the output of
celery -A proj reportin the issue.
(if you are not able to do this, then at least specify the Celery
version affected). - I have verified that the issue exists against the
masterbranch of Celery. - I have included the contents of
pip freezein the issue. - I have included all the versions of all the external dependencies required
to reproduce this bug.
Optional Debugging Information
- I have tried reproducing the issue on more than one Python version
and/or implementation. - I have tried reproducing the issue on more than one message broker and/or
result backend. - I have tried reproducing the issue on more than one version of the message
broker and/or result backend. - I have tried reproducing the issue on more than one operating system.
- I have tried reproducing the issue on more than one workers pool.
- I have tried reproducing the issue with autoscaling, retries,
ETA/Countdown & rate limits disabled. - I have tried reproducing the issue after downgrading
and/or upgrading Celery and its dependencies.
Related Issues and Possible Duplicates
Related Issues
- None
Possible Duplicates
- None
Environment & Settings
Celery version:
celery report Output:
software -> celery:5.0.5 (singularity) kombu:5.0.2 py:3.7.5 billiard:3.6.3.0 py-amqp:5.0.3 platform -> system:Linux arch:64bit, ELF kernel version:4.4.0-19041-Microsoft imp:CPython loader -> celery.loaders.default.Loader settings -> transport:amqp results:disabled
deprecated_settings: None
Steps to Reproduce
Required Dependencies
- Minimal Python Version: N/A or Unknown
- Minimal Celery Version: 5
- Minimal Kombu Version: N/A or Unknown
- Minimal Broker Version: N/A or Unknown
- Minimal Result Backend Version: N/A or Unknown
- Minimal OS and/or Kernel Version: N/A or Unknown
- Minimal Broker Client Version: N/A or Unknown
- Minimal Result Backend Client Version: N/A or Unknown
Python Packages
pip freeze Output:
absl-py==0.9.0
aiohttp==3.6.2
aiomisc==11.0.0
amqp==5.0.3
appdirs==1.4.4
asgiref==3.2.10
asn1crypto==0.24.0
astor==0.8.1
async-timeout==3.0.1
atomicwrites==1.3.0
attrs==19.3.0
auth0-python==3.9.1
aws2-wrap==1.1.4
awscli==1.14.44
Babel==2.8.0
backcall==0.1.0
billiard==3.6.3.0
boto3==1.14.19
boto3-stubs==1.14.19.0
botocore==1.17.63
Brotli==1.0.9
cachetools==4.0.0
celery==5.0.5
certifi==2019.11.28
cffi==1.14.0
chardet==3.0.4
click==7.1.2
click-didyoumean==0.0.3
click-plugins==1.1.1
click-repl==0.1.6
colorama==0.3.7
colorlog==4.4.0
convertdate==2.2.2
cryptography==2.7
ddtrace==0.44.0
decorator==4.4.2
defusedxml==0.6.0
Django==3.1.2
django-celery-results==1.0.4
django-cors-headers==3.1.0
django-debug-toolbar==3.1.1
django-filter==2.1.0
django-prometheus==1.0.15
django-rest-auth==0.9.5
django-rest-framework-condition==0.1.1
djangorestframework==3.12.1
djangorestframework-jwt==1.11.0
docutils==0.15.2
ecdsa==0.15
ffmpeg-python==0.2.0
fitparse==1.1.0
flower==0.9.3
fusepy==3.0.1
future==0.18.2
gast==0.2.2
gitdb==4.0.2
gitdb2==3.0.0
GitPython==3.1.0
glfw==1.8.2
google-auth==1.11.3
google-auth-oauthlib==0.4.1
google-pasta==0.2.0
gprof2dot==2019.11.30
graphqlclient==0.2.4
grpcio==1.27.2
h5py==2.10.0
holidays==0.10.1
idna==2.6
imageio-ffmpeg==0.3.0
importlib-metadata==1.5.0
imutils==0.5.2
intervaltree==3.1.0
ipython==7.6.1
ipython-genutils==0.2.0
jedi==0.16.0
jmespath==0.9.5
joblib==0.14.1
Keras-Applications==1.0.8
Keras-Preprocessing==1.1.0
keyring==10.6.0
keyrings.alt==3.0
kombu==5.0.2
kubernetes==12.0.0
logzio-python-handler==2.0.13
lxml==4.4.2
Markdown==3.2.1
memory-profiler==0.57.0
more-itertools==8.2.0
multidict==4.7.5
munkres==1.1.2
mypy-boto3==1.14.19.0
mypy-boto3-cloudformation==1.14.19.0
mypy-boto3-dynamodb==1.14.19.0
mypy-boto3-ec2==1.14.19.0
mypy-boto3-lambda==1.14.19.0
mypy-boto3-rds==1.14.19.0
mypy-boto3-s3==1.14.19.0
mypy-boto3-sqs==1.14.19.0
numpy==1.17.0
oauthlib==3.1.0
olefile==0.45.1
opencv-python==3.4.5.20
opt-einsum==3.2.0
packaging==20.3
pandas==1.1.4
parso==0.6.2
pdfkit==0.6.1
pexpect==4.8.0
pickleshare==0.7.5
Pillow==7.1.2
pipdeptree==1.0.0
pluggy==0.13.1
pprofile==2.0.2
prometheus-client==0.7.1
prompt-toolkit==2.0.10
protobuf==3.11.3
psutil==5.7.0
psycopg2-binary==2.8.3
ptyprocess==0.6.0
py==1.8.1
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.20
pycrypto==2.6.1
pyee==7.0.4
Pygments==2.6.1
pygobject==3.26.1
PyJWT==1.7.1
PyMeeus==0.3.7
PyOpenGL==3.1.0
pyparsing==2.4.6
pyperclip==1.7.0
pyppeteer==0.2.2
pyquaternion==0.9.5
PySocks==1.7.1
pytest==4.6.5
pytest-django==3.10.0
pytest-django-ordering==1.2.0
pytest-profiling==1.7.0
python-apt==1.6.5+ubuntu0.2
python-dateutil==2.8.0
python-dotenv==0.10.3
python-http-client==3.2.6
python-jose==3.0.1
python-json-logger==0.1.11
python-memcached==1.59
python3-openid==3.1.0
pytz==2019.3
pyxdg==0.25
PyYAML==5.3.1
redis==3.3.11
requests==2.22.0
requests-oauthlib==1.3.0
retry==0.9.2
roman==2.0.0
rsa==4.0
s3transfer==0.3.3
scikit-fmm==2019.1.30
scikit-learn==0.23.1
scipy==1.3.1
SecretStorage==2.3.1
sendgrid==6.4.1
Shapely==1.6.4.post2
six==1.12.0
smmap==3.0.1
smmap2==3.0.1
social-auth-app-django==3.1.0
social-auth-core==3.2.0
sortedcontainers==2.3.0
sqlparse==0.3.1
starkbank-ecdsa==1.1.0
tenacity==6.3.1
tensorboard==2.0.2
tensorflow==2.0.0
tensorflow-estimator==2.0.1
termcolor==1.1.0
threadpoolctl==2.1.0
tornado==5.1.1
tqdm==4.56.0
traitlets==4.3.3
tripy==1.0.0
twilio==6.29.3
typing-extensions==3.7.4.3
unattended-upgrades==0.1
urllib3==1.25.8
uWSGI==2.0.18
vine==5.0.0
wcwidth==0.1.8
websocket-client==0.57.0
websockets==8.1
Werkzeug==1.0.0
wrapt==1.12.1
xgboost==0.90
xlrd==1.2.0
XlsxWriter==1.2.8
xxhash==1.3.0
yappi==1.0
yarl==1.4.2
zipp==3.1.0
Other Dependencies
Details
N/A
Minimally Reproducible Test Case
Details
Expected Behavior
Actual Behavior
Hi, I think there is a bug with version 5+.
When using the guide in the docs for writing custom control commands and trying to run it from the CLI, it fails. When running this command from a python script, it is working (with broadcast). When using celery 4.4.3 on the same code, it also works.
The guide: https://docs.celeryproject.org/en/stable/userguide/workers.html#writing-your-own-remote-control-commands
the error:
$ celery -A route inspect current_prefetch_count
Usage: celery inspect [OPTIONS] [report|conf|query_task|clock|ping|stats|sched
uled|reserved|active|revoked|registered|objgraph|memsamp
le|memdump|active_queues]
Try 'celery inspect --help' for help.
Error: Invalid value for '[report|conf|query_task|clock|ping|stats|scheduled|reserved|active|revoked|registered|objgraph|memsample|memdump|active_queues]': invalid choice: current_prefetch_count. (choose from report, conf, query_task, clock, ping, stats, scheduled, rese
rved, active, revoked, registered, objgraph, memsample, memdump, active_queues)