Bug #69494: ERROR: test_selftest_command_spam (tasks.mgr.test_module_selftest.TestModuleSelftest) - mgr - Ceph

Actions

Copy link

Bug #69494

closed

ERROR: test_selftest_command_spam (tasks.mgr.test_module_selftest.TestModuleSelftest)

Added by Laura Flores about 1 year ago. Updated 11 months ago.

Status:

Duplicate

Priority:

Normal

Assignee:

Category:

Target version:

% Done:

Source:

Backport:

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

Pull request ID:

Tags (freeform):

Merge Commit:

Fixed In:

Released In:

Upkeep Timestamp:

Tags:

main-failures

Description

Seeing this in the following failure: /a/skanta-2024-12-05_07:34:09-rados-wip-bharath2-testing-2024-12-04-1214-distro-default-smithi/8021718

2024-12-05T08:39:52.806 INFO:tasks.cephfs_test_runner:test_selftest_command_spam (tasks.mgr.test_module_selftest.TestModuleSelftest) ... ERROR
2024-12-05T08:39:52.806 INFO:tasks.cephfs_test_runner:
2024-12-05T08:39:52.806 INFO:tasks.cephfs_test_runner:======================================================================
2024-12-05T08:39:52.806 INFO:tasks.cephfs_test_runner:ERROR: test_selftest_command_spam (tasks.mgr.test_module_selftest.TestModuleSelftest)
2024-12-05T08:39:52.806 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2024-12-05T08:39:52.806 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2024-12-05T08:39:52.806 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_e4eeebda7d988dc20ee63a4f7e7d82e07061f6d5/virtualenv/lib/python3.10/site-packages/urllib3/connection.py", line 174, in _new_conn
2024-12-05T08:39:52.806 INFO:tasks.cephfs_test_runner:    conn = connection.create_connection(
2024-12-05T08:39:52.806 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_e4eeebda7d988dc20ee63a4f7e7d82e07061f6d5/virtualenv/lib/python3.10/site-packages/urllib3/util/connection.py", line 95, in create_connection
2024-12-05T08:39:52.807 INFO:tasks.cephfs_test_runner:    raise err
2024-12-05T08:39:52.807 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_e4eeebda7d988dc20ee63a4f7e7d82e07061f6d5/virtualenv/lib/python3.10/site-packages/urllib3/util/connection.py", line 85, in create_connection
2024-12-05T08:39:52.807 INFO:tasks.cephfs_test_runner:    sock.connect(sa)
2024-12-05T08:39:52.807 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_e4eeebda7d988dc20ee63a4f7e7d82e07061f6d5/virtualenv/lib/python3.10/site-packages/gevent/_socketcommon.py", line 590, in connect
2024-12-05T08:39:52.807 INFO:tasks.cephfs_test_runner:    self._internal_connect(address)
2024-12-05T08:39:52.807 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_e4eeebda7d988dc20ee63a4f7e7d82e07061f6d5/virtualenv/lib/python3.10/site-packages/gevent/_socketcommon.py", line 634, in _internal_connect
2024-12-05T08:39:52.807 INFO:tasks.cephfs_test_runner:    raise _SocketError(err, strerror(err))
2024-12-05T08:39:52.807 INFO:tasks.cephfs_test_runner:ConnectionRefusedError: [Errno 111] Connection refused
2024-12-05T08:39:52.807 INFO:tasks.cephfs_test_runner:
2024-12-05T08:39:52.807 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred:
2024-12-05T08:39:52.807 INFO:tasks.cephfs_test_runner:
2024-12-05T08:39:52.807 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2024-12-05T08:39:52.807 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_e4eeebda7d988dc20ee63a4f7e7d82e07061f6d5/virtualenv/lib/python3.10/site-packages/urllib3/connectionpool.py", line 715, in urlopen
2024-12-05T08:39:52.807 INFO:tasks.cephfs_test_runner:    httplib_response = self._make_request(
2024-12-05T08:39:52.807 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_e4eeebda7d988dc20ee63a4f7e7d82e07061f6d5/virtualenv/lib/python3.10/site-packages/urllib3/connectionpool.py", line 404, in _make_request
2024-12-05T08:39:52.807 INFO:tasks.cephfs_test_runner:    self._validate_conn(conn)
2024-12-05T08:39:52.808 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_e4eeebda7d988dc20ee63a4f7e7d82e07061f6d5/virtualenv/lib/python3.10/site-packages/urllib3/connectionpool.py", line 1058, in _validate_conn
2024-12-05T08:39:52.808 INFO:tasks.cephfs_test_runner:    conn.connect()
2024-12-05T08:39:52.808 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_e4eeebda7d988dc20ee63a4f7e7d82e07061f6d5/virtualenv/lib/python3.10/site-packages/urllib3/connection.py", line 363, in connect
2024-12-05T08:39:52.808 INFO:tasks.cephfs_test_runner:    self.sock = conn = self._new_conn()
2024-12-05T08:39:52.808 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_e4eeebda7d988dc20ee63a4f7e7d82e07061f6d5/virtualenv/lib/python3.10/site-packages/urllib3/connection.py", line 186, in _new_conn
2024-12-05T08:39:52.808 INFO:tasks.cephfs_test_runner:    raise NewConnectionError(
2024-12-05T08:39:52.808 INFO:tasks.cephfs_test_runner:urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPSConnection object at 0x7ff83a1db8e0>: Failed to establish a new connection: [Errno 111] Connection refused
2024-12-05T08:39:52.808 INFO:tasks.cephfs_test_runner:
2024-12-05T08:39:52.808 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred:
2024-12-05T08:39:52.808 INFO:tasks.cephfs_test_runner:
2024-12-05T08:39:52.808 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2024-12-05T08:39:52.808 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_e4eeebda7d988dc20ee63a4f7e7d82e07061f6d5/virtualenv/lib/python3.10/site-packages/requests/adapters.py", line 486, in send
2024-12-05T08:39:52.808 INFO:tasks.cephfs_test_runner:    resp = conn.urlopen(
2024-12-05T08:39:52.808 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_e4eeebda7d988dc20ee63a4f7e7d82e07061f6d5/virtualenv/lib/python3.10/site-packages/urllib3/connectionpool.py", line 799, in urlopen
2024-12-05T08:39:52.808 INFO:tasks.cephfs_test_runner:    retries = retries.increment(
2024-12-05T08:39:52.808 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_e4eeebda7d988dc20ee63a4f7e7d82e07061f6d5/virtualenv/lib/python3.10/site-packages/urllib3/util/retry.py", line 592, in increment
2024-12-05T08:39:52.808 INFO:tasks.cephfs_test_runner:    raise MaxRetryError(_pool, url, error or ResponseError(cause))
2024-12-05T08:39:52.808 INFO:tasks.cephfs_test_runner:urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='172.21.15.176', port=7790): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7ff83a1db8e0>: Failed to establish a new connection: [Errno 111] Connection refused'))

2024-12-05T08:33:19.153 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'selftest' has failed: Synthetic exception in serve","count":1},"muted":false}},"mutes":[]}

Related issues 1 (1 open — 0 closed)

Actions

Copy link

Updated by Laura Flores about 1 year ago

/a/yuriw-2024-12-18_15:56:21-rados-wip-yuri6-testing-2024-12-17-1653-distro-default-smithi/8043433

Actions

Copy link

Updated by Laura Flores about 1 year ago

Might have something to do with this earlier Traceback:

/a/skanta-2024-12-22_00:38:58-rados-wip-bharath8-testing-2024-12-21-1707-distro-default-smithi/8047122

2024-12-22T04:31:36.716 INFO:tasks.ceph.mgr.z.smithi151.stderr:2024-12-22T04:31:36.157+0000 7f327061f640 -1 log_channel(cluster) log [ERR] : Unhandled exception from module 'dashboard' while running on mgr.z: No module named 'smb'
2024-12-22T04:31:36.716 INFO:tasks.ceph.mgr.z.smithi151.stderr:2024-12-22T04:31:36.157+0000 7f327061f640 -1 dashboard.serve:
2024-12-22T04:31:36.716 INFO:tasks.ceph.mgr.z.smithi151.stderr:2024-12-22T04:31:36.157+0000 7f327061f640 -1 Traceback (most recent call last):
2024-12-22T04:31:36.716 INFO:tasks.ceph.mgr.z.smithi151.stderr:  File "/usr/share/ceph/mgr/dashboard/module.py", line 346, in serve
2024-12-22T04:31:36.716 INFO:tasks.ceph.mgr.z.smithi151.stderr:    mapper, parent_urls = Router.generate_routes(self.url_prefix)
2024-12-22T04:31:36.716 INFO:tasks.ceph.mgr.z.smithi151.stderr:  File "/usr/share/ceph/mgr/dashboard/controllers/_router.py", line 49, in generate_routes
2024-12-22T04:31:36.716 INFO:tasks.ceph.mgr.z.smithi151.stderr:    controllers = BaseController.load_controllers()
2024-12-22T04:31:36.716 INFO:tasks.ceph.mgr.z.smithi151.stderr:  File "/usr/share/ceph/mgr/dashboard/controllers/_base_controller.py", line 45, in load_controllers
2024-12-22T04:31:36.716 INFO:tasks.ceph.mgr.z.smithi151.stderr:    importlib.import_module(f'{__package__}.{module}')
2024-12-22T04:31:36.716 INFO:tasks.ceph.mgr.z.smithi151.stderr:  File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module
2024-12-22T04:31:36.716 INFO:tasks.ceph.mgr.z.smithi151.stderr:    return _bootstrap._gcd_import(name[level:], package, level)
2024-12-22T04:31:36.716 INFO:tasks.ceph.mgr.z.smithi151.stderr:  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
2024-12-22T04:31:36.716 INFO:tasks.ceph.mgr.z.smithi151.stderr:  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
2024-12-22T04:31:36.716 INFO:tasks.ceph.mgr.z.smithi151.stderr:  File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
2024-12-22T04:31:36.716 INFO:tasks.ceph.mgr.z.smithi151.stderr:  File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
2024-12-22T04:31:36.717 INFO:tasks.ceph.mgr.z.smithi151.stderr:  File "<frozen importlib._bootstrap_external>", line 883, in exec_module
2024-12-22T04:31:36.717 INFO:tasks.ceph.mgr.z.smithi151.stderr:  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
2024-12-22T04:31:36.717 INFO:tasks.ceph.mgr.z.smithi151.stderr:  File "/usr/share/ceph/mgr/dashboard/controllers/smb.py", line 8, in <module>
2024-12-22T04:31:36.717 INFO:tasks.ceph.mgr.z.smithi151.stderr:    from smb.enums import Intent
2024-12-22T04:31:36.717 INFO:tasks.ceph.mgr.z.smithi151.stderr:ModuleNotFoundError: No module named 'smb'

Actions

Copy link