Bug #73663: bucket notifications: ERROR: Failure: ModuleNotFoundError (No module named 'boto.vendored.six.moves') - rgw - Ceph

Actions

Copy link

Bug #73663

open

bucket notifications: ERROR: Failure: ModuleNotFoundError (No module named 'boto.vendored.six.moves')

Added by Casey Bodley 5 months ago. Updated 17 days ago.

Status:

Pending Backport

Priority:

Urgent

Assignee:

Yuval Lifshitz

Target version:

% Done:

Source:

Backport:

tentacle squid

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

Pull request ID:

67387

Tags (freeform):

backport_processed

Merge Commit:

e851e5ab38b68d841f016dac938a4c824bd156be

Fixed In:

v20.3.0-5593-ge851e5ab38

Released In:

Upkeep Timestamp:

2026-02-25T08:53:48+00:00

Tags:

notifications

Description

on ubuntu 24 with python 3.12, test_bn.py fails with:

Failure: ModuleNotFoundError (No module named 'boto.vendored.six.moves') ... ERROR

======================================================================
ERROR: Failure: ModuleNotFoundError (No module named 'boto.vendored.six.moves')
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib/python3.12/site-packages/nose/failure.py", line 40, in runTest
    raise self.exc_val.with_traceback(self.tb)
  File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib/python3.12/site-packages/nose/loader.py", line 422, in loadTestsFromName
    module = self.importer.importFromPath(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib/python3.12/site-packages/nose/importer.py", line 100, in importFromPath
    return self.importFromDir(dir_path, fqname)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib/python3.12/site-packages/nose/importer.py", line 152, in importFromDir
    mod = load_module(part_fqname, fh, filename, desc)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib/python3.12/site-packages/nose/importer.py", line 69, in load_module
    spec.loader.exec_module(module)
  File "<frozen importlib._bootstrap_external>", line 995, in exec_module
  File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed
  File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/test_bn.py", line 13, in <module>
    import boto
  File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib/python3.12/site-packages/boto/__init__.py", line 27, in <module>
    from boto.pyami.config import Config, BotoConfigLocations
  File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib/python3.12/site-packages/boto/pyami/config.py", line 29, in <module>
    from boto.compat import expanduser, ConfigParser, NoOptionError, NoSectionError, StringIO
  File "/home/ubuntu/cephtest/ceph/src/test/rgw/bucket_notification/virtualenv/lib/python3.12/site-packages/boto/compat.py", line 52, in <module>
    from boto.vendored.six.moves import filter, http_client, map, _thread, \
ModuleNotFoundError: No module named 'boto.vendored.six.moves'

from https://pulpito.ceph.com/cbodley-2025-10-28_18:56:35-rgw:notifications-wip-cbodley-testing-distro-default-gibba/

Related issues 2 (2 open — 0 closed)

Actions

Copy link

Updated by Casey Bodley 5 months ago

Description updated (diff)

Actions

Copy link

Updated by Casey Bodley 5 months ago

Assignee set to Yuval Lifshitz

@Yuval Lifshitz just making sure this is on your radar, things will break once we add ubuntu24/rocky10 to the qa suites after tentacle ships

Actions

Copy link

Updated by Mark Kogan 4 months ago

a workaround to install python 3.11.11 on RHEL 10 is detailed in:
https://tracker.ceph.com/issues/72500#note-8

Actions

Copy link

Updated by Yuval Lifshitz 4 months ago

will replacing boto with boto3 in all of the bucket notifications tests fix the issue?

Actions

Copy link

Updated by Casey Bodley 4 months ago

Yuval Lifshitz wrote in #note-4:

will replacing boto with boto3 in all of the bucket notifications tests fix the issue?

yep, just need to drop the boto dependency

Actions

Copy link

Updated by Hoai-Thu Vuong 3 months ago

solution: https://gist.github.com/thuvh/49dd85b912db24a32ec88371069552af

Actions

Copy link

Updated by Hoai-Thu Vuong 3 months ago

please update Pull request id to https://github.com/ceph/ceph/pull/66745

Actions

Copy link

Updated by J. Eric Ivancich 2 months ago

Status changed from New to In Progress
Pull request ID set to 66745

Actions

Copy link

Updated by Yuval Lifshitz about 1 month ago

Status changed from In Progress to Fix Under Review
Backport set to tentacle
Pull request ID changed from 66745 to 67387

Actions

Copy link

#10

Updated by Yuval Lifshitz about 1 month ago

Tags set to notifications

Actions

Copy link

#11

Updated by Joseph Mundackal about 1 month ago

Can this be backported to squid as well - so that ALL supported versions have this change?

Actions

Copy link

#12

Updated by Upkeep Bot 26 days ago

Status changed from Fix Under Review to Pending Backport
Merge Commit set to e851e5ab38b68d841f016dac938a4c824bd156be
Fixed In set to v20.3.0-5593-ge851e5ab38
Upkeep Timestamp set to 2026-02-25T08:53:48+00:00

Actions

Copy link

#13

Updated by Upkeep Bot 26 days ago

Copied to Backport #75154: tentacle: bucket notifications: ERROR: Failure: ModuleNotFoundError (No module named 'boto.vendored.six.moves') added

Actions

Copy link

#14