Ceph » rgw

I have seen this same test fail multiple times within the past week, always in nautilus PRs. Here is the log excerpt from https://github.com/ceph/ceph/pull/27868

133/168 Test #160: unittest_rgw_amqp .......................***Failed    7.18 sec
Running main() from gmock_main.cc
[==========] Running 17 tests from 3 test cases.
[----------] Global test environment set-up.
[----------] 10 tests from AMQP_Connection
[ RUN      ] AMQP_Connection.ConnectionOK
[       OK ] AMQP_Connection.ConnectionOK (2 ms)
[ RUN      ] AMQP_Connection.ConnectionReuse
[       OK ] AMQP_Connection.ConnectionReuse (0 ms)
[ RUN      ] AMQP_Connection.NameResolutionFail
[       OK ] AMQP_Connection.NameResolutionFail (43 ms)
[ RUN      ] AMQP_Connection.InvalidPort
[       OK ] AMQP_Connection.InvalidPort (2 ms)
[ RUN      ] AMQP_Connection.InvalidHost
[       OK ] AMQP_Connection.InvalidHost (3 ms)
[ RUN      ] AMQP_Connection.InvalidVhost
[       OK ] AMQP_Connection.InvalidVhost (2 ms)
[ RUN      ] AMQP_Connection.UserPassword
[       OK ] AMQP_Connection.UserPassword (56 ms)
[ RUN      ] AMQP_Connection.URLParseError
[       OK ] AMQP_Connection.URLParseError (0 ms)
[ RUN      ] AMQP_Connection.ExchangeMismatch
[       OK ] AMQP_Connection.ExchangeMismatch (0 ms)
[ RUN      ] AMQP_Connection.MaxConnections
[       OK ] AMQP_Connection.MaxConnections (1803 ms)
[----------] 10 tests from AMQP_Connection (1911 ms total)

[----------] 4 tests from AMQP_PublishAndWait
[ RUN      ] AMQP_PublishAndWait.ReceiveAck
/home/jenkins-build/build/workspace/ceph-pull-requests/src/test/rgw/test_rgw_amqp.cc:180: Failure
Value of: callback_invoked
  Actual: false
Expected: true
[  FAILED  ] AMQP_PublishAndWait.ReceiveAck (377 ms)
[ RUN      ] AMQP_PublishAndWait.ReceiveNack
/home/jenkins-build/build/workspace/ceph-pull-requests/src/test/rgw/test_rgw_amqp.cc:161: Failure
      Expected: 0
To be equal to: rc
      Which is: -4097
[  FAILED  ] AMQP_PublishAndWait.ReceiveNack (302 ms)
[ RUN      ] AMQP_PublishAndWait.FailWrite
[       OK ] AMQP_PublishAndWait.FailWrite (300 ms)
[ RUN      ] AMQP_PublishAndWait.ClosedConnection
[       OK ] AMQP_PublishAndWait.ClosedConnection (602 ms)
[----------] 4 tests from AMQP_PublishAndWait (1583 ms total)

[----------] 3 tests from AMQP_ConnectionRetry
[ RUN      ] AMQP_ConnectionRetry.InvalidHost
[       OK ] AMQP_ConnectionRetry.InvalidHost (302 ms)
[ RUN      ] AMQP_ConnectionRetry.InvalidPort
[       OK ] AMQP_ConnectionRetry.InvalidPort (303 ms)
[ RUN      ] AMQP_ConnectionRetry.FailWrite
[       OK ] AMQP_ConnectionRetry.FailWrite (1202 ms)
[----------] 3 tests from AMQP_ConnectionRetry (1809 ms total)

[----------] Global test environment tear-down
[==========] 17 tests from 3 test cases ran. (5303 ms total)
[  PASSED  ] 15 tests.
[  FAILED  ] 2 tests, listed below:
[  FAILED  ] AMQP_PublishAndWait.ReceiveAck
[  FAILED  ] AMQP_PublishAndWait.ReceiveNack

 2 FAILED TESTS

Since it tends to succeed on re-run, the assumption is that the failure has something to do with the test environment. This one is:

+ source /etc/os-release
++ NAME='CentOS Linux'
++ VERSION='7 (AltArch)'
++ ID=centos
++ ID_LIKE='rhel fedora'
++ VERSION_ID=7
++ PRETTY_NAME='CentOS Linux 7 (AltArch)'
++ ANSI_COLOR='0;31'
++ CPE_NAME=cpe:/o:centos:centos:7:server
++ HOME_URL=https://www.centos.org/
++ BUG_REPORT_URL=https://bugs.centos.org/
++ SIG_FAMILY='AltArch aarch64'
++ CENTOS_MANTISBT_PROJECT=CentOS-7
++ CENTOS_MANTISBT_PROJECT_VERSION=7
++ REDHAT_SUPPORT_PRODUCT=centos
++ REDHAT_SUPPORT_PRODUCT_VERSION=7