Project

General

Profile

Actions
Copy link

Bug #68567

closed

cephfs/qa : Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirroring.TestMirroring)

Added by Kumar Hemanth over 1 year ago. Updated 8 months ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Jos Collin
Category:
Testing
Target version:
Ceph - v20.0.0
% Done:

0%

Source:
Q/A
Backport:
reef,squid,tentacle
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
cephfs-mirror
Labels (FS):
qa, qa-failure
Pull request ID:
62250
Tags (freeform):
backport_processed
Merge Commit:
53e32489fb72b7e12c93b7c413dee198cc1fbae5
Fixed In:
v20.3.0-302-g53e32489fb
Released In:
Upkeep Timestamp:
2025-07-14T21:09:24+00:00

Description

--- Logs - https://qa-proxy.ceph.com/teuthology/hyelloji-2024-10-15_06:08:53-fs-wip-hemanth-testing-2024-10-14-1559-testing-default-smithi/7947606/teuthology.log

2024-10-15T07:43:25.749 INFO:tasks.cephfs_test_runner:======================================================================
2024-10-15T07:43:25.749 INFO:tasks.cephfs_test_runner:FAIL: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirroring.TestMirroring)
2024-10-15T07:43:25.749 INFO:tasks.cephfs_test_runner:Test incremental snapshot synchronization (based on mtime differences).
2024-10-15T07:43:25.749 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2024-10-15T07:43:25.749 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2024-10-15T07:43:25.749 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_e07487c6fc88daf5bf2df835d473f72d50e621d4/qa/tasks/cephfs/test_mirroring.py", line 1199, in test_cephfs_mirror_incremental_sync
2024-10-15T07:43:25.749 INFO:tasks.cephfs_test_runner:    self.verify_snapshot(repo_path, 'snap_c')
2024-10-15T07:43:25.749 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_e07487c6fc88daf5bf2df835d473f72d50e621d4/qa/tasks/cephfs/test_mirroring.py", line 256, in verify_snapshot
2024-10-15T07:43:25.749 INFO:tasks.cephfs_test_runner:    self.assertTrue(source_res == dest_res)
2024-10-15T07:43:25.750 INFO:tasks.cephfs_test_runner:AssertionError: False is not true
2024-10-15T07:43:25.750 INFO:tasks.cephfs_test_runner:
2024-10-15T07:43:25.750 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2024-10-15T07:43:25.750 INFO:tasks.cephfs_test_runner:Ran 10 tests in 3343.808s
2024-10-15T07:43:25.750 INFO:tasks.cephfs_test_runner:
2024-10-15T07:43:25.750 INFO:tasks.cephfs_test_runner:FAILED (failures=1)
2024-10-15T07:43:25.750 INFO:tasks.cephfs_test_runner:
2024-10-15T07:43:25.750 INFO:tasks.cephfs_test_runner:======================================================================
2024-10-15T07:43:25.750 INFO:tasks.cephfs_test_runner:FAIL: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirroring.TestMirroring)
2024-10-15T07:43:25.750 INFO:tasks.cephfs_test_runner:Test incremental snapshot synchronization (based on mtime differences).
2024-10-15T07:43:25.751 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2024-10-15T07:43:25.751 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2024-10-15T07:43:25.751 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_e07487c6fc88daf5bf2df835d473f72d50e621d4/qa/tasks/cephfs/test_mirroring.py", line 1199, in test_cephfs_mirror_incremental_sync
2024-10-15T07:43:25.751 INFO:tasks.cephfs_test_runner:    self.verify_snapshot(repo_path, 'snap_c')
2024-10-15T07:43:25.751 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_e07487c6fc88daf5bf2df835d473f72d50e621d4/qa/tasks/cephfs/test_mirroring.py", line 256, in verify_snapshot
2024-10-15T07:43:25.751 INFO:tasks.cephfs_test_runner:    self.assertTrue(source_res == dest_res)
2024-10-15T07:43:25.751 INFO:tasks.cephfs_test_runner:AssertionError: False is not true
2024-10-15T07:43:25.751 INFO:tasks.cephfs_test_runner:
2024-10-15T07:43:25.751 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_e2eb3a97c43341ca720d42f59fa1648ddab2267a/teuthology/run_tasks.py", line 112, in run_tasks
    manager.__enter__()
  File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
    return next(self.gen)
  File "/home/teuthworker/src/github.com_ceph_ceph-c_e07487c6fc88daf5bf2df835d473f72d50e621d4/qa/tasks/cephfs_test_runner.py", line 211, in task
    raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests)))
RuntimeError: Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirroring.TestMirroring)
2024-10-15T07:43:25.949 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=efb264b0e5c54060b3484578b5152be2
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_e2eb3a97c43341ca720d42f59fa1648ddab2267a/teuthology/run_tasks.py", line 112, in run_tasks
    manager.__enter__()
  File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__
    return next(self.gen)
  File "/home/teuthworker/src/github.com_ceph_ceph-c_e07487c6fc88daf5bf2df835d473f72d50e621d4/qa/tasks/cephfs_test_runner.py", line 211, in task
    raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests)))
RuntimeError: Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirroring.TestMirroring)
2024-10-15T07:43:25.950 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner

Related issues 5 (1 open — 4 closed)

Related to CephFS - Bug #69671: Test failure: test_cephfs_mirror_sync_with_purged_snapshot (tasks.cephfs.test_mirroring.TestMirroring)ResolvedJos Collin

Actions
Related to CephFS - Bug #74984: qa: Test failure: test_cephfs_mirror_incremental_sync/test_cephfs_mirror_sync_with_purged_snapshot (snapdiff bug)TriagedVenky Shankar

Actions
Copied to CephFS - Backport #71299: reef: cephfs/qa : Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirroring.TestMirroring)RejectedJos CollinActions
Copied to CephFS - Backport #71300: tentacle: cephfs/qa : Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirroring.TestMirroring)ResolvedVenky ShankarActions
Copied to CephFS - Backport #71301: squid: cephfs/qa : Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirroring.TestMirroring)ResolvedVenky ShankarActions
Actions
Copy link
 #1

Updated by Venky Shankar over 1 year ago

  • Description updated (diff)
  • Assignee set to Jos Collin
  • Target version set to v20.0.0
  • Component(FS) cephfs-mirror added
  • Labels (FS) qa, qa-failure added
Actions
Copy link
 #2

Updated by Jos Collin over 1 year ago

  • Status changed from New to In Progress
Actions
Copy link
 #3

Updated by Jos Collin over 1 year ago

  • Pull request ID set to 61068
Actions
Copy link
 #4

Updated by Jos Collin over 1 year ago

  • Backport set to quincy,reef,squid
Actions
Copy link
 #5

Updated by Jos Collin over 1 year ago

  • Status changed from In Progress to Fix Under Review
Actions
Copy link
 #6

Updated by Venky Shankar about 1 year ago

  • Priority changed from Normal to Urgent
Actions
Copy link
 #7

Updated by Jos Collin about 1 year ago

  • Status changed from Fix Under Review to New
  • Pull request ID deleted (61068)
Actions
Copy link
 #8

Updated by Jos Collin about 1 year ago ยท Edited

  • Status changed from New to In Progress

As per the discussion here: https://github.com/ceph/ceph/pull/61068#discussion_r1886642766, this issue is expected to be resolved by https://github.com/ceph/ceph/pull/61245, as the do_synchronize code, which made this issue, is changed/replaced in https://github.com/ceph/ceph/pull/61245.

Actions
Copy link
 #9

Updated by Jos Collin about 1 year ago

  • Pull request ID set to 61539
Actions
Copy link
 #10

Updated by Jos Collin about 1 year ago

  • Status changed from In Progress to Fix Under Review
Actions
Copy link
 #11

Updated by Konstantin Shalygin about 1 year ago

  • Backport changed from quincy,reef,squid to reef,squid
Actions
Copy link
 #12

Updated by Jos Collin 11 months ago

  • Pull request ID changed from 61539 to 62250
Actions
Copy link
 #13

Updated by Venky Shankar 11 months ago

  • Related to Bug #69671: Test failure: test_cephfs_mirror_sync_with_purged_snapshot (tasks.cephfs.test_mirroring.TestMirroring) added
Actions
Copy link
 #15

Updated by Jos Collin 10 months ago

  • Status changed from Fix Under Review to Pending Backport
  • Backport changed from reef,squid to reef,squid,tentacle
Actions
Copy link
 #16

Updated by Upkeep Bot 10 months ago

  • Copied to Backport #71299: reef: cephfs/qa : Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirroring.TestMirroring) added
Actions
Copy link
 #17

Updated by Upkeep Bot 10 months ago

  • Copied to Backport #71300: tentacle: cephfs/qa : Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirroring.TestMirroring) added
Actions
Copy link
 #18

Updated by Upkeep Bot 10 months ago

  • Copied to Backport #71301: squid: cephfs/qa : Test failure: test_cephfs_mirror_incremental_sync (tasks.cephfs.test_mirroring.TestMirroring) added
Actions
Copy link
 #19

Updated by Upkeep Bot 10 months ago

  • Tags (freeform) set to backport_processed
Actions
Copy link
 #20

Updated by Upkeep Bot 8 months ago

  • Merge Commit set to 53e32489fb72b7e12c93b7c413dee198cc1fbae5
  • Fixed In set to v20.3.0-302-g53e32489fb7
  • Upkeep Timestamp set to 2025-07-08T18:34:41+00:00
Actions
Copy link
 #21

Updated by Upkeep Bot 8 months ago

  • Fixed In changed from v20.3.0-302-g53e32489fb7 to v20.3.0-302-g53e32489fb72
  • Upkeep Timestamp changed from 2025-07-08T18:34:41+00:00 to 2025-07-14T15:44:44+00:00
Actions
Copy link
 #22

Updated by Upkeep Bot 8 months ago

  • Fixed In changed from v20.3.0-302-g53e32489fb72 to v20.3.0-302-g53e32489fb
  • Upkeep Timestamp changed from 2025-07-14T15:44:44+00:00 to 2025-07-14T21:09:24+00:00
Actions
Copy link
 #23

Updated by Jos Collin 8 months ago

  • Status changed from Pending Backport to Resolved
Actions
Copy link
 #24

Updated by Kotresh Hiremath Ravishankar about 1 month ago

  • Related to Bug #74984: qa: Test failure: test_cephfs_mirror_incremental_sync/test_cephfs_mirror_sync_with_purged_snapshot (snapdiff bug) added
Actions
Copy link

Also available in: Atom PDF