Project

General

Profile

Actions

Bug #70747

closed

BlueFS race condition between truncate() and unlink()

Added by Adam Kupczyk 12 months ago. Updated 5 months ago.

Status:
Resolved
Priority:
High
Assignee:
Target version:
-
% Done:

0%

Source:
Backport:
squid, reef
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Tags (freeform):
backport_processed
Fixed In:
v20.0.0-1263-gf8263181f2
Released In:
v20.2.0~633
Upkeep Timestamp:
2025-11-01T01:28:47+00:00

Description

Artifacts:
1) BlueFS asserts, most likely on Allocator conflict
2) BlueFS log is corrupted (update of 3172478 after its removal)

 0x721000: txn(seq 521088157 len 0x1f crc 0x8cfdad53)
 0x721000:  op_dir_unlink  db/4279971.log
 0x721016:  op_file_remove 3172478
 0x722000: txn(seq 521088158 len 0xe9 crc 0xe52de4e6)
 0x722000:  op_file_update  file(ino 3172478 size 0xf78ea0 mtime 2025-03-31T00:31:24.814557+0000 allocated f80000 alloc_commit f80000 extents [1:0x55668fb4000~140000,1:0x2d6c23a8000~140000,1:0x514b1fa4000~140000,1:0x2de655a0000~140000,1:0x57b9a854000~140000,1:0x59892de0000~140000,1:0x5ab4f038000~140000,1:0x1d9ac564000~130000,1:0x3eb715fc000~130000,1:0x4575c5b4000~130000,1:0x51ecb9b0000~130000,1:0x2b2f680c000~130000,1:0x2dd68fec000~d0000])

3) BlueFS log fails to replay:
Mar 21 20:02:53 osmes22cep002 ceph-osd[448006]: bluefs _replay file with link count 0: file(ino 2762119 size 0xf71553 mtime 2025-03-20T14:44:36.965304+0000 allocated f80000 alloc_commit f80000 extents [1:0x370c3cb0000~180000,1:0x33f7e81c000~160000,1:0x2f4a7718000~140000,1:0x13031fe8000~f0000,1:0x532b1a3c000~f0000,1:0x571a1e1c000~f0000,1:0x4d808770000~f0000,1:0x5a6c7460000~f0000,1:0x595382c000~e0000,1:0xd473f00000~e0000,1:0xd520748000~e0000,1:0xf41e720000~e0000,1:0xfbdaba0000~e0000,1:0x11bf2230000~e0000,1:0x11f3fbe4000~e0000,1:0x12ce0e98000~90000])


Related issues 2 (0 open2 closed)

Copied to bluestore - Backport #70855: reef: BlueFS race condition between truncate() and unlink()ResolvedAdam KupczykActions
Copied to bluestore - Backport #70856: squid: BlueFS race condition between truncate() and unlink()ResolvedAdam KupczykActions
Actions #1

Updated by Adam Kupczyk 12 months ago

  • Pull request ID set to 62588
Actions #2

Updated by Adam Kupczyk 12 months ago

  • Status changed from New to Fix Under Review
  • Priority changed from Normal to High
Actions #3

Updated by Neha Ojha 12 months ago

  • Status changed from Fix Under Review to Pending Backport
Actions #4

Updated by Upkeep Bot 12 months ago

  • Copied to Backport #70855: reef: BlueFS race condition between truncate() and unlink() added
Actions #5

Updated by Upkeep Bot 12 months ago

  • Copied to Backport #70856: squid: BlueFS race condition between truncate() and unlink() added
Actions #6

Updated by Upkeep Bot 12 months ago

  • Tags (freeform) set to backport_processed
Actions #7

Updated by Igor Fedotov 11 months ago

  • Status changed from Pending Backport to Resolved
Actions #8

Updated by Upkeep Bot 9 months ago

  • Merge Commit set to f8263181f27c504f3b3d3ed827664422deb11cee
  • Fixed In set to v20.0.0-1263-gf8263181f27
  • Upkeep Timestamp set to 2025-07-09T18:11:49+00:00
Actions #9

Updated by Upkeep Bot 8 months ago

  • Fixed In changed from v20.0.0-1263-gf8263181f27 to v20.0.0-1263-gf8263181f2
  • Upkeep Timestamp changed from 2025-07-09T18:11:49+00:00 to 2025-07-14T18:12:25+00:00
Actions #10

Updated by Upkeep Bot 5 months ago

  • Released In set to v20.2.0~633
  • Upkeep Timestamp changed from 2025-07-14T18:12:25+00:00 to 2025-11-01T01:28:47+00:00
Actions

Also available in: Atom PDF