Object stuck in GC cycle, pt. 3 #3715
Description
Expected Behavior
Object deleted, object gone.
Current Behavior
Dec 04 12:00:53 metis1 neofs-node[1649231]: info log/log.go:12 local object storage operation {"shard_id": "PRYXSqmUXp4ZNZDLqXsgcR", "address": "7ZVSQHtioVRiDT2btN9xEmQhczXV9vryCEAHUawfD8Sc/6GXUGR7SrPsZF9k77qtmrfyVSDRUDK9FPPzw8DSrWbz7", "op": "metabase DELETE"}
Dec 04 12:01:03 metis1 neofs-node[1649231]: info log/log.go:12 local object storage operation {"shard_id": "PRYXSqmUXp4ZNZDLqXsgcR", "address": "7ZVSQHtioVRiDT2btN9xEmQhczXV9vryCEAHUawfD8Sc/6GXUGR7SrPsZF9k77qtmrfyVSDRUDK9FPPzw8DSrWbz7", "op": "metabase DELETE"}
Dec 04 12:01:13 metis1 neofs-node[1649231]: info log/log.go:12 local object storage operation {"shard_id": "PRYXSqmUXp4ZNZDLqXsgcR", "address": "7ZVSQHtioVRiDT2btN9xEmQhczXV9vryCEAHUawfD8Sc/6GXUGR7SrPsZF9k77qtmrfyVSDRUDK9FPPzw8DSrWbz7", "op": "metabase DELETE"}
Dec 04 12:01:24 metis1 neofs-node[1649231]: info log/log.go:12 local object storage operation {"shard_id": "PRYXSqmUXp4ZNZDLqXsgcR", "address": "7ZVSQHtioVRiDT2btN9xEmQhczXV9vryCEAHUawfD8Sc/6GXUGR7SrPsZF9k77qtmrfyVSDRUDK9FPPzw8DSrWbz7", "op": "metabase DELETE"}
Dec 04 12:01:34 metis1 neofs-node[1649231]: info log/log.go:12 local object storage operation {"shard_id": "PRYXSqmUXp4ZNZDLqXsgcR", "address": "7ZVSQHtioVRiDT2btN9xEmQhczXV9vryCEAHUawfD8Sc/6GXUGR7SrPsZF9k77qtmrfyVSDRUDK9FPPzw8DSrWbz7", "op": "metabase DELETE"}
Dec 04 12:01:44 metis1 neofs-node[1649231]: info log/log.go:12 local object storage operation {"shard_id": "PRYXSqmUXp4ZNZDLqXsgcR", "address": "7ZVSQHtioVRiDT2btN9xEmQhczXV9vryCEAHUawfD8Sc/6GXUGR7SrPsZF9k77qtmrfyVSDRUDK9FPPzw8DSrWbz7", "op": "metabase DELETE"}
Dec 04 12:01:54 metis1 neofs-node[1649231]: info log/log.go:12 local object storage operation {"shard_id": "PRYXSqmUXp4ZNZDLqXsgcR", "address": "7ZVSQHtioVRiDT2btN9xEmQhczXV9vryCEAHUawfD8Sc/6GXUGR7SrPsZF9k77qtmrfyVSDRUDK9FPPzw8DSrWbz7", "op": "metabase DELETE"}
Dec 04 12:02:05 metis1 neofs-node[1649231]: info log/log.go:12 local object storage operation {"shard_id": "PRYXSqmUXp4ZNZDLqXsgcR", "address": "7ZVSQHtioVRiDT2btN9xEmQhczXV9vryCEAHUawfD8Sc/6GXUGR7SrPsZF9k77qtmrfyVSDRUDK9FPPzw8DSrWbz7", "op": "metabase DELETE"}
Dec 04 12:02:15 metis1 neofs-node[1649231]: info log/log.go:12 local object storage operation {"shard_id": "PRYXSqmUXp4ZNZDLqXsgcR", "address": "7ZVSQHtioVRiDT2btN9xEmQhczXV9vryCEAHUawfD8Sc/6GXUGR7SrPsZF9k77qtmrfyVSDRUDK9FPPzw8DSrWbz7", "op": "metabase DELETE"}
Dec 04 12:02:25 metis1 neofs-node[1649231]: info log/log.go:12 local object storage operation {"shard_id": "PRYXSqmUXp4ZNZDLqXsgcR", "address": "7ZVSQHtioVRiDT2btN9xEmQhczXV9vryCEAHUawfD8Sc/6GXUGR7SrPsZF9k77qtmrfyVSDRUDK9FPPzw8DSrWbz7", "op": "metabase DELETE"}
Dec 04 12:02:35 metis1 neofs-node[1649231]: info log/log.go:12 local object storage operation {"shard_id": "PRYXSqmUXp4ZNZDLqXsgcR", "address": "7ZVSQHtioVRiDT2btN9xEmQhczXV9vryCEAHUawfD8Sc/6GXUGR7SrPsZF9k77qtmrfyVSDRUDK9FPPzw8DSrWbz7", "op": "metabase DELETE"}
Dec 04 12:02:46 metis1 neofs-node[1649231]: info log/log.go:12 local object storage operation {"shard_id": "PRYXSqmUXp4ZNZDLqXsgcR", "address": "7ZVSQHtioVRiDT2btN9xEmQhczXV9vryCEAHUawfD8Sc/6GXUGR7SrPsZF9k77qtmrfyVSDRUDK9FPPzw8DSrWbz7", "op": "metabase DELETE"}
Possible Solution
Fix something.
Steps to Reproduce (for bugs)
Not really known.
Context
Happens on mainnet. See #3629 and #3641 as well.
Regression
Not likely.
Your Environment
- Version used: 0.50.2
- Server setup and configuration: mainnet
- Operating System and version (
uname -a): Debian trixie