-
Notifications
You must be signed in to change notification settings - Fork 3.7k
Closed
Description
Steps to reproduce:
List the minimal actions needed to reproduce the behavior.
- Set vm.max_mmap_count 'too low'
- Create many (likely 1000's) of shards with TSI enabled
Expected behavior:
The database should gracefully fail with a complaint about vm.max_mmap_count being too low- this is now in Log when approaching linux kernel limits #23439- The database should be more aware of different errors that occur during opening of TSM files, and only move the file aside for an error that actually indicates corruption.
Actual behavior:
- Because we are out of mmap space, random memory allocations fail, crashing the application
- Because we are out of mmap space, opening TSM files fails in a way that causes the TSM files to be marked as corrupt and moved aside.
Environment info:
- System info: Any linux version
- InfluxDB version: 1.9.6
- Other relevant environment details: n/a
Logs:
The most concerning errors are: Cannot read corrupt tsm file, renaming, which moves the TSM files aside even though they are not actually corrupt.
Reactions are currently unavailable