Skip to content

wal: use existing logs sizes after restart#11098

Merged
sergepetrenko merged 1 commit intotarantool:masterfrom
LevKats:gh-9811-checkpoint-wal-threshold-after-restart
Mar 27, 2025
Merged

wal: use existing logs sizes after restart#11098
sergepetrenko merged 1 commit intotarantool:masterfrom
LevKats:gh-9811-checkpoint-wal-threshold-after-restart

Conversation

@LevKats
Copy link
Contributor

@LevKats LevKats commented Feb 5, 2025

During the checkpoint_wal_threshold exceedance checks tarantool used to ignore the sizes of files created prior to the server restart which resulted in cases when the server didn't create any checkpoints and generate a huge amount of logs which were replayed each server restart. Now the wal_dir is scanned for proper writer->checkpoint_wal_size calculation after the recovery process.

Fixes #9811
NO_DOC=bugfix

@LevKats LevKats requested a review from Serpentian February 5, 2025 14:58
@LevKats LevKats self-assigned this Feb 5, 2025
@LevKats LevKats requested a review from a team as a code owner February 5, 2025 14:58
@LevKats LevKats force-pushed the gh-9811-checkpoint-wal-threshold-after-restart branch from 505b9a6 to 18dd512 Compare February 5, 2025 15:06
@coveralls
Copy link

coveralls commented Feb 5, 2025

Coverage Status

coverage: 87.463% (+0.02%) from 87.447%
when pulling 7638032 on LevKats:gh-9811-checkpoint-wal-threshold-after-restart
into 08be759
on tarantool:master
.

@nshy nshy assigned nshy and unassigned LevKats Feb 6, 2025
@nshy nshy self-requested a review February 6, 2025 07:58
@nshy nshy assigned LevKats and unassigned nshy Feb 6, 2025
@LevKats LevKats force-pushed the gh-9811-checkpoint-wal-threshold-after-restart branch 2 times, most recently from dfb63b8 to c32eb00 Compare February 11, 2025 05:20
@LevKats LevKats requested a review from nshy February 11, 2025 05:50
@nshy nshy removed their assignment Feb 11, 2025
@LevKats LevKats force-pushed the gh-9811-checkpoint-wal-threshold-after-restart branch from c32eb00 to 805586b Compare February 17, 2025 05:27
@LevKats LevKats requested a review from nshy February 18, 2025 07:33
@nshy nshy removed their assignment Feb 18, 2025
@LevKats LevKats force-pushed the gh-9811-checkpoint-wal-threshold-after-restart branch from 805586b to 310f8ea Compare February 18, 2025 14:45
@LevKats LevKats requested a review from nshy February 18, 2025 19:19
@LevKats LevKats force-pushed the gh-9811-checkpoint-wal-threshold-after-restart branch from 310f8ea to a2f7daa Compare February 19, 2025 05:38
@LevKats LevKats force-pushed the gh-9811-checkpoint-wal-threshold-after-restart branch 2 times, most recently from 421c2ce to 3c43a71 Compare February 21, 2025 15:20
@LevKats LevKats requested a review from nshy February 21, 2025 16:41
@nshy nshy removed their assignment Feb 24, 2025
During the `checkpoint_wal_threshold` exceedance checks tarantool used
to ignore the sizes of files created prior to the server restart which
resulted in cases when the server didn't create any checkpoints and
generate a huge amount of logs which were replayed each server restart.
Now the `wal_dir` is scanned for proper `writer->checkpoint_wal_size`
calculation after the recovery process.

Fixes tarantool#9811
NO_DOC=bugfix
@LevKats LevKats force-pushed the gh-9811-checkpoint-wal-threshold-after-restart branch from 3c43a71 to 7638032 Compare March 7, 2025 17:41
@LevKats LevKats requested review from Serpentian and nshy March 7, 2025 17:56
Copy link
Contributor

@Serpentian Serpentian left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for addressing the comment) I have no more objections

@nshy nshy removed their assignment Mar 24, 2025
@LevKats LevKats added the full-ci Enables all tests for a pull request label Mar 26, 2025
@sergepetrenko sergepetrenko added backport/2.11 Automatically create a 2.11 backport PR backport/3.2 Automatically create a 3.2 backport PR backport/3.3 Automatically create a 3.3 backport PR and removed full-ci Enables all tests for a pull request labels Mar 27, 2025
@sergepetrenko sergepetrenko merged commit f1ccb2f into tarantool:master Mar 27, 2025
99 of 100 checks passed
@TarantoolBot
Copy link
Collaborator

Successfully created backport PR for release/2.11:

@TarantoolBot
Copy link
Collaborator

Successfully created backport PR for release/3.2:

@TarantoolBot
Copy link
Collaborator

Successfully created backport PR for release/3.3:

@TarantoolBot
Copy link
Collaborator

Backport summary

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport/2.11 Automatically create a 2.11 backport PR backport/3.2 Automatically create a 3.2 backport PR backport/3.3 Automatically create a 3.3 backport PR

Projects

None yet

Development

Successfully merging this pull request may close these issues.

checkpoint_wal_threshold doesn't account WALs created before a restart

7 participants