cherry-pick #1934 to release-4.0
You can switch your code base to this Pull Request by using git-extras:

# In tics repo:
git pr https://github.com/pingcap/tics/pull/2002

After apply modifications, you can push your change to this PR via:

git push git@github.com:ti-srebot/tics.git pr/2002:release-4.0-f9d94d5d56e2

What problem does this PR solve?

Issue Number: close #1932

Problem Summary: as the issue descript

What is changed and how it works?

If there is any incomplete write batch get ignored, truncate the meta file to throw away broken data

Related changes

• PR to update pingcap/docs/pingcap/docs-cn:
• Need to cherry-pick to the release branch:

Check List

Tests

• Unit test
  • If comment out meta_on_disk.setSize(meta_file_pos); inside PageFile::setFileAppendPos, we can see error while running PageStorage_test.IgnoreIncompleteWriteBatch1

    Code: 49. DB::Exception: PageFile binary version not match {MergingReader of PageFile_1_0, type: Formal, sequence no: 0, meta offset: 217, data offset: 1024} [unknown_version=0] [file=/data1/tics/cmake-build-debug/tmp/data/t1/log/page_1_0/meta]
    

  • Or comment out ::ftruncate(file->getFd(), offset); inside writeFile, we can see error while running PageStorage_test.IgnoreIncompleteWriteBatch2

    Code: 49. DB::Exception: PageFile binary version not match {MergingReader of PageFile_1_0, type: Formal, sequence no: 0, meta offset: 217, data offset: 1024} [unknown_version=0] [file=/data1/tics/cmake-build-debug/tmp/data/t1/log/page_1_0/meta]
    

Side effects

Release note

• Fix the bug that incomplete data may make TiFlash fail to restart