Skip to content

[Bug] when replay restore with reserve dynamic partition cause OBSERVER down #17319

@nextdreamblue

Description

@nextdreamblue

Search before asking

  • I had searched in the issues and found no similar issues.

Version

1.1
1.2
master

What's Wrong?

2023-03-02 11:07:33,412 WARN (UNKNOWN 10.0.41.23_9010_1677552982864(-1)|1) [Catalog.notifyNewFETypeTransfer():2317] notify new FE type transfer: UNKNOWN
2023-03-02 11:07:33,494 WARN (RepNode 10.0.41.23_9010_1677552982864(-1)|54) [Catalog.notifyNewFETypeTransfer():2317] notify new FE type transfer: OBSERVER
2023-03-02 11:07:50,050 ERROR (replayer|65) [EditLog.logEdit():872] Fatal Error : write stream Exception
java.lang.UnsupportedOperationException: Write operation is not allowed because the Database is configured as read-only.
        at com.sleepycat.je.Cursor.updatesProhibitedException(Cursor.java:5438) ~[je-18.3.13-doris-SNAPSHOT.jar:18.3.13-doris-SNAPSHOT]
        at com.sleepycat.je.Cursor.checkUpdatesAllowed(Cursor.java:5397) ~[je-18.3.13-doris-SNAPSHOT.jar:18.3.13-doris-SNAPSHOT]
        at com.sleepycat.je.Cursor.checkUpdatesAllowed(Cursor.java:5384) ~[je-18.3.13-doris-SNAPSHOT.jar:18.3.13-doris-SNAPSHOT]
        at com.sleepycat.je.Cursor.putInternal(Cursor.java:2439) ~[je-18.3.13-doris-SNAPSHOT.jar:18.3.13-doris-SNAPSHOT]
        at com.sleepycat.je.Cursor.putInternal(Cursor.java:841) ~[je-18.3.13-doris-SNAPSHOT.jar:18.3.13-doris-SNAPSHOT]
        at com.sleepycat.je.Database.put(Database.java:1635) ~[je-18.3.13-doris-SNAPSHOT.jar:18.3.13-doris-SNAPSHOT]
        at com.sleepycat.je.Database.put(Database.java:1688) ~[je-18.3.13-doris-SNAPSHOT.jar:18.3.13-doris-SNAPSHOT]
        at org.apache.doris.journal.bdbje.BDBJEJournal.write(BDBJEJournal.java:145) ~[doris-fe.jar:1.0-SNAPSHOT]
        at org.apache.doris.persist.EditLog.logEdit(EditLog.java:869) ~[doris-fe.jar:1.0-SNAPSHOT]
        at org.apache.doris.persist.EditLog.logDropPartition(EditLog.java:956) ~[doris-fe.jar:1.0-SNAPSHOT]
        at org.apache.doris.catalog.Catalog.dropPartition(Catalog.java:3487) ~[doris-fe.jar:1.0-SNAPSHOT]
        at org.apache.doris.clone.DynamicPartitionScheduler.executeDynamicPartition(DynamicPartitionScheduler.java:419) ~[doris-fe.jar:1.0-SNAPSHOT]
        at org.apache.doris.clone.DynamicPartitionScheduler.executeDynamicPartitionFirstTime(DynamicPartitionScheduler.java:102) ~[doris-fe.jar:1.0-SNAPSHOT]
        at org.apache.doris.common.util.DynamicPartitionUtil.registerOrRemoveDynamicPartitionTable(DynamicPartitionUtil.java:424) ~[doris-fe.jar:1.0-SNAPSHOT]
        at org.apache.doris.backup.RestoreJob.setTableStateToNormal(RestoreJob.java:1734) ~[doris-fe.jar:1.0-SNAPSHOT]
        at org.apache.doris.backup.RestoreJob.allTabletCommitted(RestoreJob.java:1455) ~[doris-fe.jar:1.0-SNAPSHOT]
        at org.apache.doris.backup.RestoreJob.replayWaitingAllTabletsCommitted(RestoreJob.java:1534) ~[doris-fe.jar:1.0-SNAPSHOT]
        at org.apache.doris.backup.RestoreJob.replayRun(RestoreJob.java:291) ~[doris-fe.jar:1.0-SNAPSHOT]
        at org.apache.doris.backup.BackupHandler.replayAddJob(BackupHandler.java:643) ~[doris-fe.jar:1.0-SNAPSHOT]
        at org.apache.doris.persist.EditLog.loadJournal(EditLog.java:273) ~[doris-fe.jar:1.0-SNAPSHOT]
        at org.apache.doris.catalog.Catalog.replayJournal(Catalog.java:2458) ~[doris-fe.jar:1.0-SNAPSHOT]
        at org.apache.doris.catalog.Catalog$3.runOneCycle(Catalog.java:2242) ~[doris-fe.jar:1.0-SNAPSHOT]
        at org.apache.doris.common.util.Daemon.run(Daemon.java:116) ~[doris-fe.jar:1.0-SNAPSHOT]

OBSERVER崩溃和启动失败

What You Expected?

OBSERVER 节点可以正确启动

How to Reproduce?

No response

Anything Else?

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions