Search before asking

• I had searched in the issues and found no similar feature requirement.

Description

The role of zookeeper

1. Store service-related information of master and worker, host IP, port, cpu load, etc.
2. Master and worker health check
3. master failover
4. Distributed lock

Problems caused by zookeeper

1. Increase the complexity of system deployment and operation and maintenance. While deploying the DS cluster, a zookeeper cluster should also be deployed. It is also necessary to monitor the operation and maintenance of the DS cluster and the zookeeper cluster at the same time
2. Increase the chance of error. The network between the DS cluster and the zookeeper cluster is fluttering, and errors may occur.

Advantages of remove zookeeper

1. The deployment architecture is simpler
2. Lower maintenance cost
3. No more DS errors due to zookeeper cluster errors

Blue print of remove zookeeper

1. Refer to Kafka's KRaft solution to achieve leader election and data synchronization between masters
2. The worker server registers with the leader master and maintains a heartbeat with the master
3. Api server obtains cluster information from leader master

Use case

No response

Related issues

#6680

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct