We are hoping hierarchical tribe nodes to solve the following issues:
- Tribe start up is slow, especially for the "top level" tribe, which talk with all 30 clusters cross a number of data centers. It would take up to 10 minutes before a tribe node is fully up and ready to answer queries. The idea is each data center would form its own tribe in order to buffer some of the slowness.
- Query slowness. Queries are slow when talking to the "top level" tribe nodes but may be faster to each data center based tribe.
- When one or more downstream clusters have issues, it affects the whole tribe. With hierarchical tribe nodes, it will affect some of the tribes but not others.
We are hoping hierarchical tribe nodes to solve the following issues: