Description

With this issue we define the global retention for data stream lifecycle and we track the progress.

We would like to introduce a global retention configuration that would enable the project owners to introduce default and max retention for all data streams managed by data stream lifecycle.

The work will be completed in the following steps:

• Introduce the cluster state metadata that will store the global retention, this is effectively not adding any functionality since there is no way to add global retention. (Introduce the data stream global retention cluster state metadata #106170).
• Use the global retention in the data stream lifecycle, this is effectively not adding any functionality since there is no way to add global retention (Part 1: [DSL Global Retention] Calculate and use global retention in DSL #106268 & Part 2: [DSL Global Retention] Use data stream global retention metadata #106221).
• Introduce PUT, GET, DELETE REST APIs to enable the user with the correct privileges to manage the global retention. With this PR the feature becomes available and it will include docs and tests ([DSL] Introduce data stream global retention - Part 3 #105682).
• Add telemetry about the global retention

We propose the above sequence of steps to ensure that the functionality will not be exposed to the users until its complete.