Description
Databricks has release as Public Preview the OIDC Federation authentication that allows to authenticate without need of rotating the service principal secret. The details can be found here: https://docs.databricks.com/aws/en/dev-tools/auth/oauth-federation-provider
Use case/motivation
Using this type of authentication is more secure because it eliminates the need to manage credentials and can be restricted to an AWS role, for example. It also makes the Airflow instance more resilient and reliable, preventing pipeline failures when a token expires—such as when a user forgets to rotate the secret or when an automated rotation process fails.
Related issues
No response
Are you willing to submit a PR?
Code of Conduct
Description
Databricks has release as Public Preview the OIDC Federation authentication that allows to authenticate without need of rotating the service principal secret. The details can be found here: https://docs.databricks.com/aws/en/dev-tools/auth/oauth-federation-provider
Use case/motivation
Using this type of authentication is more secure because it eliminates the need to manage credentials and can be restricted to an AWS role, for example. It also makes the Airflow instance more resilient and reliable, preventing pipeline failures when a token expires—such as when a user forgets to rotate the secret or when an automated rotation process fails.
Related issues
No response
Are you willing to submit a PR?
Code of Conduct