Skip to content

adding new spanner-migrations runner module under community folder.#5597

Merged
arpit974 merged 3 commits into
GoogleCloudPlatform:developfrom
arpit974:community/modules/scripts/spanner-migrations-runner-module
May 15, 2026
Merged

adding new spanner-migrations runner module under community folder.#5597
arpit974 merged 3 commits into
GoogleCloudPlatform:developfrom
arpit974:community/modules/scripts/spanner-migrations-runner-module

Conversation

@arpit974

@arpit974 arpit974 commented May 4, 2026

Copy link
Copy Markdown
Contributor

Adding a module for executing sequential Spanner schema migrations using the gcloud CLI.

This module provides a declarative mechanism for managing Spanner database schema evolution through versioned SQL migration files. It is specifically designed to handle advanced Spanner features, such as Protobuf-based columns, which are not currently supported by the native Google Cloud Terraform provider.

The module automates the application of schema changes by iterating through a specified directory and applying all .up.sql files in alphabetical order. To ensure stability during infrastructure updates, it utilizes a content-based hash trigger to avoid redundant execution of migrations that have already been applied.

Key Changes:

Sequential Execution: Implements a shell-based loop via local-exec to ensure migrations are applied in strict alphabetical/versioned order.
Protobuf Support: Includes an optional path for a compiled proto descriptors file (.pb), enabling the application of DDLs that reference custom Protobuf types.
Efficient Idempotency: Uses a SHA256 hash of all migration files as a Terraform trigger. The module only executes when new migration files are added or existing ones are modified.
Encapsulated Scripts: Hides the complexity of gcloud spanner databases ddl update commands behind a standard Cluster Toolkit module interface.

Submission Checklist

NOTE: Community submissions can take up to 2 weeks to be reviewed.

Please take the following actions before submitting this pull request.

  • Fork your PR branch from the Toolkit "develop" branch (not main)
  • Test all changes with pre-commit in a local branch #
  • Confirm that "make tests" passes all tests
  • Add or modify unit tests to cover code changes
  • Ensure that unit test coverage remains above 80%
  • Update all applicable documentation
  • Follow Cluster Toolkit Contribution guidelines #

@arpit974 arpit974 added the release-new-modules Added to release notes under the "New Modules" heading. label May 4, 2026
@gemini-code-assist

Copy link
Copy Markdown
Contributor

Summary of Changes

Hello, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request introduces a new Terraform module designed to streamline the process of applying DDL migrations to Google Cloud Spanner databases. By leveraging gcloud commands within a null_resource, it provides an automated, infrastructure-as-code approach to managing Spanner schema changes, enhancing consistency and reducing manual effort for database evolution.

Highlights

  • New Spanner Migrations Runner Module: A new Terraform module has been introduced under the community folder to automate Spanner DDL migrations.
  • Automated DDL Application: The module uses gcloud to apply .up.sql files found in a specified directory, ensuring migrations are applied in alphabetical order.
  • Support for Proto Descriptors: The module includes an optional input for a compiled proto descriptors file (.pb), allowing for custom types in Spanner DDL migrations.
Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for GitHub and other Google products, sign up here.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution.

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces a new community module, spanner-migrations-runner, which applies Spanner DDL migrations using the gcloud CLI. The review feedback identifies a bug in the fileset logic that would cause failures when no sub-directory is provided and highlights a violation of the repository style guide regarding the registration of new modules in the global index. Additionally, it is recommended to use a minimum version constraint for Terraform rather than pinning to a specific patch version to ensure better compatibility for a reusable module.

Comment thread community/modules/scripts/spanner-migrations-runner/main.tf Outdated
Comment thread community/modules/scripts/spanner-migrations-runner/README.md
Comment thread community/modules/scripts/spanner-migrations-runner/versions.tf
@arpit974 arpit974 marked this pull request as ready for review May 4, 2026 16:18
@arpit974 arpit974 requested a review from a team as a code owner May 4, 2026 16:18

@kvenkatachala333 kvenkatachala333 left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Just a minor nit: please handle the gemini suggestion of ensuring new module is added to the index in the root modules/README.md file as required by the repository style guide

Comment thread community/modules/scripts/spanner-migrations-runner/main.tf
Comment thread community/modules/scripts/spanner-migrations-runner/main.tf
@arpit974 arpit974 merged commit b09740d into GoogleCloudPlatform:develop May 15, 2026
17 of 83 checks passed
Thibaut-Nurit pushed a commit to Thibaut-Nurit/cluster-toolkit that referenced this pull request May 20, 2026
…oogleCloudPlatform#5597)

adding new module spanner-migrations runner under community folder.
kadupoornima pushed a commit to kadupoornima/cluster-toolkit that referenced this pull request May 25, 2026
…oogleCloudPlatform#5597)

adding new module spanner-migrations runner under community folder.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

release-new-modules Added to release notes under the "New Modules" heading.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants