Skip to content

Conversation

@bbernays
Copy link
Collaborator

@bbernays bbernays commented Mar 13, 2024

Summary

When a destination is using append mode there should be no constraints on any column. Prior to this change in append mode we would only remove the Primary Key, but now we are also removing the unique constraints.

BEGIN_COMMIT_OVERRIDE
feat!: Remove unique constraints in append mode (#17129)

BREAKING-CHANGE: Remove unique constraints in append mode (#17129). This should not be breaking for most destinations (based on our tests, only DuckDB since it does not support removal of unique constraints), and will allow syncs to work when append mode is configured and the source schema has a unique constraint on a column.

END_COMMIT_OVERRIDE

@bbernays bbernays requested a review from yevgenypats as a code owner March 13, 2024 18:16
@bbernays bbernays added the no automerge Block automatic merging label Mar 13, 2024
@bbernays bbernays linked an issue Mar 13, 2024 that may be closed by this pull request
Copy link
Member

@erezrokah erezrokah left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's the reason this is a breaking change? How removing the unique constraint can break existing configurations/syncs?

@erezrokah erezrokah self-assigned this Jul 12, 2024
@erezrokah erezrokah force-pushed the remove-unique-in-append branch from 68c55ec to 2680cb0 Compare July 12, 2024 13:16
@erezrokah erezrokah requested review from a team and erezrokah and removed request for a team July 12, 2024 13:16
kodiakhq bot pushed a commit that referenced this pull request Jul 16, 2024
#### Summary

Preparation for #17129. This ensures the MySQL destination can handle the change in #17129
@erezrokah erezrokah added automerge Automatically merge once required checks pass and removed no automerge Block automatic merging labels Jul 17, 2024
@kodiakhq kodiakhq bot merged commit 4aeb94e into main Jul 17, 2024
@kodiakhq kodiakhq bot deleted the remove-unique-in-append branch July 17, 2024 12:25
kodiakhq bot pushed a commit that referenced this pull request Jul 18, 2024
🤖 I have created a release *beep* *boop*
---


## [6.0.0](cli-v5.25.1...cli-v6.0.0) (2024-07-18)


### ⚠ BREAKING CHANGES

* Change `skip_dependent_tables` default from `false` to `true` ([#18191](#18191)), to avoid new tables implicitly being synced when added to plugins. See more in the [reference docs](https://docs.cloudquery.io/docs/reference/source-spec#skip_dependent_tables)
* Remove unique constraints in append mode ([#17129](#17129)). This should not be breaking for most destinations (based on our tests, only DuckDB since it does not support removal of unique constraints), and will allow syncs to work when append mode is configured and the source schema has a unique constraint on a column.

### Features

* Change `skip_dependent_tables` default from `false` to `true` ([#18191](#18191)) ([3c86963](3c86963))
* Remove unique constraints in append mode ([#17129](#17129)) ([4aeb94e](4aeb94e))


### Bug Fixes

* **deps:** Update module github.com/cloudquery/cloudquery-api-go to v1.12.2 ([#18584](#18584)) ([d38ac1b](d38ac1b))
* **deps:** Update module github.com/cloudquery/plugin-pb-go to v1.20.5 ([#18590](#18590)) ([5bfa3ca](5bfa3ca))
* **deps:** Update module github.com/cloudquery/plugin-pb-go to v1.20.6 ([#18593](#18593)) ([64cbb9a](64cbb9a))

---
This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/cli automerge Automatically merge once required checks pass

Projects

None yet

Development

Successfully merging this pull request may close these issues.

feat(cli): Remove all unique constraints when in append mode

5 participants