Action items

• Check for primary keys violations in destinations
  • Check in a single batch (Primary key violation check plugin-sdk#627)
• Fix primary key violations found:
  • AWS (AWS primary key violations #7181)
  • Azure (Azure primary key violations #7183)

Issue description

Some resources have duplicate primary keys.

User impact

The issue was discovered during syncs to Microsoft SQL Server destination. Other destination plugins don't highlight the issue at the moment. Instead, the data written ends up being a single record instead of multiple ones (overwrite and overwrite-delete-stale modes).

Observed issues

• Several AWS resources have duplicates #6837
• MSSQL Destination PK violations & unicode characters #6984

Related

• Add primary key violation check to test destination #7175