When using this source plugin with the destination as BigQuery, I am getting the following error: -
Error: failed to sync v2 source crowdstrike: rpc error: code = Internal desc = failed to write: failed to flush: primary keys are not supported by the BigQuery plugin (if you are trying to use it as a state backend, this is not currently supported)
2023-08-04T12:42:35Z ERR exiting with error error="failed to sync v2 source crowdstrike: rpc error: code = Internal desc = failed to write: failed to flush: primary keys are not supported by the BigQuery plugin (if you are trying to use it as a state backend, this is not currently supported)" module=cli
I see that this error is from this check in the BigQuery plugin for primary keys - https://github.com/cloudquery/cloudquery/blob/main/plugins/destination/bigquery/client/migrate.go#L27
Does this mean the tables for BigQuery should not have any primary keys in them? I tested this by creating a fork and removing the primary key transform from this line - https://github.com/justmiles/cq-source-crowdstrike/blob/main/resources/vulnerabilities.go#L20
But I am still running into the same error. Any help would be appreciated.
Thanks!
When using this source plugin with the destination as BigQuery, I am getting the following error: -
I see that this error is from this check in the BigQuery plugin for primary keys - https://github.com/cloudquery/cloudquery/blob/main/plugins/destination/bigquery/client/migrate.go#L27
Does this mean the tables for BigQuery should not have any primary keys in them? I tested this by creating a fork and removing the primary key transform from this line - https://github.com/justmiles/cq-source-crowdstrike/blob/main/resources/vulnerabilities.go#L20
But I am still running into the same error. Any help would be appreciated.
Thanks!