bug: CloudQuery refusing to sync with AWS because of the Postgres version, however PG is the latest edition #12139
Description
Is there an existing issue for this?
- I have searched the existing issues
Current Behavior
I tried syncing, however CQ told me the CQ's version is out of date and that the AWS plugin requires the latest version of CQ. (Error: please upgrade CLI to latest version to sync source aws)
Therefore I cloned the CQ's repo, built from source, retried without success.
However, then it started complaining how my Postgres version is not acceptable. Which is strange as my PG is 15. (Error: destination postgresql does not support CloudQuery protocol version 3, required by aws. Please upgrade to newer version of postgresql)
Expected Behavior
Sync goes smoothly as it went for GCP.
CloudQuery (redacted) config
Source:
kind: source
spec:
name: aws
path: cloudquery/aws
version: "v20.0.0"
tables: ["aws_s3_buckets"]
destinations: ["postgresql"]
concurrency: 10000
spec:
regions:
- us-east-1
accounts:
- id: "asset-monitor"
local_profile: "asset-monitor"
aws_debug: false`Destination:
kind: destination
spec:
name: "postgresql"
path: "cloudquery/postgresql"
version: "v4.2.2"
write_mode: "overwrite-delete-stale"
spec:
connection_string: "postgresql://postgres:__REDACTED__@localhost:5432/postgres?sslmode=disable"`Steps To Reproduce
No response
CloudQuery (redacted) logs
2023-07-12T14:58:12Z INF Loading spec(s) args=["./cloudquery-config/"] module=cli
2023-07-12T14:58:13Z INF Plugin server listening address=/tmp/cq-rxsOQpmuYAVMHsui.sock module=cli
2023-07-12T14:58:13Z INF Destination plugin server listening address=/tmp/cq-EIjNjaSmyosuPcHX.sock module=cli
2023-07-12T14:58:14Z INF started call grpc.code=OK grpc.component=server grpc.method=GetVersions grpc.method_type=unary grpc.service=cloudquery.discovery.v1.Discovery grpc.start_time=2023-07-12T16:58:14+02:00 grpc.time_ms=0.015 module=cli peer.address=@ protocol=grpc
2023-07-12T14:58:14Z INF finished call grpc.code=OK grpc.component=server grpc.method=GetVersions grpc.method_type=unary grpc.service=cloudquery.discovery.v1.Discovery grpc.start_time=2023-07-12T16:58:14+02:00 grpc.time_ms=0.031 module=cli peer.address=@ protocol=grpc
2023-07-12T14:58:14Z WRN the top-level `concurrency` option is deprecated. Please use the plugin-level concurrency option instead field=concurrency module=cli source=aws
2023-07-12T14:58:14Z INF started call grpc.code=OK grpc.component=server grpc.method=GetVersions grpc.method_type=unary grpc.service=cloudquery.discovery.v0.Discovery grpc.start_time=2023-07-12T16:58:14+02:00 grpc.time_ms=0.014 module=cli peer.address=@ protocol=grpc
2023-07-12T14:58:14Z INF finished call grpc.code=OK grpc.component=server grpc.method=GetVersions grpc.method_type=unary grpc.service=cloudquery.discovery.v0.Discovery grpc.start_time=2023-07-12T16:58:14+02:00 grpc.time_ms=0.029 module=cli peer.address=@ protocol=grpc
2023-07-12T14:58:14Z INF waiting for source plugin to terminate module=cli
2023-07-12T14:58:14Z INF Got stop signal. Destination plugin server shutting down address=/tmp/cq-EIjNjaSmyosuPcHX.sock module=cli signal=interrupt
2023-07-12T14:58:14Z INF waiting for source plugin to terminate module=cli
2023-07-12T14:58:14Z INF Got stop signal. Plugin server shutting down address=/tmp/cq-rxsOQpmuYAVMHsui.sock module=cli signal=interrupt
2023-07-12T14:58:14Z ERR exiting with error error="destination postgresql does not support CloudQuery protocol version 3, required by aws. Please upgrade to newer version of postgresql" module=cli
CloudQuery version
Latest (cloned the repo & built from source)
Additional Context
No response
Pull request (optional)
- I can submit a pull request
Metadata
Metadata
Assignees
Labels
No labels