Bug(destinations-BigQuery): Batch write failures with Error 413 (Request Entity Too Large) #6070
Description
Could be related to https://discord.com/channels/872925471417962546/1057191097648033833/1057356930928082984 (waiting for further logs).
I was able to reproduce this error on our cq-playground account with the following configuration (I kept only the tables that generate the errors):
kind: source
spec:
name: aws
version: v9.0.1
destinations: [bigquery]
path: cloudquery/aws
tables: [aws_docdb_cluster_parameter_groups, aws_ec2_instance_types, aws_rds_engine_versions]
---
kind: destination
spec:
name: bigquery
path: cloudquery/bigquery
version: "v1.3.1"
write_mode: "append"
spec:
project_id: <project-id>
dataset_id: <datatest-id>Also, at some point it seems CloudQuery is hanging, the source plugin reports the sync finished, but the CLI is stuck on Syncing resources
Metadata
Metadata
Assignees
Labels
No labels