Skip to content

fix(bigquery-spec)!: Move batch_size from the plugin spec to the top level spec#6092

Merged
erezrokah merged 8 commits intomainfrom
fix/bigquery_batch_size
Dec 29, 2022
Merged

fix(bigquery-spec)!: Move batch_size from the plugin spec to the top level spec#6092
erezrokah merged 8 commits intomainfrom
fix/bigquery_batch_size

Conversation

@erezrokah
Copy link
Copy Markdown
Member

@erezrokah erezrokah commented Dec 28, 2022

Summary

Same as #6090 not from a fork so tests can pass.

Fixes #6070

With the SDK level batching the configuration that "takes" is now at the top spec level. Setting batch_size at the plugin level has no impact

@erezrokah erezrokah requested review from a team and amanenk and removed request for a team December 28, 2022 13:20
@erezrokah erezrokah force-pushed the fix/bigquery_batch_size branch from 18b29a9 to 4774a95 Compare December 28, 2022 15:58
@erezrokah erezrokah added the automerge Automatically merge once required checks pass label Dec 29, 2022
@erezrokah erezrokah merged commit a1d706e into main Dec 29, 2022
@erezrokah erezrokah deleted the fix/bigquery_batch_size branch December 29, 2022 09:37
erezrokah added a commit that referenced this pull request Dec 29, 2022
…p level spec (#6091)

<!-- 🎉 Thank you for making CloudQuery awesome by submitting a PR 🎉 -->

#### Summary

**Not the same** as #6092.
The Postgres plugin doesn't use managed batching so its configuration
still works. However since it's available via the top level spec we
should use that one for consistency in our docs.

<!--
Use the following steps to ensure your PR is ready to be reviewed

- [ ] Read the [contribution guidelines](../blob/main/CONTRIBUTING.md)
🧑‍🎓
- [ ] Test locally on your own infrastructure
- [ ] Run `go fmt` to format your code 🖊
- [ ] Lint your changes via `golangci-lint run` 🚨 (install golangci-lint
[here](https://golangci-lint.run/usage/install/#local-installation))
- [ ] Update or add tests 🧪
- [ ] Ensure the status checks below are successful ✅
--->
erezrokah pushed a commit that referenced this pull request Dec 29, 2022
🤖 I have created a release *beep* *boop*
---


##
[2.0.0](plugins-destination-bigquery-v1.3.2...plugins-destination-bigquery-v2.0.0)
(2022-12-29)


### ⚠ BREAKING CHANGES

* **bigquery-spec:** Move `batch_size` from the plugin spec to the top
level spec
([#6092](#6092))

### Bug Fixes

* **bigquery-spec:** Move `batch_size` from the plugin spec to the top
level spec
([#6092](#6092))
([a1d706e](a1d706e))
* **deps:** Update module github.com/cloudquery/plugin-sdk to v1.16.0
([#6098](#6098))
([7bacdf3](7bacdf3))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

automerge Automatically merge once required checks pass

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Bug(destinations-BigQuery): Batch write failures with Error 413 (Request Entity Too Large)

5 participants