Skip to content

fix: Reduce default concurrency#491

Merged
kodiakhq[bot] merged 1 commit intomainfrom
erezrokah-patch-1
Dec 12, 2022
Merged

fix: Reduce default concurrency#491
kodiakhq[bot] merged 1 commit intomainfrom
erezrokah-patch-1

Conversation

@erezrokah
Copy link
Copy Markdown
Member

Summary

When plugins have many tables, like the new Azure plugin we quickly run into memory issues with the current default.
This works on my machine ™️ with the new Azure plugin


Use the following steps to ensure your PR is ready to be reviewed

  • Read the contribution guidelines 🧑‍🎓
  • Run go fmt to format your code 🖊
  • Lint your changes via golangci-lint run 🚨 (install golangci-lint here)
  • Update or add tests 🧪
  • Ensure the status checks below are successful ✅

@kodiakhq kodiakhq bot merged commit f995da9 into main Dec 12, 2022
@kodiakhq kodiakhq bot deleted the erezrokah-patch-1 branch December 12, 2022 18:46
@github-actions
Copy link
Copy Markdown

⏱️ Benchmark results

  • DefaultConcurrency-2 resources/s: 12,459
  • Glob-2 ns/op: 148.1
  • TablesWithChildrenDefaultConcurrency-2 resources/s: 31,197
  • BufferedScanner-2 ns/op: 9.282
  • LogReader-2 ns/op: 30.57

erezrokah pushed a commit that referenced this pull request Dec 13, 2022
🤖 I have created a release *beep* *boop*
---


##
[1.12.1](v1.12.0...v1.12.1)
(2022-12-13)


### Bug Fixes

* Don't panic on empty-string for timestamp
([#489](#489))
([83813de](83813de))
* Fix deadlock off-by-one
([#493](#493))
([4ea9ed8](4ea9ed8))
* Reduce default concurrency
([#491](#491))
([f995da9](f995da9))
* Refactor glob filters
([#488](#488))
([cb5f6bb](cb5f6bb))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
erezrokah added a commit to cloudquery/cloudquery that referenced this pull request Dec 29, 2022
<!-- 🎉 Thank you for making CloudQuery awesome by submitting a PR 🎉 -->

#### Summary

I reduced this in cloudquery/plugin-sdk#491 and
forgot to update the docs

<!--
Use the following steps to ensure your PR is ready to be reviewed

- [ ] Read the [contribution guidelines](../blob/main/CONTRIBUTING.md)
🧑‍🎓
- [ ] Test locally on your own infrastructure
- [ ] Run `go fmt` to format your code 🖊
- [ ] Lint your changes via `golangci-lint run` 🚨 (install golangci-lint
[here](https://golangci-lint.run/usage/install/#local-installation))
- [ ] Update or add tests 🧪
- [ ] Ensure the status checks below are successful ✅
--->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants