Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: cloudquery/plugin-sdk
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: v1.23.0
Choose a base ref
...
head repository: cloudquery/plugin-sdk
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: v1.24.0
Choose a head ref
  • 4 commits
  • 41 files changed
  • 4 contributors

Commits on Jan 9, 2023

  1. feat: Add local backend for storing cursor state (#569) 

    A state store allows us to store cursors for #413. This first iteration introduces the interface and implements it for a local JSON storage backend. After some back and forth I decided to call it `backend`, similar to Terraform. Alternatives considered were `state` (confusing because it's not a single state) and `storage` (confusing because it's similar to `destination`). 

Since the interface is a generic key-value store, we lose the ability to know whether a table is incremental or not, and which columns are used as cursor keys if it is. I'm proposing that we add some fields to the `Table` definition to be able to at least document these aspects, but it's not enforced.

See cloudquery/cloudquery#6336 for an example implementation using this new functionality.
    @hermanschaaf
    hermanschaaf authored Jan 9, 2023
    1 Configuration menu
    Copy the full SHA
    3b07885 View commit details
    Browse the repository at this point in the history

  2. feat: Remove codegen (#589) 

    Removing codegen 🥳
    @yevgenypats
    yevgenypats authored Jan 9, 2023
    Configuration menu
    Copy the full SHA
    1c5943a View commit details
    Browse the repository at this point in the history

  3. fix(destinations): Log correct size of batch (#588) 

    
If we exceed `BatchSizeBytes` the batch size can be lower than the one in the spec

---
    @erezrokah
    erezrokah authored Jan 9, 2023
    1 Configuration menu
    Copy the full SHA
    9cebafe View commit details
    Browse the repository at this point in the history

  4. chore(main): Release v1.24.0 (#586) 

    🤖 I have created a release *beep* *boop*
---


## [1.24.0](v1.23.0...v1.24.0) (2023-01-09)


### Features

* Add local backend for storing cursor state ([#569](#569)) ([3b07885](3b07885))
* Remove codegen ([#589](#589)) ([1c5943a](1c5943a))


### Bug Fixes

* **destinations:** Log correct size of batch ([#588](#588)) ([9cebafe](9cebafe))

---
This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
    @cq-bot
    cq-bot authored Jan 9, 2023
    1 Configuration menu
    Copy the full SHA
    a54dbe7 View commit details
    Browse the repository at this point in the history
Loading