Skip to content

implement StateStore methods in SlidingWindow#4

Merged
ymatsuda merged 2 commits into
confluentinc:streamingfrom
ymatsuda:slidingwindow
Aug 21, 2015
Merged

implement StateStore methods in SlidingWindow#4
ymatsuda merged 2 commits into
confluentinc:streamingfrom
ymatsuda:slidingwindow

Conversation

@ymatsuda

@ymatsuda ymatsuda commented Aug 6, 2015

Copy link
Copy Markdown

@guozhangwang

Copy link
Copy Markdown

ymatsuda Seems the class Value is not added?

EDIT: never mind, just saw it in the same class file.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shall we just move these functions below to Utils.java?

@guozhangwang

Copy link
Copy Markdown

ymatsuda LGTM, do you want to merge it now?

We can discuss the full windowing semantics later and improve based on this.

ymatsuda added a commit that referenced this pull request Aug 21, 2015
implement StateStore methods in SlidingWindow
@ymatsuda ymatsuda merged commit 7e8f519 into confluentinc:streaming Aug 21, 2015
@guozhangwang

Copy link
Copy Markdown

lgtm

@ymatsuda ymatsuda deleted the slidingwindow branch September 2, 2015 16:26
Geoff (granders) pushed a commit that referenced this pull request Jan 31, 2016
Author: Michael Blume <mike@loggly.com>

Reviewers: Guozhang Wang

Closes #4 from MichaelBlume/patch-1
Geoff (granders) pushed a commit that referenced this pull request Feb 3, 2016
Author: Michael Blume <mike@loggly.com>

Reviewers: Guozhang Wang

Closes #4 from MichaelBlume/patch-1

(cherry picked from commit af0df09)
Signed-off-by: Guozhang Wang <wangguoz@gmail.com>
Andrew Egelhofer (andrewegel) pushed a commit that referenced this pull request Nov 16, 2021
* Adding Dockerfile build

* Minor cleanup
Sushant Mahajan (smjn) added a commit that referenced this pull request Aug 6, 2024
* AKCORE-254: RPC batching and event based poll. (#4)

### What
- Build infra code to allow for RPC batching in PersisterStateManager.
- Change poll mechanism to be triggered on various events (new RPC, completion of RPC on specific parition key etc.)

### Why
- Batching improves performance by leveraging the turnaround time of an RPC on a specific node n1 (share coord leader) to batch multiple RPCs into a single one for subsequent requests. For example: 
  - Suppose we get a Write RPC r1 for n1.
  - We send this RPC in standard way.
  - While r1 is inflight, lets say 3 more RPCs for n1 are received (r2, r3, r4)
  - coalesce and batch r2, r3, and r4 into a single RPC R1.
  - When r1 completes, make a single RPC R1 to n1
  - This saves 2 network calls.
  - The result of R1 is broken down to create response objects for individual RPCs (r2, r3, r4)
- Event based poll is more performant and simpler to implement.

### Testing
-  Added and updated tests at requisite places.

* Incorporated review comments. (#6)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants