Skip to content

Stream task#7

Merged
ymatsuda merged 3 commits into
confluentinc:streamingfrom
guozhangwang:StreamTask
Aug 26, 2015
Merged

Stream task#7
ymatsuda merged 3 commits into
confluentinc:streamingfrom
guozhangwang:StreamTask

Conversation

@guozhangwang

Copy link
Copy Markdown

ymatsuda

Refactored Processor layer to add the ProcessorFactory.

  1. Keep track of current StampedRecord and ProcessorNode in StreamTask.
  2. Create ProcessorContextImpl inside StreamTask, and pass-in with initialization.
  3. Remove KafkaProcessor and Punctuator, just use Processor instead.
  4. Remove recordCollector in ProcessorContext.
  5. Fix the timestamp tracking logic so that it is now monotonically increasing, ymatsuda could you double check on this logic also?

The interfacing classes with KStream would be in TopologyBuilder (addProcessor etc), and ProcessorTopology (getSources, getTopic etc).

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fix the class name in the comment

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ack.

@guozhangwang

Copy link
Copy Markdown
Author

ymatsuda

@ymatsuda

Copy link
Copy Markdown

OK

ymatsuda added a commit that referenced this pull request Aug 26, 2015
@ymatsuda ymatsuda merged commit 7b0f375 into confluentinc:streaming Aug 26, 2015
Ewen Cheslack-Postava (ewencp) pushed a commit that referenced this pull request Jul 12, 2016
… as Apache Kafka 0.10.0.0

Merge tag '0.10.0.0-rc6' into 0.10.0

Release candidate #7 for Apache Kafka 0.10.0.0
@guozhangwang Guozhang Wang (guozhangwang) deleted the StreamTask branch October 7, 2016 21:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants