Skip to content

Merge latest commits from apache again#78

Merged
Guozhang Wang (guozhangwang) merged 16 commits into
confluentinc:streamingfrom
guozhangwang:rebaseAgain
Sep 25, 2015
Merged

Merge latest commits from apache again#78
Guozhang Wang (guozhangwang) merged 16 commits into
confluentinc:streamingfrom
guozhangwang:rebaseAgain

Conversation

@guozhangwang

Copy link
Copy Markdown

ymatsuda

Also fixes some issues in MockRestoreConsumer.

Author: Jason Gustafson <jason@confluent.io>

Reviewers: Ismael Juma, Guozhang Wang

Closes apache#119 from hachikuji/KAFKA-2403
…artition info.

Author: Dong Lin <lindong28@gmail.com>
Author: Dong Lin <lindong@cis.upenn.edu>

Reviewers: Jason Gustafson, Ismael Juma, Guozhang Wang

Closes apache#118 from lindong28/KAFKA-2390
…ition Topic

We now write to the channel with an empty buffer when
there are pending bytes remaining and all data has been
sent.

Author: Ismael Juma <ismael@juma.me.uk>

Reviewers: Sriharsha Chintalapani <schintalapani@hortonworks.com>, Ben Stopford <benstopford@gmail.com>, Jun Rao <junrao@gmail.com>

Closes apache#236 from ijuma/kafka-2576-ssl-multi-partition-topic-hang
…y created when two zookeeper sessions are established in a very short period of time

This is a patch to get around the problem discussed in the KAFKA-1387 jira. The tests are not passing in my box when I run them all, but they do pass when I run them individually, which indicates that there is something leaking from a test to the next. I still need to work this out and also work on further testing this. I wanted to open this PR now so that it can start getting reviewed.

Author: flavio junqueira <fpj@apache.org>
Author: fpj <fpj@apache.org>
Author: Flavio Junqueira <fpj@apache.org>

Reviewers: Ismael Juma <ismael@juma.me.uk>, Guozhang Wang <wangguoz@gmail.com>, Jun Rao <junrao@gmail.com>

Closes apache#178 from fpj/1387
… 0.9.0.0

Simplified the logic to choose the default fix version. We just hardcode
it for `trunk` and try to compute it based on the branch name for the
rest.

Removed logic that tries to handle forked release branches as it
seems to be specific to how the Spark project handles their JIRA.

Author: Ismael Juma <ismael@juma.me.uk>

Reviewers: Guozhang Wang

Closes apache#238 from ijuma/kafka-2548-merge-pr-tool-4-segment-fix-version
Updated the version from 0.8.3 to 0.9.0. in ApiVersion.  Also updated in gradle.propeties.

Author: Manikumar reddy O <manikumar.reddy@gmail.com>

Reviewers: Ismael Juma, Gwen Shapira

Closes apache#237 from omkreddy/KAFKA-2554
Author: Dong Lin <lindong28@gmail.com>

Reviewers: Jason Gustafson, Guozhang Wang

Closes apache#239 from lindong28/KAFKA-2390-followup
Author: Ewen Cheslack-Postava <me@ewencp.org>

Reviewers: Gwen Shapira, James Cheng

Closes apache#202 from ewencp/kafka-2373-copycat-distributed-offset
Author: Ashish Singh <asingh@cloudera.com>

Reviewers: Ewen Cheslack-Postava, Gwen Shapira

Closes apache#231 from SinghAsDev/KAFKA-2571
Author: Jason Gustafson <jason@confluent.io>

Reviewers: Gwen Shapira

Closes apache#240 from hachikuji/KAFKA-2579
… commit

Author: Jason Gustafson <jason@confluent.io>

Reviewers: Onur Karaman, Guozhang Wang

Closes apache#243 from hachikuji/KAFKA-2409
…ack's commitSync

hachikuji ewencp I found this problem when adding new consumer to mirror maker which commits offset in the rebalance callback. It is not clear to me why we are triggering rebalance for commitSync() and fetchCommittedOffset(). Can you help review to see if I miss something?

Regarding commitSync, After each poll() the partitions will be either assigned to a consumer or it will be already revoked. As long as user is using internal offset map, the offset map will always be valid. i.e. the offset map will always only contain the assigned partitions when commitSync is called. Hence there is no need to trigger a rebalance in commitSync().

The same guarantee also apply to fetchCommittedOffset(), isn't the only requirement is to ensure we know the coordinator?

Another related issue is that today the IllegalGenerationIdException is a bit confusing. When we receive an IllegalGenerationIdException from heartbeat, we need to use that same generation Id to commit offset and the coordinator will take it. So the generation ID was not really illegal. I will file a ticket for this issue.

Author: Jiangjie Qin <becket.qin@gmail.com>

Reviewers: Jason Gustafson, Guozhang Wang

Closes apache#221 from becketqin/KAFKA-2555
@guozhangwang

Copy link
Copy Markdown
Author

ymatsuda

I cannot find a good way to generalize MockRestoreConsumer, so I will revert some changes.

@ymatsuda

Copy link
Copy Markdown

lgtm

Guozhang Wang (guozhangwang) added a commit that referenced this pull request Sep 25, 2015
Merge latest commits from apache again
@guozhangwang Guozhang Wang (guozhangwang) merged commit 6eac054 into confluentinc:streaming Sep 25, 2015
@guozhangwang Guozhang Wang (guozhangwang) deleted the rebaseAgain branch October 7, 2016 21:47
José Armando García Sancio (jsancio) pushed a commit that referenced this pull request Sep 13, 2019
…cs (#78)

Uses a null check before accessing a Selector's interceptor since client-side selectors don't use interceptors

This commit includes parts of two commits that were originally committed to cc-kafka (https://github.com/confluentinc/cc-kafka/commit/ea013304c99f67831d916a274cc930f1c06114ad and https://github.com/confluentinc/cc-kafka/commit/bd0d23f76ee2a8386ee0f61eaca4570f2a502a7d) (reviewed by Rajini)

Additional changes in tests:
* Add listenerNames and SSL mapping config to failing tests
* Remove synchronization from test class PhysicalCluster#principal() method

Having it synchronized resulted in a deadlock when calling shutdown() because principal() was caused when the Selector was closed

Reviewers: Rajini<rajini@confluent.io>
Andrew Egelhofer (andrewegel) pushed a commit that referenced this pull request Nov 16, 2021
List of commits from kafka-broker-plugins:

* Include all transitive dependencies in assembly (#71)
* Add OAuth LoginCallbackHandler for the Kafka server (#72)
* CPKAFKA-1593: Multi-tenant authorizer for CCloud (#66)
* CPKAFKA-1593: Integration tests for multi-tenant authorizer for CCloud (#67)
* CAAS-1960: Implement Phase 3.1 Metrics (#76)
* CAAS-1960: Add authenticated connections and authentication rate metrics per tenant (#77)
* Bump Confluent to 5.2.0-SNAPSHOT, Kafka to 2.2.0-SNAPSHOT
* Topic config constraints (#70)
* Remove redundant import in MultiTenantRequestContext (#79)
* 4.1.x to 5.0.x (#78)
* 5.0.x to 5.1.x (#82)
* CPKAFKA-1408: Add tenant throughput and request quota plugin (#68)
* Improve topic policy checks (#81)
* CPKAFKA-1410: Partition assignor to balance partitions at tenant level (#73)
* CPKAFKA-1694: Add partition throughput percentiles for monitoring (#84)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

9 participants