Skip to content

Fail indexDocs() on rejection#111962

Merged
DaveCTurner merged 1 commit intoelastic:mainfrom
DaveCTurner:2024/08/19/indexRandom-no-rejections
Aug 19, 2024
Merged

Fail indexDocs() on rejection#111962
DaveCTurner merged 1 commit intoelastic:mainfrom
DaveCTurner:2024/08/19/indexRandom-no-rejections

Conversation

@DaveCTurner
Copy link
Copy Markdown
Member

@DaveCTurner DaveCTurner commented Aug 19, 2024

In 9dc59e2 we relaxed the indexDocs() test utility to retry on
rejections caused by exceeding the write queue length limit, but then we
added a limit on concurrency in d88ac0a and then massively relaxed the
queue length limit in #59559. We should not be seeing such rejections
any more, so we can revert this special handling and strengthen the
tests to assert that the indexing process encounters no failures at all.

In 9dc59e2 we relaxed the `indexDocs()` test utility to retry on
rejections caused by exceeding the write queue length limit, but then we
massively relaxed this limit in elastic#59559. We should not be seeing such
rejections any more, so we can revert this special handling and
strengthen the tests to assert that the indexing process encounters no
failures at all.
@DaveCTurner DaveCTurner added >test Issues or PRs that are addressing/adding tests :Distributed/CRUD A catch all label for issues around indexing, updating and getting a doc by id. Not search. v8.16.0 labels Aug 19, 2024
@DaveCTurner DaveCTurner requested a review from fcofdez August 19, 2024 08:19
@elasticsearchmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/es-distributed (Team:Distributed)

@elasticsearchmachine elasticsearchmachine added the Team:Distributed Meta label for distributed team. label Aug 19, 2024
Copy link
Copy Markdown
Contributor

@fcofdez fcofdez left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@DaveCTurner DaveCTurner merged commit ca6d41c into elastic:main Aug 19, 2024
@DaveCTurner DaveCTurner deleted the 2024/08/19/indexRandom-no-rejections branch August 19, 2024 11:04
weizijun added a commit to weizijun/elasticsearch that referenced this pull request Aug 19, 2024
* upstream/main:
  Fail `indexDocs()` on rejection (elastic#111962)
  Move repo analyzer to its own package (elastic#111963)
  Add generated evaluators for DateNanos conversion functions (elastic#111961)
  Clean the last traces from global retention in templates (elastic#111669)
  Fix known issue docs for elastic#111866 (elastic#111956)
  x-pack/plugin/otel: introduce x-pack-otel plugin (elastic#111091)
  Improve reaction to blob store corruptions (elastic#111954)
  Introduce `StreamingXContentResponse` (elastic#111933)
  Revert "Add 8.15.0 known issue for memory locking in Windows (elastic#111949)"
  Test get-snapshots API with missing details (elastic#111903)
  Add 8.15.0 known issue for memory locking in Windows (elastic#111949)

# Conflicts:
#	server/src/main/java/org/elasticsearch/TransportVersions.java
cbuescher pushed a commit to cbuescher/elasticsearch that referenced this pull request Sep 4, 2024
In 9dc59e2 we relaxed the `indexDocs()` test utility to retry on
rejections caused by exceeding the write queue length limit, but then we
massively relaxed this limit in elastic#59559. We should not be seeing such
rejections any more, so we can revert this special handling and
strengthen the tests to assert that the indexing process encounters no
failures at all.
davidkyle pushed a commit to davidkyle/elasticsearch that referenced this pull request Sep 5, 2024
In 9dc59e2 we relaxed the `indexDocs()` test utility to retry on
rejections caused by exceeding the write queue length limit, but then we
massively relaxed this limit in elastic#59559. We should not be seeing such
rejections any more, so we can revert this special handling and
strengthen the tests to assert that the indexing process encounters no
failures at all.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Distributed/CRUD A catch all label for issues around indexing, updating and getting a doc by id. Not search. Team:Distributed Meta label for distributed team. >test Issues or PRs that are addressing/adding tests v8.16.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants