Skip to content

[8.0] MOD-7795 Backport 5778 to 8.0#5907

Merged
lerman25 merged 1 commit into8.0from
backport-5578-to-8.0
Apr 10, 2025
Merged

[8.0] MOD-7795 Backport 5778 to 8.0#5907
lerman25 merged 1 commit into8.0from
backport-5578-to-8.0

Conversation

@lerman25
Copy link
Copy Markdown
Collaborator

@lerman25 lerman25 commented Apr 10, 2025

backport PR #5778 to 8.0

* oom is 80% hard coded. basic shard log

* added error message in FT.INFO

* remove redundant additions

* treat maxmemry == 0 is invalid

* fixed PR comments

* fixed a typo

* indent

* draft

* Add warning to resp3

* Add background indexing failure to info metrics and ft.info

* deserilize error

* format

* correct config

* add config to config pytest

* add initial basic pytest

* Raise bg_index_error and temporal solution for % in log

* base verbosity test

* revert resp3 warning

* fix missing comma

* add pause on OOM mechanism

* Add test for pause on OOM mechanism

* New tests

* new test

* error on OOM index

* create new test file

* revert text_index_error to master

* Add OOM check for ALTER and test

* cleanup + format

* little cleanup

* more cleanup

* change % to percent for log display

* spellcheck fix

* typo fix

* fix pytests for index errors field

* spellcheck

* update index errors dict

* fix error change in config, fix pytest for index_errors

* revert test config

* update IndexError_Deserialize

* Leak possible fix

* Add terminate bg pool debug command

* expose reindex thread pool

* expose reindex thread pool

* less num_docs, add thread pool terminate

* fix pytest

* coord into account for ftinfo

* fix info for coord

* fix serialization process

* fix test

* fix flakeness

* Guy comments round 1

* new help for config

* format

* change config name

* remove Dvir's comment

* change error message + format

* format, guys comments, changing SET_BG_INDEX_RESUME to be without args, changing debug command syntax

* move scanner canceled into memory check blcok

* fix query error string

* change true/false to macro

* adhere to user data

* fix config text

* fix config

* fix config name, add comments on thread pool, change assert

* fix pytest

* Alon's comments round1

* remove SetIndexErrorMessage

* fail of ft.debug search/agg , add assertion instead of if

* change test

* Fail on hset after OOM, test for cluster

* fix assert, fix error message, change loose memory for tests,

* fix leakage

* fix "missing" error message

* support python < 3.9

* fix delete during indexing test, add warning and comment to GIL release

* make test more robust

---------

Co-authored-by: DvirDukhan <dvir@redis.com>
(cherry picked from commit 8b63157)
@lerman25 lerman25 changed the base branch from master to 8.0 April 10, 2025 10:38
@alonre24 alonre24 marked this pull request as draft April 10, 2025 10:47
@alonre24 alonre24 marked this pull request as ready for review April 10, 2025 10:48
@codecov
Copy link
Copy Markdown

codecov bot commented Apr 10, 2025

Codecov Report

Attention: Patch coverage is 96.50350% with 5 lines in your changes missing coverage. Please review.

Project coverage is 87.31%. Comparing base (3a86e12) to head (945a893).
Report is 1 commits behind head on 8.0.

Files with missing lines Patch % Lines
src/debug_commands.c 89.28% 3 Missing ⚠️
src/spec.c 96.15% 2 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##              8.0    #5907      +/-   ##
==========================================
+ Coverage   87.25%   87.31%   +0.06%     
==========================================
  Files         206      206              
  Lines       36523    36635     +112     
==========================================
+ Hits        31867    31987     +120     
+ Misses       4656     4648       -8     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@lerman25 lerman25 added this pull request to the merge queue Apr 10, 2025
Merged via the queue into 8.0 with commit 29192a4 Apr 10, 2025
7 checks passed
@lerman25 lerman25 deleted the backport-5578-to-8.0 branch April 10, 2025 12:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants