Skip to content

[phrase match] Restructure full_text_index::inverted_index module#6638

Merged
coszio merged 3 commits intodevfrom
restructure-full-text-index-module
Jun 12, 2025
Merged

[phrase match] Restructure full_text_index::inverted_index module#6638
coszio merged 3 commits intodevfrom
restructure-full-text-index-module

Conversation

@coszio
Copy link
Contributor

@coszio coszio commented Jun 4, 2025

Builds on top of #6493

Since more files and logic is being added to full-text-index, navigability was getting more complex. This PR aims to simplify it by:

  • moving all inverted_index specific files to one module
  • moving a chunky congruence test into its own file
  • removing old_mmap_postings and compressed_postings modules

@coszio coszio force-pushed the persist-ordered-documents branch from 7a1af3b to 2b9d2b4 Compare June 4, 2025 15:57
@coszio coszio force-pushed the restructure-full-text-index-module branch from 42201d2 to 21303a2 Compare June 4, 2025 15:58
@coszio coszio requested a review from generall June 4, 2025 15:59
@coszio coszio added this to the Phrase matching milestone Jun 4, 2025
@coszio coszio force-pushed the persist-ordered-documents branch from 2b9d2b4 to ae56018 Compare June 5, 2025 17:44
@coszio coszio force-pushed the restructure-full-text-index-module branch from 21303a2 to b49774c Compare June 5, 2025 17:53
Base automatically changed from persist-ordered-documents to dev June 10, 2025 17:07
@coszio coszio force-pushed the restructure-full-text-index-module branch from e7bfb15 to 8d7fcfb Compare June 10, 2025 18:18
@coszio coszio marked this pull request as ready for review June 10, 2025 19:10
@coszio coszio requested a review from timvisee June 10, 2025 19:10
@coderabbitai

This comment was marked as resolved.

coderabbitai[bot]

This comment was marked as resolved.

@coszio coszio force-pushed the restructure-full-text-index-module branch from 8d7fcfb to e3fd633 Compare June 11, 2025 15:40
coderabbitai[bot]

This comment was marked as resolved.

Copy link
Member

@timvisee timvisee left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

Am I correct that there is no logic change in here. At least I didn't see any.

If not, let's merge! If there is, please let me know and I'll revisit that part again.

@coszio
Copy link
Contributor Author

coszio commented Jun 12, 2025

There's no logic changes here, correct

@coszio coszio merged commit 7e23fa0 into dev Jun 12, 2025
17 checks passed
@coszio coszio deleted the restructure-full-text-index-module branch June 12, 2025 13:43
generall pushed a commit that referenced this pull request Jul 17, 2025
…6638)

* move all inverted indexes to one module

Also, remove `old_mmap_postings` and `compressed_postings`

* move congruence test into its own file

* remove old de/serialize_tokenset functions
@coderabbitai coderabbitai bot mentioned this pull request Aug 19, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants