Skip to content

create index with dynamically allocated blockmaps#32

Merged
Ngalstyan4 merged 7 commits intomainfrom
feature/davkhech-dynamic-blockmap-page
Aug 9, 2023
Merged

create index with dynamically allocated blockmaps#32
Ngalstyan4 merged 7 commits intomainfrom
feature/davkhech-dynamic-blockmap-page

Conversation

@Ngalstyan4
Copy link
Copy Markdown
Contributor

No description provided.

@codecov
Copy link
Copy Markdown

codecov bot commented Aug 7, 2023

Codecov Report

Merging #32 (5ddfaa5) into main (db801ad) will increase coverage by 2.15%.
The diff coverage is 91.37%.

Additional details and impacted files
@@            Coverage Diff             @@
##             main      #32      +/-   ##
==========================================
+ Coverage   78.45%   80.61%   +2.15%     
==========================================
  Files          10       10              
  Lines         803      815      +12     
  Branches      176      169       -7     
==========================================
+ Hits          630      657      +27     
+ Misses         92       75      -17     
- Partials       81       83       +2     
Files Changed Coverage Δ
src/hnsw/external_index.c 82.03% <91.22%> (+4.25%) ⬆️
src/hnsw/insert.c 84.81% <100.00%> (+2.31%) ⬆️

@Ngalstyan4 Ngalstyan4 force-pushed the feature/davkhech-dynamic-blockmap-page branch 2 times, most recently from f12419a to 2898ba3 Compare August 8, 2023 06:39
@Ngalstyan4 Ngalstyan4 requested a review from var77 August 8, 2023 06:44
build index fixed, retreiver fixed

minor fixes

another bug found

dockerfile update, insert added, test fixed

more fixes, still more bugs to go

final bugs fixed
@Ngalstyan4 Ngalstyan4 force-pushed the feature/davkhech-dynamic-blockmap-page branch from 2898ba3 to b8157c5 Compare August 8, 2023 07:01
Copy link
Copy Markdown
Contributor Author

@Ngalstyan4 Ngalstyan4 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is ready to be merged. @davkhech @var77 , please take a look before I squash the commits and merge!

RUN apt update && apt-mark hold locales && \
# Install required packages for build
apt install -y --no-install-recommends build-essential cmake postgresql-server-dev-15 gdb
apt install -y --no-install-recommends build-essential cmake postgresql-server-dev-15 gdb wget postgres-15-pgvector python3-pip sudo && \
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@davkhech are the added packages actually necessary? how did you use them?
@var77

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes they're necessary for the livedebug script to work in the container.

hdr_page = BufferGetPage(hdr_buf);
hdr = (HnswIndexHeaderPage *)PageGetContents(hdr_page);
assert(hdr->magicNumber == LDB_WAL_MAGIC_NUMBER);
HEADER_FOR_EXTERNAL_RETRIEVER = *hdr;
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

no need to add here, as it's assigned later out of if block

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

needed because ldb_wal_retriever_area_init uses it :)

@davkhech
Copy link
Copy Markdown
Contributor

davkhech commented Aug 8, 2023

LGTM!

@Ngalstyan4 Ngalstyan4 force-pushed the feature/davkhech-dynamic-blockmap-page branch from b8157c5 to 5ddfaa5 Compare August 8, 2023 17:39
@Ngalstyan4 Ngalstyan4 merged commit 0f415c7 into main Aug 9, 2023
@Ngalstyan4 Ngalstyan4 deleted the feature/davkhech-dynamic-blockmap-page branch August 9, 2023 02:21
var77 added a commit that referenced this pull request Oct 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants