Skip to content

Dedup by key extension#83

Merged
hannahhoward merged 2 commits intomasterfrom
feat/disable-dedup
Aug 13, 2020
Merged

Dedup by key extension#83
hannahhoward merged 2 commits intomasterfrom
feat/disable-dedup

Conversation

@hannahhoward
Copy link
Collaborator

Goals

  • provide a way to communicate that you don't want requests deduplicated across blocks

Implementation

When you register alternate persistence stores, it's important to treat requests to those persistence stores as if they are a seperate peer.

This impliments a "dedup by key" extension which provides a way to say to a provider, for this peer, only dedup blocks in requests that also have this key.

On the provider, we simply use the alternate store name as the key

add deduping requests by a given key to the response manager
use dedup extension to not dedup data across stores
@hannahhoward hannahhoward merged commit 8e60042 into master Aug 13, 2020
@aschmahmann aschmahmann mentioned this pull request Sep 22, 2020
72 tasks
@mvdan mvdan deleted the feat/disable-dedup branch December 15, 2021 14:16
marten-seemann pushed a commit that referenced this pull request Mar 2, 2023
updates to graphsync 0.2.0 which includes ipld-prime update also
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant