Skip to content

Providing from bitswap slows down the gateways over time. #5822

@Stebalien

Description

@Stebalien

We currently send out provider records whenever we fetch a block from bitswap. Unfortunately, when under constant load, our provider record queue can back up quite a bit. This:

  1. Slowly (over weeks) eats up gigabytes of memory.
  2. Blocks up the dialer queue. This ends up making it really hard to actually fetch content via the gateway because the gateway is busy working through a massive queue of DHT requests.

Proposed solution: In addition to all the provider record work being done in #5774, we should consider adding an option to simply disable provider records (at least for files fetched via the gateway).

Metadata

Metadata

Assignees

No one assigned

    Labels

    kind/bugA bug in existing code (including security flaws)topic/gatewayTopic gateway

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions