We currently send out provider records whenever we fetch a block from bitswap. Unfortunately, when under constant load, our provider record queue can back up quite a bit. This:
- Slowly (over weeks) eats up gigabytes of memory.
- Blocks up the dialer queue. This ends up making it really hard to actually fetch content via the gateway because the gateway is busy working through a massive queue of DHT requests.
Proposed solution: In addition to all the provider record work being done in #5774, we should consider adding an option to simply disable provider records (at least for files fetched via the gateway).
We currently send out provider records whenever we fetch a block from bitswap. Unfortunately, when under constant load, our provider record queue can back up quite a bit. This:
Proposed solution: In addition to all the provider record work being done in #5774, we should consider adding an option to simply disable provider records (at least for files fetched via the gateway).