Skip to content

[Azure] Add Azure Table Storage database#257

Closed
loic-sharma wants to merge 5 commits intomasterfrom
azure/table-storage
Closed

[Azure] Add Azure Table Storage database#257
loic-sharma wants to merge 5 commits intomasterfrom
azure/table-storage

Conversation

@loic-sharma
Copy link
Owner

@loic-sharma loic-sharma commented Apr 17, 2019

This is an experiment to support massive read/write throughput using Azure Table Storage. I'll be benchmarking this on Azure later. The moonshot goal is to scale this to 12,000 reads per second (~1 billion reads per day), as this is roughly NPM's scale.

  • Perf test
    • Mass index
    • Perf test registration leaf
    • Perf test registration page
    • Perf test version list
  • Consider adding IPackageService.FindVersions API to improve version list perf
  • Consider adding a special row on each package partition that lists that package's versions. It's unclear how to implement this, maintaining this row should not harm write throughput but ideally this row should be strongly consistent

@loic-sharma
Copy link
Owner Author

Replaced by #347

loic-sharma added a commit that referenced this pull request Sep 22, 2019
Adds using Azure Table Storage as a database. The goal is to mirror nuget.org cheaply at a high scale.
 
Replaces #257
@loic-sharma loic-sharma deleted the azure/table-storage branch September 28, 2019 23:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants