Skip to content

[Core] Add batched get interface#924

Merged
YaoJiayi merged 4 commits intodevfrom
localdev/batched-put-interface
Jun 30, 2025
Merged

[Core] Add batched get interface#924
YaoJiayi merged 4 commits intodevfrom
localdev/batched-put-interface

Conversation

@YaoJiayi
Copy link
Copy Markdown
Collaborator

@YaoJiayi YaoJiayi commented Jun 30, 2025

Add batched get interface. This interface makes the storage backends be able to perform batched get operation.

PR #912 and #863 can leverage this.


PR Checklist (Click to Expand)

Thank you for your contribution to LMCache! Before submitting the pull request, please ensure the PR meets the following criteria. This helps us maintain the code quality and improve the efficiency of the review process.

PR Title and Classification

Please try to classify PRs for easy understanding of the type of changes. The PR title is prefixed appropriately to indicate the type of change. Please use one of the following:

  • [Bugfix] for bug fixes.
  • [CI/Build] for build or continuous integration improvements.
  • [Doc] for documentation fixes and improvements.
  • [Model] for adding a new model or improving an existing model. Model name should appear in the title.
  • [Core] for changes in the core LMCache logic (e.g., LMCacheEngine, Backend etc.)
  • [Misc] for PRs that do not fit the above categories. Please use this sparingly.

Note: If the PR spans more than one category, please include all relevant prefixes.

Code Quality

The PR need to meet the following code quality standards:

  • The code need to be well-documented to ensure future contributors can easily understand the code.
  • Please include sufficient tests to ensure the change is stay correct and robust. This includes both unit tests and integration tests.

What to Expect for the Reviews

To create a new tag for lmcache (Note: v prefix is required):
git tag vx.x.x
git push origin vx.x.x (same version again)

For example:
git tag v0.3.0
git push origin v0.3.0

In case the workflow fails, delete the tag and try again:
git tag -d vx.x.x
git push origin :refs/tags/vx.x.x

For example:
git tag -d v0.3.0
git push origin :refs/tags/v0.3.0

To create a new release and publish lmcache Python package to PyPi:
git remote add upstream git@github.com:LMCache/LMCache.git
gh release create vx.x.x --repo LMCache/LMCache --title "vx.x.x" --notes "<Add description>"

For example:
git remote add upstream git@github.com:LMCache/LMCache.git
gh release create v0.3.0 --repo LMCache/LMCache --title "v0.3.0" --notes "LMCache v0.3.0 is a feature release. Users are encouraged to upgrade for the best experience."

[!TIP]
The creation of a release and subsequent tag generation can be done alternatively from the LMCache releases page.

We aim to address all PRs in a timely manner. If no one reviews your PR within 5 days, please @-mention one of KuntaiDu, ApostaC or YaoJiayi.

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
@YaoJiayi YaoJiayi requested a review from Shaoting-Feng June 30, 2025 00:26
@YaoJiayi YaoJiayi changed the title [Core] Add batched put interface [Core] Add batched get interface Jun 30, 2025
YaoJiayi added 2 commits June 29, 2025 17:40
Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
Copy link
Copy Markdown
Contributor

@Shaoting-Feng Shaoting-Feng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Comment thread lmcache/v1/storage_backend/abstract_backend.py
Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
@YaoJiayi YaoJiayi merged commit 162cc9e into dev Jun 30, 2025
3 of 4 checks passed
TeenSpirit1107 pushed a commit to TeenSpirit1107/LMCache-yimeng that referenced this pull request Jul 3, 2025
* add batched put interface

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

* minor fix

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

* minor fix

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

* fix typo

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

---------

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
Shaoting-Feng pushed a commit that referenced this pull request Jul 10, 2025
* add batched put interface

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

* minor fix

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

* minor fix

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

* fix typo

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

---------

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
Shaoting-Feng pushed a commit to Shaoting-Feng/LMCache that referenced this pull request Jul 14, 2025
* add batched put interface

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

* minor fix

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

* minor fix

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

* fix typo

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

---------

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
Shaoting-Feng pushed a commit to Shaoting-Feng/LMCache that referenced this pull request Jul 14, 2025
* add batched put interface

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

* minor fix

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

* minor fix

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

* fix typo

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

---------

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
Signed-off-by: Shaoting Feng <shaotingf@uchicago.edu>
@YaoJiayi YaoJiayi deleted the localdev/batched-put-interface branch July 29, 2025 03:40
YurianStormrage pushed a commit to YurianStormrage/LMCache that referenced this pull request Aug 26, 2025
* add batched put interface

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

* minor fix

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

* minor fix

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

* fix typo

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

---------

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
KevinCheung2259 pushed a commit to KevinCheung2259/LMCache that referenced this pull request Nov 5, 2025
* add batched put interface

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

* minor fix

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

* minor fix

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

* fix typo

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

---------

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
DongDongJu pushed a commit to DongDongJu/LMCache that referenced this pull request Feb 22, 2026
* add batched put interface

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

* minor fix

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

* minor fix

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

* fix typo

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>

---------

Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants