This commit re-enables p2p sharing for both vllm v0 and v1.

Signed-off-by: Or Ozeri <oro@il.ibm.com>

Add async sending based on async V1 connector API updates

Create LICENSE

* [XWKV-48] Implement gismo backend (LMCache#7)

* [XWKV-48] Cache fd to optimize performance (LMCache#11)

Cache fd to optimize performance.

Add thread pool to read/write file in parallel.

* [XWKV-48] Support remotely read kv (LMCache#12)

As Gismo supports locally read files
written remotely, we need to change our code
to make sure we can read files not cached.

* [XWKV-68] Use vram API to boost performance (LMCache#13)

As vram read/write API to boost performance.

Use new get/put method to read/write meta file.

* [XWKV-68] Use batched contains API

Use mvfs batched contains API to implement
batch contains interface to
boost performance.

Add retry when get metadata in case lmcache
reads faster than backend.

---------

Co-authored-by: Jinwen <287310886@qq.com>

Create LICENSE

- Add assert memory_obj.tensor is not None in batched_submit_put_task
  for parity with single-key submit_put_task
- Add summary debug logs to batched_get_blocking and
  batched_get_non_blocking for production observability
- Deduplicate batched_async_contains by delegating to batched_contains

* [MP][optimize] optimize save when mla enabled

Signed-off-by: idellzheng <idellzheng@tencent.com>

* use ParallelStrategy

Signed-off-by: idellzheng <idellzheng@tencent.com>

* rename world_sise and worker_id

Signed-off-by: idellzheng <idellzheng@tencent.com>

* optimize mla save

Signed-off-by: idellzheng <idellzheng@tencent.com>

---------

Signed-off-by: idellzheng <idellzheng@tencent.com>