* Bucketing/Warmup WIP

* Cleanup

* Revert "Fix model_output_idx on HPU (vllm-project#27)"

This reverts commit 90dfa92.

* Rework selected_token_indices fix to also work with block_size padding

* Simple prompt attention POC

* Remove cumsum

* MQA/GQA support for simple prompt_attention

* Cleanup

* Fix typo

* Restore profiling runs

…ernel tuning script for rocm.

Merge pull request vllm-project#33  - tuned moe configs v2

Enable jit for com ops

…oject#26)

* indexer medatata to separate prefill and decode

* deep_gemm prefill kernel

* decode kernel, can run for single batch

* bug fixing insert decode k into kv before gemm

* don't use tilelang quant function

* faster non-looping torch for kv cache insertion

* add chunked prefill impl

* change quant kernel back to tilelang for promotion

* fix format (vllm-project#31)

Signed-off-by: Chen Zhang <zhangch99@outlook.com>

* update unit tests

* Fp8 indexer prefill (vllm-project#33)

* init

Signed-off-by: Chen Zhang <zhangch99@outlook.com>

* can run

---------

Signed-off-by: Chen Zhang <zhangch99@outlook.com>

* remove debug comment

Signed-off-by: Chen Zhang <zhangch99@outlook.com>

* cleanup

* further cleanup

---------

Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

* Support cpu kv-cache offload on XPU platform

Signed-off-by: chzhang <chaojun.zhang@intel.com>

* Support cpu kv-cache offload on XPU platform

Signed-off-by: chzhang <chaojun.zhang@intel.com>

---------

Signed-off-by: chzhang <chaojun.zhang@intel.com>

AFDConnector, ubatch refactor