[main] remove dbo code#3712
Conversation
|
👋 Hi! Thank you for contributing to the vLLM Ascend project. The following points will speed up your PR merge:
If CI fails, you can run linting and testing checks locally according Contributing and Testing. |
There was a problem hiding this comment.
Code Review
This pull request removes code related to dbo (dual-batch overlap) in the vLLM project, specifically targeting the ascend platform. The changes involve removing a sample file, environment variable configurations, and related metadata and logic from the attention modules. The review focuses on ensuring the complete removal of dbo-related code and maintaining the project's overall correctness and efficiency.
|
This pull request has conflicts, please resolve those before we can evaluate the pull request. |
31a428d to
22e20de
Compare
1c36d72 to
42f50f1
Compare
Signed-off-by: zzzzwwjj <1183291235@qq.com>
### What this PR does / why we need it? Remove codes of dbo. Currently, vLLM has supported dbo with pr: vllm-project/vllm#23693. ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? - vLLM version: v0.11.0rc3 - vLLM main: vllm-project/vllm@17c540a Signed-off-by: zzzzwwjj <1183291235@qq.com> Signed-off-by: luolun <luolun1995@cmbchina.com>
### What this PR does / why we need it? Remove codes of dbo. Currently, vLLM has supported dbo with pr: vllm-project/vllm#23693. ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? - vLLM version: v0.11.0rc3 - vLLM main: vllm-project/vllm@17c540a Signed-off-by: zzzzwwjj <1183291235@qq.com> Signed-off-by: hwhaokun <haokun0405@163.com>
### What this PR does / why we need it? Remove codes of dbo. Currently, vLLM has supported dbo with pr: vllm-project/vllm#23693. ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? - vLLM version: v0.11.0rc3 - vLLM main: vllm-project/vllm@17c540a Signed-off-by: zzzzwwjj <1183291235@qq.com> Signed-off-by: nsdie <yeyifan@huawei.com>
### What this PR does / why we need it? Remove codes of dbo. Currently, vLLM has supported dbo with pr: vllm-project/vllm#23693. ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? - vLLM version: v0.11.0rc3 - vLLM main: vllm-project/vllm@17c540a Signed-off-by: zzzzwwjj <1183291235@qq.com>
What this PR does / why we need it?
Remove codes of dbo.
Currently, vLLM has supported dbo with pr: vllm-project/vllm#23693.
Does this PR introduce any user-facing change?
How was this patch tested?