I'm running on H20 and sglang is installed through these command:
`git clone -b openbmb https://github.com/OpenBMB/sglang.git
cd sglang
pip install --upgrade pip
pip install -e "python[all]"`
when I execute this command I encountered the below error
python -m sglang.launch_server --model-path OpenBMB/MiniCPM4-8B/ --trust-remote-code --port 30000 --chat-template chatml
File "sglang/python/sglang/srt/models/minicpm.py", line 145, in __init__ self.rotary_emb.cos_sin_cache = self.rotary_emb._compute_cos_sin_cache() TypeError: Phi3LongRoPEScaledRotaryEmbedding._compute_cos_sin_cache() missing 3 required positional arguments: 'max_position_embeddings', 'rescale_factors', and 'mscale'
Did anyone deal with this error before?
I'm running on H20 and sglang is installed through these command:
`git clone -b openbmb https://github.com/OpenBMB/sglang.git
cd sglang
pip install --upgrade pip
pip install -e "python[all]"`
when I execute this command I encountered the below error
python -m sglang.launch_server --model-path OpenBMB/MiniCPM4-8B/ --trust-remote-code --port 30000 --chat-template chatmlFile "sglang/python/sglang/srt/models/minicpm.py", line 145, in __init__ self.rotary_emb.cos_sin_cache = self.rotary_emb._compute_cos_sin_cache() TypeError: Phi3LongRoPEScaledRotaryEmbedding._compute_cos_sin_cache() missing 3 required positional arguments: 'max_position_embeddings', 'rescale_factors', and 'mscale'Did anyone deal with this error before?