Skip to content

offset = input_ids.index(self.config.image_token_index) #161

@JAADARI

Description

@JAADARI

anyone faced this problem before ? :

Exception in ModelRpcClient:
Traceback (most recent call last):
File "/home/fjaadari/anaconda3/envs/llava/lib/python3.10/site-packages/sglang/srt/managers/router/model_rpc.py", line 161, in exposed_step
self.handle_generate_request(recv_req)
File "/home/fjaadari/anaconda3/envs/llava/lib/python3.10/site-packages/sglang/srt/managers/router/model_rpc.py", line 243, in handle_generate_request
req.input_ids, req.image_offset = self.model_runner.model.pad_input_ids(
File "/home/fjaadari/anaconda3/envs/llava/lib/python3.10/site-packages/sglang/srt/models/llava.py", line 63, in pad_input_ids
offset = input_ids.index(self.config.image_token_index)
ValueError: 32000 is not in list

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions