Skip to content

Add e5-mistral embedding model - step 3/3#988

Merged
Ying1123 merged 2 commits intomainfrom
ying-e5-mistral
Aug 8, 2024
Merged

Add e5-mistral embedding model - step 3/3#988
Ying1123 merged 2 commits intomainfrom
ying-e5-mistral

Conversation

@Ying1123
Copy link
Copy Markdown
Contributor

@Ying1123 Ying1123 commented Aug 8, 2024

This is the last PR contains unit test after

Note: does not support input is a list of prompts

@Ying1123 Ying1123 force-pushed the ying-e5-mistral branch 2 times, most recently from 79e4bcd to c961031 Compare August 8, 2024 08:06
Comment thread python/sglang/srt/model_executor/model_runner.py Outdated
Comment thread python/sglang/srt/utils.py Outdated
Comment thread python/sglang/srt/managers/tp_worker.py Outdated
@Ying1123 Ying1123 requested a review from merrymercy August 8, 2024 08:12
@merrymercy
Copy link
Copy Markdown
Contributor

This PR introduces too many if/else. Follow this principle to refactor them

  1. If there is a if/else branch, make sure the generation branch is the first one
  2. If possible, always use if is_generation instead of if not is_embedding

@Ying1123 Ying1123 mentioned this pull request Aug 8, 2024
29 tasks
@Ying1123 Ying1123 force-pushed the ying-e5-mistral branch 11 times, most recently from ead6e1f to 84306a9 Compare August 8, 2024 21:56
Comment thread python/sglang/srt/managers/tokenizer_manager.py Outdated
@Ying1123 Ying1123 force-pushed the ying-e5-mistral branch 2 times, most recently from 881fa81 to 189626c Compare August 8, 2024 23:12
@Ying1123 Ying1123 merged commit e040a24 into main Aug 8, 2024
@Ying1123 Ying1123 deleted the ying-e5-mistral branch August 8, 2024 23:31
@Ying1123 Ying1123 mentioned this pull request Aug 9, 2024
timethink pushed a commit to timethink/sglang that referenced this pull request Mar 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants