Please let us know what model architectures you would like to be added!

Up to date todo list below. Please feel free to contribute any model, a PR without device mapping, ISQ, etc. will still be merged!

Language models

• snowflake-arctic-instruct: Snowflake/snowflake-arctic-instruct
• WizardLM-2: alpindale/WizardLM-2-8x22B
• Command R: CohereForAI/c4ai-command-r-v01
• Command R+: CohereForAI/c4ai-command-r-plus

Multimodal models

• Llava: liuhaotian/llava-v1.5-7b
• Idefics2: HuggingFaceM4/idefics2-8b
• deepseek-vl: deepseek-ai/deepseek-vl-7b-chat
• MiniCPM: openbmb/MiniCPM-V-2
• Phi 3 Vision: https://huggingface.co/microsoft/Phi-3-vision-128k-instruct

Embedding models

• T5: google-t5/t5-base
• nomic-text-embed: nomic-ai/nomic-embed-text-v1