How do I add a model executor that is derived from the huggingface model class [RagTokenForGeneration](https://huggingface.co/docs/transformers/en/model_doc/rag#transformers.RagTokenForGeneration). I could only find this [link](https://docs.vllm.ai/en/latest/models/adding_model.html) that documents about adding a new model. Can someone elaborate for this use case. Thanks
How do I add a model executor that is derived from the huggingface model class RagTokenForGeneration.
I could only find this link that documents about adding a new model. Can someone elaborate for this use case.
Thanks