VLLM Support
#7
by
salmankhanpm - opened
The embedding variant has vllm support. will this work with vllm ?
There is an open PR for adding vLLM support for this model: https://github.com/vllm-project/vllm/pull/30550
nvidia-oliver-holworthy changed discussion status to
closed