How to use microsoft/VibeVoice-1.5B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-to-speech", model="microsoft/VibeVoice-1.5B")
# Load model directly from transformers import AutoModelForSeq2SeqLM model = AutoModelForSeq2SeqLM.from_pretrained("microsoft/VibeVoice-1.5B", dtype="auto")
Is there a way to run this model locally on a phone yet? or I need to wait a compatibility with llama.cpp?
@Lxdro Thanks for letting us know the issue. You could also post feature requests in the llama.cpp repo.
· Sign up or log in to comment
