Install & run guidelabs/steerling-8b easily using llmpm

#1
by sarthak-saxena - opened

Install & run any hugging face model using llmpm

  • pip install llmpm
  • llmpm install guidelabs/steerling-8b
  • llmpm serve guidelabs/steerling-8b

LLMPMDemo_fuckwk

Website: https://llmpm.co

Appears llmpm doesn't support "guidelabs/steerling-8b" yet. I am receiving the following error :

error  Failed to load model: The checkpoint you are trying to load has model type `causal_diffusion` but Transformers does not recognize this architecture. This could be because of an 
issue with the checkpoint, or because your version of Transformers is out of date.

You can update Transformers with the command `pip install --upgrade transformers`. If this does not work, and the checkpoint is very new, then there may not be a release version that 
supports this model yet. In this case, you can get the most up-to-date code by installing Transformers from source with the command `pip install 
git+https://github.com/huggingface/transformers.git`

Sign up or log in to comment