Free T4 GPU no more

#6
by mikeee - opened
Owner

Free T4 GPU grant suspended by huggingface, nothing I can do. Sorrrry folks

can you share how to access it on local pc

We are phasing out dedicated-hardware grants. But if you'd like you can adapt the demo to not use llama.cpp via DOcker, and rather direct Transformers, and with that you can use ZeroGPU, which I can grant: https://huggingface.co/docs/hub/en/spaces-zerogpu.

You can use Gradio Server for a custom UI https://huggingface.co/blog/introducing-gradio-server

Owner

can you share how to access it on local pc

Everything is in Dockfile https://huggingface.co/spaces/mikeee/qwen-7b-chat/blob/main/Dockerfile, and nothing else. You do need at least a T4 though, otherwise it will be too slow to be useful.

Sign up or log in to comment