IntelliCode Compose: Code Generation Using Transformer
This is an unofficial reupload of GPT-C in the SafeTensors format using transformers 4.40.1. The goal of this reupload is to prevent older models that are still relevant baselines from becoming stale as a result of changes in HuggingFace. Additionally, I may include minor corrections, such as model max length configuration.
- Downloads last month
- 125
Install from pip and serve model
# Install vLLM from pip: pip install vllm# Start the vLLM server: vllm serve "claudios/GPT-C"# Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "claudios/GPT-C", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'