Ernest Yeung's picture

Ernest Yeung

ernestyalumni

·

AI & ML interests

I'm interested in developing models directly in CUDA C++ or libNVVM. Reach out to me if you share the same interest!

Recent Activity

new activity about 13 hours ago

QuantTrio/Qwen3.5-2B-AWQ:TensorRT-LLM 1.3.0rc8 fails to load Qwen3.5-2B-AWQ with unsupported AWQ quantization_config

repliedto mitkox's post 5 months ago

Say hello to my little friends! I just unboxed this trio of HP Z2 G1a! Three is always better than one! 3x AMD Ryzen AI Max+ Pro 395 384GB RAM 24TB of RAID storage Ubuntu 24.04 ROCm 7.0.2 llama cpp, vLLM and Aibrix Small, cheap GPUs are about to become the Raspberry Pi of edge AI inference. Sprinkle some `kubectl` fairy dust on top, and suddenly it's a high-availability, self-healing, cloud-native, enterprise-grade AI cluster camping in a closet. Make sure you own your AI. AI in the cloud is not aligned with you; it’s aligned with the company that owns it.

new activity 7 months ago

nunchaku-ai/nunchaku-flux.1-dev:Nunchaku not loading .safetensor file

View all activity

Organizations

models 0

None public yet

datasets 0

None public yet