Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
ManniX-ITAΒ 
posted an update 1 day ago
Post
91
πŸš€ Two drops: the Ornith-1.5-27B-A3B pair (Coder + CoderX) and Qwen3.8-27B-Omnimerge-v6.

βœ‚οΈ Ornith = code-targeted expert prune of Ornith-1.5-35B-A3B: 256β†’184 experts/layer, ~35.9Bβ†’26.7B, still A3B active. Top-8, MTP head and vision untouched. Nothing folded β€” every surviving expert is bit-identical to the base, asserted at build. Same map for both; CoderX adds a REAP-style floor (--protect 6).

πŸ“Š Q6_K + imatrix, llama.cpp, vendor sampler, 11 benches β€” base 256e / Coder / CoderX:
⚑ LiveCodeBench v6 (77 hard) β€” 0.6623 / 0.7273 / 0.7662 β†’ +10.4pp over the teacher with 28% fewer experts
🧠 GPQA-Diamond β€” 0.8283 / 0.7677 / 0.8131 β†’ the floor buys back most of what the pure map gives up
βœ… HumanEval 0.8963, AIME 0.9667, MATH-500 0.95 β†’ all CoderX
πŸ“ˆ Mean(11) β€” 0.8252 / 0.8292 / 0.8386

πŸ‘‰ Start with CoderX. Coder still takes HumanEval+ (0.8293) and LCB-medium (0.5273), so it isn't dominated.

πŸ§ͺ Omnimerge-v6: v4's sources, weights and method moved onto the Qwen3.8-27B base. Vs v4 on one binary and sampler, the only result outside the band is LiveCodeBench 0.883 vs 0.818 (68/77 vs 63/77). GPQA is 2pp lower and it thinks longer for it.

πŸ›‘οΈ Tool-calling (tool-eval-bench hardmode, 88 scenarios, 5 seeds, chart attached): v6 first of ten, 156.4 Β±3.5, +5.6 over its base. Read the safety column β€” 3 safety-critical failures vs 9–16 for every other model, bases included. All nine others fail TC-60 (cross-turn sleeper injection) 5/5; v6 never does.

⚠️ Ties are ties: at n=77 one LCB problem is 1.3pp. And the Ornith rows there are IQ4_XS vs Q4_K_M for the Qwen rows β€” part of that gap is quantisation, not architecture.

πŸ”— ManniX-ITA/Ornith-1.5-27B-A3B-CoderX-MTP-GGUF
πŸ”— https://ollama.com/mannix/ornith-1.5-27b-a3b-coderx
πŸ”— ManniX-ITA/Ornith-1.5-27B-A3B-Coder-MTP-GGUF
πŸ”— https://ollama.com/mannix/ornith-1.5-27b-a3b-coder
πŸ”— ManniX-ITA/Qwen3.8-27B-Omnimerge-v6-MTP-GGUF
πŸ”— https://ollama.com/mannix/omnimerge-v6
In this post