infosave commited on
Commit
4fa8278
Β·
verified Β·
1 Parent(s): fca9023

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +31 -4
README.md CHANGED
@@ -58,10 +58,8 @@ give it a first and/or last frame and it continues from there. The release's
58
  third path β€” `ref2va`, conditioning on reference images, clips and audio β€” is
59
  not ported.
60
 
61
- | file | size | what differs |
62
- |---|---|---|
63
- | `mmh3-turbo-fl2va-q4tp.cmf` | 23.94 GB | every projection at 4 bits |
64
- | `mmh3-turbo-fl2va-q2tp.cmf` | 18.74 GB | the gate/up planes at 2 |
65
 
66
  ## Keyframe to video
67
 
@@ -168,6 +166,35 @@ RAM at least the file's size β€” 24 GB β€” or every step faults on non-resident
168
  pages; the weights are memory-mapped, not read. Disk: 24 GB. A GPU is optional
169
  and wants ~14 GB of VRAM for the DiT's planes. No network access at run time.
170
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
171
  ## What it costs to run
172
 
173
  The file is memory-mapped, so plan on RAM at least its size or every step
 
58
  third path β€” `ref2va`, conditioning on reference images, clips and audio β€” is
59
  not ported.
60
 
61
+ One file: `mmh3-turbo-fl2va-q4tp.cmf`, 23.94 GB, every projection at
62
+ four bits. A two-bit build exists and is **not** published β€” see below.
 
 
63
 
64
  ## Keyframe to video
65
 
 
166
  pages; the weights are memory-mapped, not read. Disk: 24 GB. A GPU is optional
167
  and wants ~14 GB of VRAM for the DiT's planes. No network access at run time.
168
 
169
+ ## Two bits was tried, and it is not shipped
170
+
171
+ The obvious next cut is the DeepSeek-V4 policy: gate/up at two bits,
172
+ everything else at four. It builds β€” 23.94 GB down to **18.74**, and
173
+ with a device kernel of its own it renders *faster* than the four-bit
174
+ file (217.3 s against 258.4, because there is less weight to move).
175
+ `cortiq verify` passes.
176
+
177
+ It also stops following the prompt.
178
+
179
+ | | |
180
+ |---|---|
181
+ | ![four bits](https://huggingface.co/infosave/MiniMax-H3-Turbo-cmf/resolve/main/samples/ab_q4tp.gif) | ![two bits](https://huggingface.co/infosave/MiniMax-H3-Turbo-cmf/resolve/main/samples/ab_q2tp.gif) |
182
+ | `q4tp` β€” 23.94 GB, 258.4 s | `q2tp` β€” 18.74 GB, 217.3 s |
183
+
184
+ Same prompt, same seed, same four steps. On the left the corgi is behind
185
+ a pan with batter in it, drawn flat and clean, which is what was asked
186
+ for. On the right it is a different animal in a different style with
187
+ **no pan and no pancake at all**, over a washed-out ground with visible
188
+ texture noise. That is not a quantizer trading detail for size; that is
189
+ a model answering a different question.
190
+
191
+ The likely culprit is where the two bits landed. Half this file is the
192
+ PROMPT ENCODER, and the policy put two bits on its gate/up planes along
193
+ with the DiT's β€” so the loss falls on the part that decides what the
194
+ clip is about, not on the part that draws it. A two-bit build confined
195
+ to the DiT would save ~2.9 GB instead of 5.2 and is the version worth
196
+ measuring next. Until someone does, four bits is what ships.
197
+
198
  ## What it costs to run
199
 
200
  The file is memory-mapped, so plan on RAM at least its size or every step