When is the new fp8 version coming?

#4
by ca231321 - opened

When is the new fp8 version coming? Curious to see how good it is.

+1 thanks for the 4 bit is awesome, the 8 bit will be sublime.

Super anxious to try this. I know there are other projects that have already integrated the 4bit. And I have tested it a good bit. While good.... I think the 8bit will work even better with greater accuracy. I have a 12 GB card. Do you need a tester by chance? I would be willing to help test it if you need.

I am getting the feeling this 8bit version is not coming any more. It's been two weeks now and nothing.

ditto~ but let's give the gentleman some more time...

please don't include 8 bit in the model card if it's not yet available

Sign up or log in to comment