Is the BF16 noticeably better?
#1
by
BingoBird
- opened
2x24GB gang here - is there advantage to running B16?
Thank you for making these quants. I guess the window before unsloth got around to it was narrow.
Of course. Hopefully it provided some help for a bit. Re: B16 - I don't know... haven't tested. I primarily created that to build the other quants from and haven't used it. If you end up using, I'd be interested to hear if you notice any difference.