Wrong naming. Not DWQ, nor 4bit, but a regular 8 bit quant.
#1
by
m-i
- opened
You can see it in the config.json
Yes, checking this later today and uploading the right file.
4bit version creation started! It should be live tomorrow.
Fixed! 4bit version is now live.
ivanfioravanti
changed discussion status to
closed