Official GGUF models uploaded
Thanks for creating GGUF versions of the models! I noticed a small issue with the conversion - the chat template wasn't included in the model so LMStudio didn't work with them well.
We uploaded GGUF conversions of the models here with imatrix-quantizations and the correct chat template:
https://huggingface.co/dicta-il/DictaLM-3.0-24B-Thinking-GGUF
https://huggingface.co/dicta-il/DictaLM-3.0-1.7B-Thinking-GGUF
Thank you for releasing official gguf.
I was excited to test the gguf conversion, so I couldn't wait.
Please share the best LM studio configurations so others can reuse them.
I have a private repository using Diktabert-Joint with Phonikud-TTS and PiperHeHe voices.
Feel free to call if you want to review the code.
http://cv.clk.al is my CV.
http://date.clk.al to schedule a meeting.
I live in Israel, and as a poet, I find dicta tools handy.