city96

/

FLUX.1-dev-gguf

like 1.31k

Hi City,
I know this isn't your league but would you mind giving a bit more info on this so we can get the latest Flux 1 community models to people without the best video cards?
I'm trying to convert a community model using the EasyQuantizationGUI by rainlizard which uses this.

To Q4_K_M, which is what my GPU can handle well.

I get this error:
Error converting file: Command '['D:\AI\EasyQuantizationGUI\venv\Scripts\python.exe', 'D:\AI\EasyQuantizationGUI\convert.py', '--src', 'D:/Quantize/getphatFLUXReality_v10.safetensors', '--dst', 'D:/Quantize\getphatFLUXReality_v10-Q4_K_M_temp_conversion.gguf']' returned non-zero exit status 3221225477.
Command: ['D:\AI\EasyQuantizationGUI\venv\Scripts\python.exe', 'D:\AI\EasyQuantizationGUI\convert.py', '--src', 'D:/Quantize/getphatFLUXReality_v10.safetensors', '--dst', 'D:/Quantize\getphatFLUXReality_v10-Q4_K_M_temp_conversion.gguf']
Return code: 3221225477

So right now I have no idea if this is because my system is simply too weak to do this or because I missed something.

I'm running a 1660Ti Mobile with 6GB VRAM and 16 GB RAM.

Thanks