GLM-4.5-MLX-2bit / README.md
monirmamoun's picture
Create README.md
ae002ca verified
metadata
language:
  - en
  - zh
library_name: mlx
license: mit
pipeline_tag: text-generation
base_model: zai-org/GLM-4.5
tags:
  - GLM-4.5

MOPO Labs presents what to our knowledge is the first quantized GLM-4.5 with a 2-bit MLX format quantization that allows the original 355gb model to work on a 192GB Mac using LM Studio and other MLX compatible tools. Note this is a research build intended to learn more about the differences between the GLM-4.5 quantized lower versus the GLM-4.5 Air model; If you discover good tips, kindly share with [email protected] or on huggingface.