Zheng Han

traphix's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in appmana/deepseek-v4-int4-int8 8 days ago

Is there a deployment tutorial?

👍 4

1

#1 opened 8 days ago by

traphix

New activity in RedHatAI/MiniMax-M2.5-quantized.w4a16 12 days ago

Can I use the same creation script to quantize MiniMax-M2.7?

#1 opened 12 days ago by

traphix

New activity in RedHatAI/Qwen3.6-35B-A3B-NVFP4 about 1 month ago

Regarding the correctness of the int4 quantization script

1

#5 opened about 1 month ago by

traphix

Creation details?

1

#3 opened about 1 month ago by

traphix

New activity in apolo13x/Qwen3.5-27B-quantized.w4a16 about 1 month ago

Any creation details?

#1 opened about 1 month ago by

traphix

New activity in nm-testing/MiniMax-M2.5-W4A16 about 2 months ago

oneshot vs model_free_ptq? which one has better recovery?

1

#1 opened about 2 months ago by

traphix

New activity in RedHatAI/Qwen3.5-397B-A17B-FP8-dynamic about 2 months ago

W4A16 quant

👍 2

5

#1 opened 3 months ago by

timroethig

New activity in apolo13x/Qwen3.5-35B-A3B-quantized.w4a16 about 2 months ago

Any creation details?

#2 opened about 2 months ago by

traphix

New activity in RedHatAI/Qwen3.5-397B-A17B-FP8-dynamic about 2 months ago

Creation details?

1

#8 opened about 2 months ago by

traphix

New activity in RedHatAI/Qwen3.5-122B-A10B-FP8-dynamic about 2 months ago

Creation details?

#2 opened about 2 months ago by

traphix

New activity in nivvis/Qwen3.5-122B-A10B-heretic-v2-FP8 about 2 months ago

Which framework was used for FP8 quantization? LLM-compressor?

2

#1 opened about 2 months ago by

traphix

New activity in huihui-ai/Huihui-Qwen3-Coder-Next-abliterated about 2 months ago

GPTQ quantization

2

#2 opened 3 months ago by

ArtemSultanov

New activity in win10/Huihui-Qwen3.5-27B-abliterated-FP8 about 2 months ago

Which framework was used to quantize this model? llm-compressor? or Can you share the quantization Python script?

#1 opened about 2 months ago by

traphix

New activity in edp1096/Huihui-Qwen3.5-27B-abliterated-FP8 about 2 months ago

Which framework was used to quantize this model? llm-compressor? or Can you share the quantization Python script?

1

#2 opened about 2 months ago by

traphix

New activity in inference-optimization/Qwen3-Coder-Next.w4a16 2 months ago

Question about weight_observer？

2

#1 opened 2 months ago by

traphix

New activity in RedHatAI/MiniMax-M2.5 3 months ago

INT4 w4a16 quantinization？

➕ 1

#1 opened 3 months ago by

traphix

liked a model 3 months ago

RedHatAI/Qwen3.5-397B-A17B-FP8-dynamic

Image-Text-to-Text • 397B • Updated 23 days ago • 662 • 5

New activity in RedHatAI/Qwen3.5-397B-A17B-FP8-dynamic 3 months ago

Quantization code for int4(w4a16) ?

#6 opened 3 months ago by

traphix

liked a model 4 months ago

RedHatAI/Qwen3-Next-80B-A3B-Instruct-quantized.w4a16

Text Generation • 12B • Updated 23 days ago • 909 • 3

New activity in RedHatAI/Qwen3-Next-80B-A3B-Instruct-quantized.w4a16 4 months ago

Tokenizer you are loading with an incorrect regex pattern

1

#2 opened 5 months ago by

traphix