nm-testing/Llama-3.2-1B-Instruct-GPTQ-nonuniform
0.7B • Updated
• 4
NM Testing
company
AI & ML interests
None defined yet.
Recent Activity
View all activity
nm-testing/debug-gsm8k-autogptq_unpacked
8B • Updated
nm-testing/Llama-3_1-8B_2of4_w4a16_gsm8k_256_8196_damp0_1_mse_llm_compressor
2B • Updated
nm-testing/Llama-3_1-8B__w4a16_gsm8k_256_8196_damp0_1_noactorder_autogptq
8B • Updated
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-quantized.w4a16-uncompressed
2B • Updated
nm-testing/yolov8-m_pytorch_ultralytics_voc_pruned80_quant-none
Updated
nm-testing/mobilenet_v1-1.0_pytorch_sparseml_imagenet_pruned-moderate
Updated
nm-testing/Llama-3.2-1B-Instruct-FP8-KV
1B • Updated
nm-testing/llava-1.5-7b-hf-FP8-dynamic
7B • Updated
nm-testing/Llama-3.2-1B-Instruct-HQQ
0.8B • Updated
• 6
nm-testing/TinyLlama-1.1B-Chat-v1.0-pruned_50.2of4-INT8-compressed
0.6B • Updated
nm-testing/llava-onevision-qwen2-7b-ov-hf-FP8-dynamic
8B • Updated
• 62 • 1
nm-testing/Qwen2-VL-7B-Instruct-FP8-dynamic
8B • Updated
• 144 • 1
nm-testing/Qwen2-VL-7B-Instruct-FP8-dynamic-all
8B • Updated
nm-testing/paligemma-3b-mix-224-FP8-dynamic
3B • Updated
nm-testing/TinyLlama-1.1B-Chat-v1.0-pruned_50.2of4-compressed
0.7B • Updated
nm-testing/Sparse-Llama-3.1-8B-gsm8k-2of4-quantized.w4a16
2B • Updated
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-FP8
8B • Updated
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-quantized.w8a8
8B • Updated
nm-testing/TinyLlama-1.1B-Chat-v1.0-pruned_50.2of4-uncompressed
1B • Updated
nm-testing/SparseLlama-3-8B-pruned_50.2of4_Fp8-compressed
5B • Updated
nm-testing/Phi-3.5-vision-instruct-W8A8-Dynamic-Per-Token
4B • Updated
• 5
nm-testing/Phi-3.5-vision-instruct-FP8-dynamic
4B • Updated
• 125
nm-testing/MiniCPM-V-2_6-FP8-dynamic
8B • Updated
nm-testing/tinyllama-one-shot-w4a16-group-packed
Text Generation • 0.3B • Updated
• 4
nm-testing/llama1.1b_0.5_sparse_bitmask
Text Generation • 0.8B • Updated
nm-testing/llama7b-one-shot-2_4-w4a16-packed
Text Generation • 1B • Updated
• 1
nm-testing/tinyllama-one-shot-w4a16-group128-packed
Text Generation • 0.3B • Updated
• 7
nm-testing/tinyllama-one-shot-w4a16-channel-packed
Text Generation • 0.3B • Updated
• 5
nm-testing/tinyllama-one-shot-w4a16-channel-compressed
Text Generation • 1B • Updated
• 3