Collection of Quantized Models for MoE
Krishna Teja Chitty-Venkata
krishnateja95
AI & ML interests
LLM Optimization, Neural Architecture Search, Quantization, Pruning
Recent Activity
updated
a model about 2 hours ago
inference-optimization/Llama-3.1-8B-Instruct-6-bits published
a model about 2 hours ago
inference-optimization/Llama-3.1-8B-Instruct-6-bits updated
a model 1 day ago
RedHatAI/sarvam-105b-FP8-Dynamic Organizations
models 57
krishnateja95/llama_3_2_11b_lora_nas_vsr_qkvogudfc_64
Updated
krishnateja95/llama_3_2_11b_lora_nas_vsr_gud_64
Updated
krishnateja95/llama_3_2_11b_lora_nas_vsr_gud_64_searched
Updated
• 4
krishnateja95/llama_3_2_11b_lora_nas_vsr_qkvogudfc_64_searched
Updated
• 3
krishnateja95/llama_3_2_11b_lora_nas_vsr_qk_64
Updated
• 1
krishnateja95/llama_3_2_11b_lora_nas_vsr_qk_64_searched
Updated
krishnateja95/llama_3_2_11b_lora_nas_hitab_qkvogudfc_64
Updated
• 1
krishnateja95/llama_3_2_11b_lora_nas_hitab_qkvogudfc_64_searched
Updated
krishnateja95/llama_3_2_11b_lora_nas_hitab_gud_64
Updated
krishnateja95/llama_3_2_11b_lora_nas_hitab_qk_64
Updated
• 1