Krishna Teja Chitty-Venkata

krishnateja95's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

updated 9 models 3 days ago

inference-optimization/Llama-3.1-8B-Instruct-QKV-Cache-FP8-Per-Head

8B • Updated 3 days ago • 25

inference-optimization/Llama-3.1-8B-Instruct-Mixed-NVFP4-FP8_DYNAMIC-gate_up_proj-all

7B • Updated 3 days ago • 12

inference-optimization/Llama-3.1-8B-Instruct-Mixed-NVFP4-FP8_DYNAMIC-down_proj-all

6B • Updated 3 days ago • 12

inference-optimization/Llama-3.1-8B-Instruct-Mixed-NVFP4-FP8_DYNAMIC-qkv_proj-all

5B • Updated 3 days ago • 16

inference-optimization/Llama-3.1-8B-Instruct-Mixed-NVFP4-FP8_DYNAMIC-out_proj-all

5B • Updated 3 days ago • 8

inference-optimization/Llama-3.1-8B-Instruct-Mixed-NVFP4-FP8_BLOCK-gate_up_proj-all

7B • Updated 3 days ago • 16

inference-optimization/Llama-3.1-8B-Instruct-Mixed-NVFP4-FP8_BLOCK-down_proj-all

6B • Updated 3 days ago • 15

inference-optimization/Llama-3.1-8B-Instruct-Mixed-NVFP4-FP8_BLOCK-qkv_proj-all

5B • Updated 3 days ago • 14

inference-optimization/Llama-3.1-8B-Instruct-Mixed-NVFP4-FP8_BLOCK-out_proj-all

5B • Updated 3 days ago • 15

updated a collection 3 days ago

Mixed Precision Models

Collection

Collection of Mixed Precision LLaMA and Qwen Models • 8 items • Updated 3 days ago

published 3 models 3 days ago

inference-optimization/Llama-3.1-8B-Instruct-Mixed-NVFP4-FP8_DYNAMIC-gate_up_proj-all

7B • Updated 3 days ago • 12

inference-optimization/Llama-3.1-8B-Instruct-Mixed-NVFP4-FP8_DYNAMIC-down_proj-all

6B • Updated 3 days ago • 12

inference-optimization/Llama-3.1-8B-Instruct-Mixed-NVFP4-FP8_DYNAMIC-qkv_proj-all

5B • Updated 3 days ago • 16