Inference Optimization

community

AI & ML interests

None defined yet.

Recent Activity

krishnateja95 updated a collection about 5 hours ago

krishnateja95 updated a collection about 5 hours ago

krishnateja95 updated a collection about 5 hours ago

View all activity

inference-optimization 's models 336

inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_hybrid

3B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_heuristic

3B • Updated Mar 12 • 2

inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_noise

3B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_hybrid

3B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_heuristic

3B • Updated Mar 12 • 7

inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_noise

3B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_hybrid

3B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-1B-Instruct_7_bits_mode_noise

1B • Updated Mar 12 • 2

inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_noise

1B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_hybrid

1B • Updated Mar 12 • 2

inference-optimization/Llama-3.2-1B-Instruct_6_bits_mode_noise

1B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-1B-Instruct_6_bits_mode_hybrid

1B • Updated Mar 12 • 2

inference-optimization/Llama-3.2-1B-Instruct_5.5_bits_mode_heuristic

1B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-1B-Instruct_5.5_bits_mode_noise

1B • Updated Mar 12 • 3

inference-optimization/Llama-3.2-1B-Instruct_5.5_bits_mode_hybrid

1B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-1B-Instruct_5_bits_mode_heuristic

1B • Updated Mar 12 • 2

inference-optimization/Llama-3.2-1B-Instruct_5_bits_mode_noise

1B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-1B-Instruct_5_bits_mode_hybrid

1B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-1B-Instruct_7_bits_mode_heuristic

1B • Updated Mar 12 • 2

inference-optimization/Llama-3.2-1B-Instruct_7_bits_mode_hybrid

1B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_heuristic

1B • Updated Mar 12 • 5

inference-optimization/Llama-3.2-1B-Instruct_6_bits_mode_heuristic

1B • Updated Mar 12 • 3

inference-optimization/Qwen3-8B_7_bits_mode_heuristic

7B • Updated Mar 12 • 1

inference-optimization/Qwen3-8B_7_bits_mode_noise

7B • Updated Mar 12 • 1

inference-optimization/Qwen3-8B_7_bits_mode_hybrid

7B • Updated Mar 12 • 1

inference-optimization/Qwen3-8B_6.5_bits_mode_heuristic

7B • Updated Mar 12 • 2

inference-optimization/Qwen3-8B_6.5_bits_mode_noise

7B • Updated Mar 12 • 1

inference-optimization/Qwen3-8B_6.5_bits_mode_hybrid

7B • Updated Mar 12 • 2

inference-optimization/Qwen3-8B_6_bits_mode_heuristic

7B • Updated Mar 12 • 2

inference-optimization/Qwen3-8B_6_bits_mode_noise

7B • Updated Mar 12 • 9