RedHatAI/granite-3.1-8b-instruct-quantized.w8a8
Text Generation • 8B • Updated
• 109 • 2
Granite Quantized
Quantized Granite models from IBM Research.
-
-
RedHatAI/granite-3.1-2b-base-quantized.w8a8
Text Generation • 3B • Updated • 7 -
RedHatAI/granite-3.1-8b-instruct-quantized.w4a16
Text Generation • 1B • Updated • 633 • 1 -
RedHatAI/granite-3.1-2b-instruct-quantized.w8a8
Text Generation • 3B • Updated • 7 -
RedHatAI/granite-3.1-8b-base-quantized.w8a8
Text Generation • 8B • Updated • 77 -
RedHatAI/granite-3.1-2b-instruct-quantized.w4a16
Text Generation • 0.5B • Updated • 36 -
RedHatAI/granite-3.1-8b-base-quantized.w4a16
Text Generation • 1B • Updated • 20 • 1 -
RedHatAI/granite-3.1-8b-instruct-FP8-dynamic
Text Generation • 8B • Updated • 28 • 1 -
RedHatAI/granite-3.1-2b-instruct-FP8-dynamic
Text Generation • 3B • Updated • 5 -
RedHatAI/granite-3.1-2b-base-FP8-dynamic
Text Generation • 3B • Updated • 1 -
RedHatAI/granite-3.1-2b-base-quantized.w4a16
Text Generation • 0.5B • Updated • 24 -
RedHatAI/granite-3.1-8b-base-FP8-dynamic
Text Generation • 8B • Updated • 1 -
ibm-granite/granite-4.0-h-small
Text Generation • Updated • 51.5k • 298 -
ibm-granite/granite-4.0-h-tiny
Text Generation • Updated • 15.6k • 191 -
ibm-granite/granite-3.3-8b-instruct
Text Generation • 8B • Updated • 52.2k • 152 -
RedHatAI/granite-4.0-h-small-FP8-dynamic
Text Generation • 32B • Updated • 622 • 1 -
RedHatAI/granite-4.0-h-tiny-FP8-dynamic
Text Generation • 7B • Updated • 395 • 2