Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
granite-3.1-8b-instruct-quantized.w4a16
like
1
Follow
Red Hat AI
1.72k
Text Generation
Safetensors
English
granite
w4a16
int4
vllm
conversational
compressed-tensors
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
1
2c6e720
granite-3.1-8b-instruct-quantized.w4a16
4.92 GB
5 contributors
History:
17 commits
jennyyyi
Update README.md
2c6e720
verified
7 months ago
.gitattributes
1.52 kB
initial commit
11 months ago
README.md
22.2 kB
Update README.md
7 months ago
added_tokens.json
87 Bytes
Add model files
11 months ago
config.json
13.7 kB
Update model files
11 months ago
generation_config.json
132 Bytes
Update model files
11 months ago
merges.txt
442 kB
Add model files
11 months ago
model.safetensors
4.92 GB
xet
Update model files
11 months ago
recipe.yaml
336 Bytes
Update model files
11 months ago
special_tokens_map.json
701 Bytes
Add model files
11 months ago
tokenizer.json
3.48 MB
Add model files
11 months ago
tokenizer_config.json
8.07 kB
Add model files
11 months ago
vocab.json
777 kB
Add model files
11 months ago