RedHatAI
/

Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation

4-bit precision

compressed-tensors

text-generation-inference

4-bit precision

Model card Files Files and versions

Resources

View closed (2)

Request: DOI

#3 opened 8 months ago by

Issue with loading model

#1 opened over 1 year ago by