Quantized Llama 3.1
updated
kaitchup/Meta-Llama-3.1-8B-Instruct-autoround-gptq-4bit-sym
Text Generation • 8B • Updated • 26
• 1
kaitchup/Meta-Llama-3.1-8B-Instruct-awq-4bit
Text Generation • 8B • Updated • 11
• 1
kaitchup/Meta-Llama-3.1-8B-awq-4bit
Text Generation • 8B • Updated • 6
kaitchup/Meta-Llama-3.1-8B-Instruct-gptq-4bit
Text Generation • 8B • Updated • 21
kaitchup/Meta-Llama-3.1-8B-Instruct-autoround-gptq-4bit-asym
Text Generation • 8B • Updated • 12
• 1
kaitchup/Meta-Llama-3.1-8B-autoround-gptq-4bit-asym
Text Generation • 8B • Updated • 9
kaitchup/Meta-Llama-3.1-8B-bnb-4bit
Text Generation • 8B • Updated • 3
kaitchup/Meta-Llama-3.1-8B-Instruct-bnb-4bit
Text Generation • 8B • Updated • 6
kaitchup/Meta-Llama-3.1-8B-autoround-gptq-4bit-sym
Text Generation • 8B • Updated • 13
kaitchup/Meta-Llama-3.1-8B-gptq-4bit
Text Generation • 8B • Updated • 6