Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
Mixtral-8x7B-v0.1-quantized.w4a16
like
0
Follow
Red Hat AI
1.75k
Safetensors
English
mixtral
Mixture of Experts
w4a16
int4
vllm
compressed-tensors
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
main
Mixtral-8x7B-v0.1-quantized.w4a16
24.5 GB
2 contributors
History:
3 commits
nm-research
Add recipe.yaml
4cabe12
verified
10 months ago
.gitattributes
1.52 kB
initial commit
12 months ago
README.md
7.48 kB
add model
12 months ago
config.json
54.1 kB
add model
12 months ago
generation_config.json
111 Bytes
add model
12 months ago
model-00001-of-00005.safetensors
4.99 GB
xet
add model
12 months ago
model-00002-of-00005.safetensors
4.97 GB
xet
add model
12 months ago
model-00003-of-00005.safetensors
5 GB
xet
add model
12 months ago
model-00004-of-00005.safetensors
5 GB
xet
add model
12 months ago
model-00005-of-00005.safetensors
4.52 GB
xet
add model
12 months ago
model.safetensors.index.json
278 kB
add model
12 months ago
recipe.yaml
364 Bytes
Add recipe.yaml
10 months ago
special_tokens_map.json
414 Bytes
add model
12 months ago
tokenizer.json
3.51 MB
add model
12 months ago
tokenizer_config.json
995 Bytes
add model
12 months ago