Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
androiddrew
/
Devstral-Small-2-24B-Instruct-2512-AWQ-4bit
like
0
Safetensors
vllm
mistral3
mistral-common
compressed-tensors
arxiv:
2501.19399
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
1
Copy to bucket
new
New discussion
New pull request
Resources
PR & discussions documentation
Code of Conduct
Hub documentation
All
Discussions
Pull requests
View closed (0)
Sort: Recently created
AWQ 4-bit produces repetitive gibberish on long outputs with vLLM v0.15.1 — same bug as cyankiwi variant
#1 opened 4 months ago by
BigBlueWhale
