neuralmagic/Llama-3.2-3B-Instruct-quantized.w8a8
Text Generation • 4B • Updated • 1.02k
Neural Magic
company
Verified
AI & ML interests
LLMs, optimization, compression, sparsification, quantization, pruning, distillation, NLP, CV
dsikka
updated a
model 12 months ago
dsikka
published a
model 12 months ago
Breaking change in transformers
1
#1 opened about 1 year ago
by 
maldv
nm-research
updated 3
models about 1 year ago
Update preprocessor_config.json
2
#4 opened over 1 year ago
by 
ManishThota
nm-research
updated 5
models about 1 year ago
RedHatAI/Qwen2.5-VL-72B-Instruct-quantized.w4a16
Image-Text-to-Text • 74B • Updated • 367 • 8
RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w4a16
Image-Text-to-Text • 8B • Updated • 3.36k • 8
RedHatAI/Qwen2.5-VL-3B-Instruct-FP8-dynamic
Image-Text-to-Text • 4B • Updated • 61k • 3
RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w8a8
Image-Text-to-Text • 4B • Updated • 107k • 2
RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w4a16
Image-Text-to-Text • 4B • Updated • 116k • 4
shubhrapandit
updated 6
models over 1 year ago
RedHatAI/Pixtral-Large-Instruct-2411-hf-quantized.w4a16
Image-Text-to-Text • 125B • Updated • 26
RedHatAI/Pixtral-Large-Instruct-2411-hf-quantized.w8a8
Image-Text-to-Text • 124B • Updated • 16
RedHatAI/Pixtral-Large-Instruct-2411-hf-FP8-dynamic
Image-Text-to-Text • 124B • Updated • 95 • 1
RedHatAI/Qwen2-VL-72B-Instruct-quantized.w4a16
Image-Text-to-Text • 74B • Updated • 15
RedHatAI/Qwen2-VL-72B-Instruct-quantized.w8a8
Image-Text-to-Text • 73B • Updated • 24
RedHatAI/Qwen2-VL-72B-Instruct-FP8-dynamic
Image-Text-to-Text • 73B • Updated • 43