How to use from
LemonadeRun and chat with the model
lemonade run user.Rumi-Q8_0List all available models
lemonade listQuick Links
- Downloads last month
- 6
Hardware compatibility
Log In to add your hardware
8-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Pull the model
# Download Lemonade from https://lemonade-server.ai/lemonade pull ondeinference/Rumi:Q8_0