| | --- |
| | license: other |
| | --- |
| | |
| | NOTE: Safetensor 4bit quant will be uploaded within the day. Cheers. |
| |
|
| | This is a GPTQ 4 bit quant of ChanSung's Elina 33b. |
| | This is a LlaMa based model; LoRA merged with latest transformers conversion. |
| | Quantized with GPTQ, --wbits 4 --act-order --true-sequential --save_safetensors c4. |
| | |
| | 128 groupsize was not used so those running this on a consumer GPU with 24GB VRAM can run it at full |
| | context (2048) without any risk of OOM. |
| | |
| | |
| | Original LoRA: |
| | https://huggingface.co/LLMs/Alpaca-LoRA-30B-elina |
| | |
| | |
| | Repo: |
| | https://huggingface.co/LLMs |
| | |
| | |
| | Likely Author: |
| | https://huggingface.co/chansung |
