Instructions to use lerugray/ferney-7b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use lerugray/ferney-7b with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf lerugray/ferney-7b:Q5_K_M # Run inference directly in the terminal: llama cli -hf lerugray/ferney-7b:Q5_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf lerugray/ferney-7b:Q5_K_M # Run inference directly in the terminal: llama cli -hf lerugray/ferney-7b:Q5_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf lerugray/ferney-7b:Q5_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf lerugray/ferney-7b:Q5_K_M
Use Docker
docker model run hf.co/lerugray/ferney-7b:Q5_K_M
- Llama new
- LM Studio
- Jan
- vLLM
How to use lerugray/ferney-7b with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "lerugray/ferney-7b" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "lerugray/ferney-7b", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/lerugray/ferney-7b:Q5_K_M
- Ollama
How to use lerugray/ferney-7b with Ollama:
ollama run hf.co/lerugray/ferney-7b:Q5_K_M
- Unsloth Desktop
- Docker Model Runner
How to use lerugray/ferney-7b with Docker Model Runner:
docker model run hf.co/lerugray/ferney-7b:Q5_K_M
- Lemonade
How to use lerugray/ferney-7b with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull lerugray/ferney-7b:Q5_K_M
Run and chat with the model
lemonade run user.ferney-7b-Q5_K_M
List all available models
lemonade list
- Atomic Chat
Add model card
Browse files
README.md
ADDED
|
@@ -0,0 +1,91 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- en
|
| 4 |
+
license: cc-by-nc-4.0
|
| 5 |
+
tags:
|
| 6 |
+
- text-generation
|
| 7 |
+
- voice-model
|
| 8 |
+
- enlightenment
|
| 9 |
+
- voltaire
|
| 10 |
+
- ollama
|
| 11 |
+
- elect
|
| 12 |
+
base_model: Qwen/Qwen2.5-7B-Instruct
|
| 13 |
+
---
|
| 14 |
+
|
| 15 |
+
# ferney: Voltaire (François-Marie Arouet, 1694–1778)
|
| 16 |
+
|
| 17 |
+
> **VOICE MODEL, the author's own recorded prose.** This model trains on Voltaire's
|
| 18 |
+
> own words in public-domain English translation. It is a small model tuned to hold
|
| 19 |
+
> a voice, and it invents freely, so read it for the register, not the record.
|
| 20 |
+
|
| 21 |
+
Part of the **Elect** voice-model series: historical figures as runnable instruments.
|
| 22 |
+
Voltaire is named here for Ferney, the village on the French-Swiss border where he
|
| 23 |
+
settled and wrote in his later years.
|
| 24 |
+
|
| 25 |
+
## What this is
|
| 26 |
+
|
| 27 |
+
A fine-tuned Qwen2.5-7B-Instruct that targets the register of Voltaire: the wit, the
|
| 28 |
+
mockery of dogma and superstition, the plea for tolerance, the dry contempt for cruelty
|
| 29 |
+
dressed up as piety. It speaks in the first person, in the manner of the philosophe who
|
| 30 |
+
spent his life setting reason against fanaticism.
|
| 31 |
+
|
| 32 |
+
The model is a full fine-tune distilled to Voltaire's first-person register and
|
| 33 |
+
register-purity-filtered so it speaks as Voltaire rather than narrating about him.
|
| 34 |
+
|
| 35 |
+
## The source
|
| 36 |
+
|
| 37 |
+
The corpus is Voltaire's own prose, in public-domain English translation:
|
| 38 |
+
|
| 39 |
+
- the **Philosophical Dictionary** (the William F. Fleming translation)
|
| 40 |
+
- the **Letters on England** (also titled the *Philosophical Letters* / *Letters
|
| 41 |
+
Concerning the English Nation*)
|
| 42 |
+
- the **Treatise on Toleration**
|
| 43 |
+
|
| 44 |
+
The build keeps Voltaire's voice and drops the translators' and editors' apparatus
|
| 45 |
+
(prefaces, footnotes, third-person framing), filtering the text down to his first-person
|
| 46 |
+
register. The corpus is not bundled with these weights; it is rebuildable from the cited
|
| 47 |
+
public-domain sources.
|
| 48 |
+
|
| 49 |
+
## Example exchanges
|
| 50 |
+
|
| 51 |
+
Real outputs from this model:
|
| 52 |
+
|
| 53 |
+
> **What is philosophy?**
|
| 54 |
+
> We take opium; we call it philosophy.
|
| 55 |
+
|
| 56 |
+
> **What do you think of priests?**
|
| 57 |
+
> Sir, I am persuaded that without your priests there will be fewer murders.
|
| 58 |
+
|
| 59 |
+
> **What is war?**
|
| 60 |
+
> War is a crime committed by order of the legislature.
|
| 61 |
+
|
| 62 |
+
## Running it
|
| 63 |
+
|
| 64 |
+
Q5_K_M GGUF, served with Ollama. Pair it with the elicitation frame (a "visitor asks
|
| 65 |
+
Voltaire" template); see the `Modelfile` in the project repo. Plain chat templates
|
| 66 |
+
mis-wrap the completion register and produce rambling, so the completion frame keeps it
|
| 67 |
+
in voice.
|
| 68 |
+
|
| 69 |
+
## Intended uses
|
| 70 |
+
|
| 71 |
+
- The Elect console (Ollama serve plus chat)
|
| 72 |
+
- Enlightenment-register dialogue and character embodiment
|
| 73 |
+
- Creative and educational use; a wit-and-tolerance sparring partner
|
| 74 |
+
|
| 75 |
+
## Limitations
|
| 76 |
+
|
| 77 |
+
This is a 7B model, not a search index over Voltaire. It invents freely: names, dates,
|
| 78 |
+
quotations, sources, events. It imitates the manner of Voltaire, the epigram and the
|
| 79 |
+
ironic thrust, but the specific claims it makes are not reliable history and the
|
| 80 |
+
quotations it attributes are not to be trusted. Treat every output as fiction in his
|
| 81 |
+
voice, never as the record, and check anything before you repeat it.
|
| 82 |
+
|
| 83 |
+
## License
|
| 84 |
+
|
| 85 |
+
CC-BY-NC-4.0. The model weights (GGUF) are released publicly under this license and are
|
| 86 |
+
downloadable from this repository. The training corpus is not bundled: it is rebuildable
|
| 87 |
+
from the cited public-domain sources (the Fleming translation of the *Philosophical
|
| 88 |
+
Dictionary*, the *Letters on England*, and the *Treatise on Toleration*).
|
| 89 |
+
|
| 90 |
+
*Part of the Elect, a roster of public-domain voice and register models. Ferney is the
|
| 91 |
+
Enlightenment member.*
|