Update README.md
Browse files
README.md
CHANGED
|
@@ -158,8 +158,11 @@ python3 -m sglang.launch_server \
|
|
| 158 |
|
| 159 |
### LightLLM
|
| 160 |
```shell
|
| 161 |
-
# Install lightllm (Recommended to use Docker
|
| 162 |
-
|
|
|
|
|
|
|
|
|
|
| 163 |
|
| 164 |
LIGHTLLM_TRITON_AUTOTUNE_LEVEL=1 LOADWORKER=18 \
|
| 165 |
python3 -m lightllm.server.api_server \
|
|
|
|
| 158 |
|
| 159 |
### LightLLM
|
| 160 |
```shell
|
| 161 |
+
# Install lightllm (Recommended to use Docker).
|
| 162 |
+
docker pull jyily/lightllm:cu129-78cc66a
|
| 163 |
+
|
| 164 |
+
# Or build from [source](https://github.com/ModelTC/LightLLM)
|
| 165 |
+
pip install git+https://github.com/ModelTC/LightLLM
|
| 166 |
|
| 167 |
LIGHTLLM_TRITON_AUTOTUNE_LEVEL=1 LOADWORKER=18 \
|
| 168 |
python3 -m lightllm.server.api_server \
|