Instructions to use kernels-community/paged-attention with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Kernels
How to use kernels-community/paged-attention with Kernels:
# !pip install kernels from kernels import get_kernel kernel = get_kernel("kernels-community/paged-attention") - Notebooks
- Google Colab
- Kaggle
Update readme
Browse files
README.md
CHANGED
|
@@ -9,4 +9,4 @@ tags:
|
|
| 9 |
|
| 10 |
## attention
|
| 11 |
|
| 12 |
-
Paged attention kernels from [vLLM](https://github.com/vllm-project/).
|
|
|
|
| 9 |
|
| 10 |
## attention
|
| 11 |
|
| 12 |
+
Paged attention kernels from [vLLM](https://github.com/vllm-project/) and [mistral.rs](https://github.com/EricLBuehler/mistral.rs).
|