Inference Providers
Active filters: utility
TitleOS/Lightning-1.7B-LoRA
Text Generation
• Updated Text Generation
• 2B • Updated • 21
• 4
TitleOS/Lightning-1.7B-Q4_K_M-GGUF
Text Generation
• 2B • Updated • 23
TitleOS/Lightning-1.7B-Q8_0-GGUF
Text Generation
• 2B • Updated • 40
• 2
bartowski/TitleOS_Lightning-1.7B-GGUF
Text Generation
• 2B • Updated • 909
• 2
alexgusevski/Lightning-1.7B-q2-mlx
Text Generation
• 2B • Updated • 6
alexgusevski/Lightning-1.7B-q3-mlx
Text Generation
• 2B • Updated • 12
alexgusevski/Lightning-1.7B-q4-mlx
Text Generation
• 2B • Updated • 14
alexgusevski/Lightning-1.7B-q6-mlx
Text Generation
• 2B • Updated • 9
alexgusevski/Lightning-1.7B-q8-mlx
Text Generation
• 2B • Updated • 8
alexgusevski/Lightning-1.7B-mlx
Text Generation
• 2B • Updated • 11
• 1
Text Generation
• Updated Text Generation
• 0.3B • Updated • 23
TitleOS/Spark-270M-FP16-Q4_K_M-GGUF
Text Generation
• 0.3B • Updated • 72
TitleOS/Spark-270M-FP16-Q8_0-GGUF
Text Generation
• 0.3B • Updated • 63
bradyclarke/Lightning-1.7B-mlx-fp16
Text Generation
• 2B • Updated • 23
bradyclarke/Lightning-1.7B-mlx-8Bit
Text Generation
• 2B • Updated • 12
bradyclarke/Lightning-1.7B-mlx-4Bit
Text Generation
• 2B • Updated • 8
bradyclarke/Spark-270M-FP16-mlx-fp16
Text Generation
• 0.3B • Updated • 35
bradyclarke/Spark-270M-FP16-mlx-8Bit
Text Generation
• 0.3B • Updated • 13
bradyclarke/Spark-270M-FP16-mlx-4Bit
Text Generation
• 0.3B • Updated • 17
bradyclarke/Spark-270M-FP16-mlx-6Bit
Text Generation
• 0.3B • Updated • 20
bradyclarke/Spark-270M-FP16-mlx-5Bit
Text Generation
• 0.3B • Updated • 26
bradyclarke/Lightning-1.7B-mlx-6Bit
Text Generation
• 2B • Updated • 12
bradyclarke/Lightning-1.7B-mlx-5Bit
Text Generation
• 2B • Updated • 18
bradyclarke/Spark-270M-FP16-mlx
Text Generation
• 0.3B • Updated • 3
bradyclarke/Spark-270M-FP16-mlx-mxfp4
Text Generation
• 0.3B • Updated • 8
bradyclarke/Spark-270M-FP16-mlx-nvfp4
Text Generation
• 0.3B • Updated • 14
bradyclarke/Spark-270M-FP16-mlx-mxfp8
Text Generation
• 0.3B • Updated • 20
bradyclarke/Lightning-1.7B-mlx-nvfp4
Text Generation
• 2B • Updated • 10