Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

399

Base only

Active filters: local-llm

yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF

Text Generation • 12B • Updated Jun 19 • 428k • 1.48k

yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF

Text Generation • 12B • Updated Jun 19 • 490k • 2.85k

FINAL-Bench/POCKET-26B-GGUF

Text Generation • 25B • Updated 27 days ago • 186k • 46

davisliu/Qwen3.8-27B-MXFP4-VL-MTP

Image-Text-to-Text • 6B • Updated 8 days ago • 1.05k • 2

dougeeai/llama-cpp-python-wheels

Updated Nov 9, 2025 • 12

xxbanditxx/orbit-injector

Text Generation • Updated May 8 • 1

syntropy-ai/Soren-1-Small

Text Generation • 2B • Updated May 31 • 156 • 41

AnkitAI/Parable-Qwen3-4B-Claude-Fable-5-GGUF

Text Generation • 4B • Updated 14 days ago • 368k • 15

AnkitAI/Parable-Qwen3-4B-Claude-Fable-5

Text Generation • 4B • Updated 8 days ago • 649 • 6

saidutta69/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-heretic

Text Generation • 1B • Updated 3 days ago • 12.2k • 9

saidutta69/granite-4.1-8b-heretic

Text Generation • 8B • Updated 3 days ago • 2.02k • 2

vinpix/Ternary-Bonsai-27B-Stock-MTP-GGUF

Text Generation • 29B • Updated 29 days ago • 8.03k • 8

FINAL-Bench/POCKET-EN-GGUF

Text Generation • 23B • Updated 27 days ago • 2.37k • 42

ewinregirgojr/MiniCPM5-1B-Agentic-Tooluse-v3-GGUF

Text Generation • 1B • Updated 27 days ago • 1.5k • 4

davisliu/Qwen3.6-27B-MXFP4-VL-MTP

Image-Text-to-Text • 6B • Updated 23 days ago • 193 • 1

guideboardlabs/Qwen3.8-27B-Q3-DOWN-XS-GGUF

27B • Updated 3 days ago • 141 • 1

liodon-ai/s1-mini-imatrix-GGUF

Text Generation • 0.8B • Updated 3 days ago • 177 • 1

McaTech/Nonet

Text Generation • 0.1B • Updated Jun 30, 2025 • 143 • 3

seasparks/Llama-3.1-8B-Instruct-LegalCite-gguf

Text Generation • 8B • Updated Apr 7, 2025 • 34

umar141/gemma-3-Baro-finetune-v2-gguf

4B • Updated Apr 13, 2025 • 20 • 1

umar141/gemma-3-Baro-finetune-v3-gguf

4B • Updated Apr 17, 2025 • 125

dwili/gemma3-1b-ringkasan-bahasa-indo-gguf

1.0B • Updated Jun 29, 2025 • 24 • 1

Hussain2050/GGUF-Loader

Updated Feb 7 • 1

shiv1119/ollama-model-shiv

Text Generation • Updated Jul 23, 2025

hedachi/LLM_Battle

Updated Aug 18, 2025 • 6

gpsworld/gpsworld

Text Generation • 3B • Updated Sep 2, 2025 • 1

neuralcrew/neutrino-instruct

Text Generation • 7B • Updated Jul 17 • 41.2k • 7

Manojb/Qwen3-4B-toolcalling-gguf-codex

Text Generation • 4B • Updated Sep 21, 2025 • 2.36k • 55

Manojb/Qwen-7B-toolcalling-ReSearch-gguf-Q8_0-codex

Text Generation • 8B • Updated Sep 21, 2025 • 243 • 2

Manojb/Qwen3-4b-toolcall-gguf-llamacpp-codex

Text Generation • 4B • Updated Sep 25, 2025 • 1.29k • 9