Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,969

Base only

Active filters: llama-cpp

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 18 • 557k • • 1.25k

prism-ml/Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 17 • 637k • 811

Jackrong/Qwen-Tool-Calling-Template-Fix

Text Generation • Updated 4 days ago • 1 • 13

douyamv/Qwen3.8-27B-abliterated-GGUF

Text Generation • Updated 13 days ago • 12

ge525/Qwen3.8-9B-Distill-uncensored-heretic-Q4_K_M-GGUF

Text Generation • 9B • Updated 4 days ago • 4.62k • 8

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 11.4k • 292

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated Jun 8 • 53.5k • 169

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 266k • 145

jica98/qwen3.5-4B-super-coder

Text Generation • 4B • Updated Jun 27 • 31.7k • 77

chenyumo/moziAI-35B-A3B-MOE-MTP-Uncensored

Text Generation • 35B • Updated about 22 hours ago • 4.95k • 5

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 93.9k • 772

gaston-parravicini/LFM2.5-8B-A1B-Uncensored-Gaston-GGUF

Text Generation • 8B • Updated May 30 • 19.6k • 26

Abiray/OvisOCR2-GGUF

Image-Text-to-Text • 0.8B • Updated Jul 13 • 11.3k • 26

alztrk/Ornith-1.5-35B-A3B-Abliterated

Text Generation • 35B • Updated 8 days ago • 3.82k • 8

paultimothymooney/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 18, 2024 • 14.9k • 9

Tesslate/OmniCoder-9B-GGUF

9B • Updated Mar 12 • 6.84k • 334

audarai/Audar-ASR-V1-Turbo

Automatic Speech Recognition • 2B • Updated 7 days ago • 1.24k • 11

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated Jun 13 • 17k • 142

cygnal/Qwen3.8-27B-heretic-ara-Q4_K_M-MTP-GGUF

Image-Text-to-Text • 27B • Updated 7 days ago • 31.9k • 7

theresa00l/Qwen3.8-27B-Uncensored-FP8-Q4_K_M-GGUF

Image-Text-to-Text • 27B • Updated 12 days ago • 11.4k • 14

asjadilahi/danAI-55M-Reasoning

Text Generation • 54.5M • Updated 1 day ago • 607 • 11

Blackfrost-Research/Qwen-3.8-2.4T-A95B-Derisked-IQ1_0-GGUF

Text Generation • 2.4T • Updated 1 day ago • 44 • 2

AeroxLabs/Aerova-Nova-2.5B-GGUF

Text Generation • 7B • Updated 3 days ago • 120 • 2

alztrk/Ornith-1.5-35B-A3B-Abliterated-GGUF

Text Generation • 35B • Updated 8 days ago • 8.14k • 3

OliviaRossi/Qwopus-KAT-Coder-35B-Merged-GGUF

Text Generation • 36B • Updated about 5 hours ago • 291 • 2

filvyb/Llama3-8b-CunnyGPT-16bit-Q8_0-GGUF

8B • Updated Jun 21, 2024 • 36 • 7

joshnader/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 5.98k • 10

hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 59.4k • 31

ggml-org/Qwen2.5-Coder-7B-Q8_0-GGUF

Text Generation • 8B • Updated Oct 28, 2024 • 2.6k • 12

localattention/ShowUI-2B-Q4_K_M-GGUF

2B • Updated Jan 9, 2025 • 50 • 4