Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21,100

Base only

Active filters: gguf-my-repo

jerkar/Qwen3.8-27B-INT8-W8A16-MTP-Q4_K_S-GGUF

Image-Text-to-Text • 27B • Updated 11 days ago • 4.74k • 6

theresa00l/Qwen3.8-27B-Uncensored-FP8-Q4_K_M-GGUF

Image-Text-to-Text • 27B • Updated 9 days ago • 9.13k • 13

saga404/Qwen3.8-9B-heretic-uncensored-Q5_0-GGUF

Text Generation • 9B • Updated 8 days ago • 4.18k • 4

optionalAI/Qwen3.8-9B-heretic-uncensored-Q4_K_M-GGUF

Text Generation • 9B • Updated 7 days ago • 8.39k • 3

paultimothymooney/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 18, 2024 • 13.2k • 9

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 11.5k • 287

jsfs11/MixtureofMerges-MoE-4x7b-v10-mixtralv0.3-GGUF

24B • Updated May 28, 2024 • 16 • 1

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 27.2k • 39

ggml-org/Qwen2.5-Coder-1.5B-Q8_0-GGUF

Text Generation • 2B • Updated Oct 28, 2024 • 4.59k • 21

ggml-org/Qwen2.5-Coder-7B-Q8_0-GGUF

Text Generation • 8B • Updated Oct 28, 2024 • 2.54k • 12

TouchNight/qwen2.5-14B-roleplay-zh-Q4_K_M-GGUF

15B • Updated Nov 11, 2024 • 652 • 6

localattention/ShowUI-2B-Q4_K_M-GGUF

2B • Updated Jan 9, 2025 • 44 • 4

hellork/BlenderLLM-IQ3_XXS-GGUF

Text-to-3D • 8B • Updated Feb 2, 2025 • 261 • 8

Aldaris/gemma-3-4b-it-Q4_K_M-GGUF

Image-Text-to-Text • 4B • Updated Mar 14, 2025 • 1.92k • 5

Aldaris/Qwen3-14B-Q4_K_M-GGUF

Text Generation • 15B • Updated Apr 29, 2025 • 5.99k • 9

jfiekdjdk/Qwen3-8B-abliterated-Q5_K_M-GGUF

Text Generation • 8B • Updated Apr 30, 2025 • 357 • 2

sizzlebop/MiniCPM4-8B-Q5_K_S-GGUF

Text Generation • 8B • Updated Jun 9, 2025 • 25 • 1

maerong3/Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-Q4_K_M-GGUF

Image-Text-to-Text • 24B • Updated Aug 6, 2025 • 730 • 4

Vortex5/Dreamstar-12B-Q6_K-GGUF

12B • Updated Nov 15, 2025 • 20 • 1

wareef/Qwen3-VL-8B-Instruct-Q4_K_M-GGUF

Image-Text-to-Text • 8B • Updated Nov 19, 2025 • 2.24k • 3

Sangto/HY-MT1.5-7B-Q4_K_M-GGUF

Translation • 8B • Updated Dec 30, 2025 • 54 • 1

jfiekdjdk/Qwen3-VL-Embedding-2B-Q8_0-GGUF

2B • Updated Jan 8 • 174 • 6

cs2764/GLM-4.7-PRISM-Q8_0-GGUF

Text Generation • 353B • Updated Jan 31 • 12 • 2

sillykiwi/Qwen3-4B-Cybersecurity-Heretic-16bit-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 3 • 1.29k • 11

ShadowOkami/gemma-4-E2B-it-Uncensored-MAX-Q4_K_M-GGUF

Any-to-Any • 5B • Updated Apr 24 • 501 • 4

brunopio/Qwen3.5-14B-A3B-Claude-4.6-Opus-Reasoning-Distilled-reap-Q4_K_M-GGUF

Text Generation • 14B • Updated May 26 • 7.54k • 18

akpsahan/AceReason-Nemotron-14B-Q4_K_M-GGUF

Text Generation • 15B • Updated May 12 • 8.24k • 1

BoneMangler/Qwen3-Coder-42B-A3B-Instruct-TOTAL-RECALL-MASTER-CODER-M-512k-ctx-W4A16-Q8_0-GGUF

Text Generation • 42B • Updated Jun 17 • 60 • 1

Kraekin/Gemma-4-26B-A4B-StyleTune-V2-Q4_K_M-GGUF

Text Generation • 26B • Updated Jun 20 • 202 • 2

mitkox/rlm-qwen3-8b-v0.1-Q4_K_M-GGUF

8B • Updated Jun 22 • 1.51k • 3