Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

125

Base only

Active filters: bnb-my-repo

medmekk/DeepSeek-R1-Distill-Qwen-1.5B-bnb-4bit

Feature Extraction • 2B • Updated Mar 19, 2025 • 6

medmekk/bloom-3b-bnb-4bit

Text Generation • 3B • Updated Mar 19, 2025 • 11

medmekk/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • 3B • Updated Mar 19, 2025 • 11

medmekk/Llama-3.1-8B-Instruct-2

Text Generation • 8B • Updated Mar 19, 2025 • 12

medmekk/Llama-3.1-Nemotron-70B-Instruct-HF-bnb-4bit

Text Generation • 72B • Updated Mar 19, 2025 • 11

medmekk/Llama-3.2-1B-Instruct-bnb-4bit

Text Generation • 1B • Updated Mar 19, 2025 • 13

kimleang123/Qwen2.5-72B-Instruct-bnb-4bit

Text Generation • 21B • Updated Apr 30, 2025 • 14

kimleang123/Qwen2.5-72B-Instruct-bnb

Text Generation • 21B • Updated Mar 19, 2025 • 12

kimleang123/Qwen2.5-14B-bnb-4bit

Text Generation • 4B • Updated Apr 30, 2025 • 14

kimleang123/Mistral-Nemo-Base-2407-bnb-4bit

12B • Updated Mar 19, 2025 • 12

kimleang123/QwQ-32B-bnb-4bit

Text Generation • 10B • Updated Mar 20, 2025 • 8

wkplhc/QwQ-32B-bnb-4bit

Text Generation • 33B • Updated Mar 20, 2025 • 10

kimleang123/Mixtral-8x7B-v0.1-bnb-4bit

13B • Updated Mar 20, 2025 • 12

marcsun13/Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • 8B • Updated Mar 20, 2025 • 11

bnb-community/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • 3B • Updated Mar 20, 2025 • 10

medmekk/isrt

Text Generation • 0.5B • Updated Mar 20, 2025 • 12

medmekk/serere

Text Generation • 33B • Updated Mar 20, 2025 • 11

bnb-community/Qwen2.5-0.5B-bnb-4bit

Text Generation • 0.5B • Updated Mar 20, 2025 • 12

bnb-community/Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • 8B • Updated Mar 20, 2025 • 12

bnb-community/Llama-3.1-8B-bnb-4bit

Text Generation • 8B • Updated Mar 20, 2025 • 14

bnb-community/QwQ-32B-bnb-4bit

Text Generation • 33B • Updated Mar 20, 2025 • 12

bnb-community/Llama-3.2-1B-bnb-4bit

Text Generation • 1B • Updated Mar 20, 2025 • 11

bnb-community/Llama-3.2-1B-Instruct-bnb-4bit

Text Generation • 1B • Updated Mar 20, 2025 • 13

bnb-community/DeepSeek-R1-Distill-Qwen-1.5B-bnb-4bit

Feature Extraction • 2B • Updated Mar 20, 2025 • 18

bnb-community/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit

Feature Extraction • 33B • Updated Mar 20, 2025 • 11

bnb-community/Qwen2.5-0.5B-Instruct-bnb-4bit

Text Generation • 0.5B • Updated Mar 20, 2025 • 10

bnb-community/Qwen2.5-Coder-0.5B-Instruct-bnb-4bit

Text Generation • 0.5B • Updated Mar 20, 2025 • 10

bnb-community/phi-4-bnb-4bit

Text Generation • 15B • Updated Mar 20, 2025 • 15

vinhnx90/facebook-opt-350m-vinhnx90-love_poems-bnb-4bit

Feature Extraction • 0.1B • Updated Mar 20, 2025 • 7

ginipick/QwQ-32B-NF4

Text Generation • 33B • Updated Mar 21, 2025 • 11 • 30