inference-optimization/gemma-4-1B-0.8B-tiny
1B • Updated • 88 • 2
Tiny Models
Tiny models used for testing
-
-
inference-optimization/DSV4-tiny-empty
3B • Updated • 3.79k • 1 -
inference-optimization/Qwen3-1.6B-A0.9B
Text Generation • 2B • Updated • 10.4k • 3 -
inference-optimization/Llama-3.2-0.5B-Instruct
Text Generation • 0.5B • Updated • 19k • 1 -
inference-optimization/GLM-5.2-0.8B-A0.8B
Text Generation • 0.8B • Updated • 5.47k • 4 -
inference-optimization/Phi-3.5-MoE-0.8B-A0.2B
Text Generation • 0.8B • Updated • 10 -
inference-optimization/Llama-4-Scout-1.7B-0.4B-Instruct
Image-Text-to-Text • 2B • Updated • 38 -
inference-optimization/gpt-oss-2.5B-A1.3B
3B • Updated • 12 -
inference-optimization/Qwen3-VL-1.0B-A0.4B-Instruct
Image-Text-to-Text • 1B • Updated • 54 • 1 -
inference-optimization/Inkling-0.6B-A0.6B
Image-Text-to-Text • 0.6B • Updated • 44 • 1 -
inference-optimization/DeepSeek-V4-Pro-0.5B-A0.37B
Text Generation • 0.5B • Updated • 139 -
inference-optimization/Kimi-K3-0.40B
Feature Extraction • 0.4B • Updated • 67.9k • 81 -
inference-optimization/Kimi-K3-0.40B-MXFP4
0.4B • Updated • 215 • 6 -
inference-optimization/Kimi-K3-0.40B-NVFP4
0.4B • Updated • 42 • 5 -
inference-optimization/gemma-4-unified-0.8B-tiny
0.8B • Updated • 16 -
inference-optimization/granite-vision-4.1-0.2B-tiny
0.2B • Updated • 14 -
inference-optimization/Qwen3-VL-Reranker-0.1B-tiny
98.7M • Updated • 75 -
inference-optimization/Qwen3.8-1.0B-A0.6B
Text Generation • 1.0B • Updated • 4.05k • 3 -
inference-optimization/GLM-5.3-Flash-0.1B-A0.1B
Image-Text-to-Text • 84.4M • Updated • 326 • 3 -
inference-optimization/Qwen3.8-Flash-Next-0.2B-A0.2B
Image-Text-to-Text • 0.2B • Updated • 341 • 2 -
inference-optimization/Nemotron-3.5-Lightning-1.4B-A0.1B-MTP
Text Generation • 1B • Updated