GSQ-RCO-GGUF Collection GGUF models optimized with GSQ-RCO for efficient inference and minimal quality loss. • 7 items • Updated about 12 hours ago • 8
GSQ-RCO-GGUF Collection GGUF models optimized with GSQ-RCO for efficient inference and minimal quality loss. • 7 items • Updated about 12 hours ago • 8
thinkingmachines/Inkling-2-Mini Image-Text-to-Text • 26B • Updated about 22 hours ago • 23.5k • • 4.8k
Model Compression with Exact Budget Constraints via Riemannian Manifolds Paper • 2605.00649 • Published May 7 • 16
GSQ: Highly-Accurate Low-Precision Scalar Quantization for LLMs via Gumbel-Softmax Sampling Paper • 2604.18556 • Published Apr 20 • 27
abenzerps/LFM2.5-24B-A2B-Uncensored-GSQ-RCO-GGUF Text Generation • 24B • Updated 25 days ago • 24.8k • 25
abenzerps/LFM2.5-24B-A2B-Uncensored-GSQ-RCO-GGUF Text Generation • 24B • Updated 25 days ago • 24.8k • 25