GGUF models optimized with GSQ-RCO for efficient inference and minimal quality loss.
-
abenzerps/Inkling-2-Mini-GSQ-RCO-GGUF
Image-Text-to-Text • 26B • Updated • 9 -
abenzerps/LFM2.5-24B-A2B-Uncensored-GSQ-RCO-GGUF
Text Generation • 24B • Updated • 24.8k • 25 -
abenzerps/Nanbeige4.3-33B-GSQ-RCO-GGUF
Text Generation • 33B • Updated • 27.5k • 47 -
abenzerps/Spark-X2.6-4B-Uncensored-GSQ-RCO-GGUF
Text Generation • 4B • Updated • 16.2k • 33