gguf 或nvfp4 版本支持

by ZKong - opened Jan 20

Discussion

ZKong

Jan 20

太大了，跑不动

MoRanYue

May 28

Will this have GGUF variants?

jk1741391802

2 days ago

Will this have GGUF variants?

You can convert it to gguf yourself and then quantize it. There are currently open-source tools that support it: https://github.com/ggml-org/llama.cpp

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment