Thats cool! If you can say, how big is the model, im curious
π Aniimage model coming soon
Jackson Yeskie
8BitStudio
AI & ML interests
Text to image, Language models
Recent Activity
new activity about 23 hours ago
hugging-science/ripp:Hugging Science is DEAD??? new activity 1 day ago
hugging-science/ripp:Message board ideaOrganizations
None yet
Hugging Science is DEAD???
β 2
28
#2 opened 8 days ago
by 
XBFDI
Message board idea
π 5
7
#3 opened 3 days ago
by 
el4
updated a
model 1 day ago
Line count
10
#2 opened about 1 month ago
by 
Sterling-Ai
reacted to harshitkgupta's post with π 6 days ago
Post
8721
Fine-tuned Qwen 2.5 (0.5B β 3B) on real coding-agent traces, 10 controlled runs, one 16GB Mac. Compared PyTorch MPS vs. Apple MLX for local LoRA SFT β and the honest answer is "it depends on what you're optimizing for":
β’ PyTorch MPS: 2.2xβ5.7x faster raw throughput, but hits a hard memory wall β can't load a 3B model in FP16 on 16GB.
β’ Apple MLX: 4-bit QLoRA fits 3B+ models with almost flat memory scaling as context grows (+109 MB going from 1kβ4k tokens).
β’ 4-bit quantization doesn't cost you convergence β eval loss tracks closely across backends.
β’ The bigger surprise: most of MLX's slowdown isn't the 4-bit dequant tax. Two of the 10 runs went unquantized to isolate it β dequant only explains 1.07xβ1.4x of the gap. A ~4.1β4.6x framework-level gap remains either way.
All 10 LoRA adapters + Trackio logs are public so the numbers are checkable, not just claimed.
Full writeup: https://huggingface.co/blog/harshitkgupta/fine-tuning-coding-agents-on-mac-pytorch-mps-mlx
β’ PyTorch MPS: 2.2xβ5.7x faster raw throughput, but hits a hard memory wall β can't load a 3B model in FP16 on 16GB.
β’ Apple MLX: 4-bit QLoRA fits 3B+ models with almost flat memory scaling as context grows (+109 MB going from 1kβ4k tokens).
β’ 4-bit quantization doesn't cost you convergence β eval loss tracks closely across backends.
β’ The bigger surprise: most of MLX's slowdown isn't the 4-bit dequant tax. Two of the 10 runs went unquantized to isolate it β dequant only explains 1.07xβ1.4x of the gap. A ~4.1β4.6x framework-level gap remains either way.
All 10 LoRA adapters + Trackio logs are public so the numbers are checkable, not just claimed.
Full writeup: https://huggingface.co/blog/harshitkgupta/fine-tuning-coding-agents-on-mac-pytorch-mps-mlx
- 7 replies
replied to Banaxi-Tech's post 8 days ago
does BananaMind have a website? Would love to easily test these on it if so
liked a
model 8 days ago
YOO WHAT?
57
#1 opened 10 days ago
by 
Bc-AI
I think they are fine, and they are cool, but is there a clear use for them? What are you for, @BananaMindBot
liked a
model 11 days ago
Saw it being used as a computer automation tool (i.e. open an app, type, something, etc) I think once more open jev type models come out we will have crazy things
I cant imagine what we will do when the human brain is mapped out in 20 years
With the usage these days you basically have to π
liked a
dataset 18 days ago
liked a
model 19 days ago
liked a
model 20 days ago
liked a
model 21 days ago
Language support
#22 opened 21 days ago
by 8BitStudio
replied to inflatebot's post 21 days ago
Also you only get one post per 24 hours