alexliap/greek-cc-manifests
Viewer ā¢ Updated ā¢ 257M ā¢ 217
š In a Training Loop
Alexandros Liapatis
alexliap
P(doom) Rejects the premise
AI & ML interests
Generative AI + Traditional ML
Recent Activity
updated a dataset about 5 hours ago
alexliap/greek-cc-manifests reacted to raincandy-u's post with š„ 1 day ago
20K parameters can tell a story. š
š¤ We trained a ~20k-parameter Transformer that can actually write stories!
https://huggingface.co/raincandy-u/MacroStories
ā ~50Ć smaller than the 1M-parameter TinyStories model
ā ~3,000Ć smaller than AlexNet
ā 81 KB in FP32
yayyy the whole model. ą«® Ė¶įµ įµ įµĖ¶ į
She has a 32-dimensional hidden state, a 378-token vocabulary, and just one decoder block ā recurrently applied 4 times with shared weights.
Despite having only 19,969 parameters, she can maintain a simple narrative across 100ā300 words: establish a goal, encounter a problem, take relevant actions, and reach an outcome.
She runs extremely fast on CPU ā no GPU required. The entire model is tiny enough to load almost instantly! āŗļø reacted to Banaxi-Tech's post with š 2 days ago
We will release the BEST SLM Leaderboard before Oct 11.
It will feature everything:
Easy to use model picker.
EXTREMELY Easy way to add your own models (2 click)
MULTIPLE leaderboard for different model types
And more!
So why don't you help us build it?
Join https://huggingface.co/betu-slm-leaderboard-testersOrganizations
None yet