CNWPlayer/Vega-2-5M-PREVIEW
4.9M • Updated • 311
🌌 Vega thingies.
CNWPlayer
CNWPlayer
AI & ML interests
SLMs, LLMs, really anything that ends in LM.
Recent Activity
updated a model about 16 hours ago
CNWPlayer/Vega-2-5M-PREVIEW reacted to Banaxi-Tech's post with 👍 1 day ago
Should I even continue making models?Organizations
None yet
updated a
model about 16 hours ago
replied to wayneworkman2012's post 1 day ago
mfw i dont have 192 bajillabytes of hbm69420 ram and would rather take fp8 glm 5.3 over iq4_xs Qwen 3.6 35ba3b
reacted to Banaxi-Tech's post with 👍 1 day ago
Post
4,152
Should I even continue making models?
- 27 replies
published a
model 3 days ago
Can we get a GGUF?
3
#7 opened 3 days ago
by 
sol-frigate
reacted to Banaxi-Tech's post with 🚀🔥 5 days ago
Post
4,682
Well GPT X3 takes the lead. As of right now.
We are now announcing BananaMind 3 🍌! (not ai for those emoji guys)
All models will use BGA (which is almost just NSA) and our BM3X architecture.
Its sizes will be:
BananaMind 3 Flash Lite, 3M parameters at a context of 8K context.
BananaMind 3 Lite, 10M parameters with 16K context.
BananaMind 3 Flash, 25M Parameters with 16K context.
BananaMind 3 Pro, 50M parameters with 24K context.
BananaMind 3 Ultra, 100M parameters with 32K context.
And lastly, BananaMind 3 Max with 150M parameters and 64K CONTEXT.
I can assure you BananaMind 3 Max WILL beat GPT X3 or match it, we won't release it otherwise. We hope for a 40+ INTELLIGENCE INDEX!
BananaMind 3 may also be partnered with dot labs.
We will cancel BananaMind 2.1 and BananaMind 2 Ultra.
As of the BETU SLM Leaderboard we may need to release it after October 11, im very busy right now (even though we said We will release BETU leaderboard before Oct 11 😟)
We are now announcing BananaMind 3 🍌! (not ai for those emoji guys)
All models will use BGA (which is almost just NSA) and our BM3X architecture.
Its sizes will be:
BananaMind 3 Flash Lite, 3M parameters at a context of 8K context.
BananaMind 3 Lite, 10M parameters with 16K context.
BananaMind 3 Flash, 25M Parameters with 16K context.
BananaMind 3 Pro, 50M parameters with 24K context.
BananaMind 3 Ultra, 100M parameters with 32K context.
And lastly, BananaMind 3 Max with 150M parameters and 64K CONTEXT.
I can assure you BananaMind 3 Max WILL beat GPT X3 or match it, we won't release it otherwise. We hope for a 40+ INTELLIGENCE INDEX!
BananaMind 3 may also be partnered with dot labs.
We will cancel BananaMind 2.1 and BananaMind 2 Ultra.
As of the BETU SLM Leaderboard we may need to release it after October 11, im very busy right now (even though we said We will release BETU leaderboard before Oct 11 😟)
- 12 replies
liked a
model 5 days ago
updated a
model 9 days ago
reacted to danielhanchen's post with 👀😎🔥❤️🚀 9 days ago
Post
3,936
Google releases EmbeddingGemma 2, a new open embedding model that runs locally on 0.5GB RAM.
The 740M parameter Apache 2.0 model combines a 270M text model with vision (170M) + audio (300M).
Run & train the model via Unsloth.
GGUF: unsloth/embeddinggemma-2-GGUF
Guide: https://unsloth.ai/docs/models/embeddinggemma-2
The 740M parameter Apache 2.0 model combines a 270M text model with vision (170M) + audio (300M).
Run & train the model via Unsloth.
GGUF: unsloth/embeddinggemma-2-GGUF
Guide: https://unsloth.ai/docs/models/embeddinggemma-2
published a
model 13 days ago
updated a
model 13 days ago
liked a
model 13 days ago
reacted to DedeProGames's post with 🤗🧠🚀 15 days ago
Post
6,290
🧱 SLM Tetris Arena: can a small language model play Tetris without ever being trained on it?
I built an arena where tiny decoder-only LMs (50K–250M params) play Tetris zero-shot. There is no fine-tuning and no game data. They only use what they picked up from pre-training on text.
How it works:
- For every piece, the engine simulates each legal placement and describes the result in plain English ("clears one line, creates no new holes, keeps the stack low…").
- The model never sees the grid. It reads each description, and the arena compares log P(" good move") with log P(" bad move"). The best-rated placement is played.
- Every player gets the same piece sequence, so it's a fair race.
- There are two protocols: Guided (the rules are in the prompt) and Blind (no rules, only pre-training knowledge).
Two ways to play:
- Match: pick any models (even your own, custom architectures welcome) and watch them play side by side on retro 8-bit boards.
- Ranked: press Play and the arena picks up to 4 models at random from a curated pool of 29. Nobody chooses their opponents, so Elo can't be farmed. Matches run on the server and count even if you close the tab.
First results (~225 ranked matches):
- gpt2 (124M) leads with 1283 Elo, but SupraNeo-4M (4M) is right behind at 1239. Next come LowOnMind-5M and BananaMind-2.1-Pico (1.5M!).
- Model size barely predicts Elo (r ≈ 0.06). Survival does (r ≈ 0.9): the models that avoid holes and keep the stack low are the ones that win.
Every ranked match (seed, model commit SHAs, scores, Elo before/after) is logged in a public dataset.
▶ Play: DedeProGames/SLM-Tetris-Arena
📊 Results: DedeProGames/lm-tetris-arena-results
Want your model in the Ranked pool? Drop it in the comments!
I built an arena where tiny decoder-only LMs (50K–250M params) play Tetris zero-shot. There is no fine-tuning and no game data. They only use what they picked up from pre-training on text.
How it works:
- For every piece, the engine simulates each legal placement and describes the result in plain English ("clears one line, creates no new holes, keeps the stack low…").
- The model never sees the grid. It reads each description, and the arena compares log P(" good move") with log P(" bad move"). The best-rated placement is played.
- Every player gets the same piece sequence, so it's a fair race.
- There are two protocols: Guided (the rules are in the prompt) and Blind (no rules, only pre-training knowledge).
Two ways to play:
- Match: pick any models (even your own, custom architectures welcome) and watch them play side by side on retro 8-bit boards.
- Ranked: press Play and the arena picks up to 4 models at random from a curated pool of 29. Nobody chooses their opponents, so Elo can't be farmed. Matches run on the server and count even if you close the tab.
First results (~225 ranked matches):
- gpt2 (124M) leads with 1283 Elo, but SupraNeo-4M (4M) is right behind at 1239. Next come LowOnMind-5M and BananaMind-2.1-Pico (1.5M!).
- Model size barely predicts Elo (r ≈ 0.06). Survival does (r ≈ 0.9): the models that avoid holes and keep the stack low are the ones that win.
Every ranked match (seed, model commit SHAs, scores, Elo before/after) is logged in a public dataset.
▶ Play: DedeProGames/SLM-Tetris-Arena
📊 Results: DedeProGames/lm-tetris-arena-results
Want your model in the Ranked pool? Drop it in the comments!
- 1 reply