Article
New Benchmarks
Banaxi-Tech
• • 2Banaxi PRO
Banaxi-Tech
AI & ML interests
SLMs, training from scratch, LoRA, TTS, Ternary models. AI Interpretability. BCI. Contact at banaxitech@gmail.com
Recent Activity
reacted to theirpost with 🤗 24 minutes ago
We're excited to release BananaAll, our SLM Super App.
It allows you to do EVERYTHING you need to do to trains SLMs in a single app, no terminal, no 30 chrome tabs.
The train tab allows you to train models, select datasets from presets, and use other ones with auto mapping, model size slider, it automatically generates a training script for you.
Then after you've trained the model or want to compare it to competitors, the evaluation tab, run ARC EASY, ARC Challenge, Hellaswag, PIQA, Arithmark 3, BananaMind Base Bench and more! Simple Results screen.
And lastly the inference tab, run your trained models or others.
Normally you would need seperate apps or scripts for that, but the BananaAll Super App lets you do all of that in a single app.
We also trained a small 2.5M parameter model on 200M tokens of Fineweb edu, The results: BananaMind Base Bench 854 and 53% on Arithmark 3. On only 200M tokens.
Check it out at https://github.com/BananaMind/BananaAll. reacted to theirpost with ❤️ 24 minutes ago
We're excited to release BananaAll, our SLM Super App.
It allows you to do EVERYTHING you need to do to trains SLMs in a single app, no terminal, no 30 chrome tabs.
The train tab allows you to train models, select datasets from presets, and use other ones with auto mapping, model size slider, it automatically generates a training script for you.
Then after you've trained the model or want to compare it to competitors, the evaluation tab, run ARC EASY, ARC Challenge, Hellaswag, PIQA, Arithmark 3, BananaMind Base Bench and more! Simple Results screen.
And lastly the inference tab, run your trained models or others.
Normally you would need seperate apps or scripts for that, but the BananaAll Super App lets you do all of that in a single app.
We also trained a small 2.5M parameter model on 200M tokens of Fineweb edu, The results: BananaMind Base Bench 854 and 53% on Arithmark 3. On only 200M tokens.
Check it out at https://github.com/BananaMind/BananaAll. reacted to theirpost with 👀 24 minutes ago
We're excited to release BananaAll, our SLM Super App.
It allows you to do EVERYTHING you need to do to trains SLMs in a single app, no terminal, no 30 chrome tabs.
The train tab allows you to train models, select datasets from presets, and use other ones with auto mapping, model size slider, it automatically generates a training script for you.
Then after you've trained the model or want to compare it to competitors, the evaluation tab, run ARC EASY, ARC Challenge, Hellaswag, PIQA, Arithmark 3, BananaMind Base Bench and more! Simple Results screen.
And lastly the inference tab, run your trained models or others.
Normally you would need seperate apps or scripts for that, but the BananaAll Super App lets you do all of that in a single app.
We also trained a small 2.5M parameter model on 200M tokens of Fineweb edu, The results: BananaMind Base Bench 854 and 53% on Arithmark 3. On only 200M tokens.
Check it out at https://github.com/BananaMind/BananaAll.Organizations
published an article about 9 hours ago
published an article 1 day ago
Article
Post to my followers
Banaxi-Tech
• • 2 published an article 6 days ago
Article
Layer-Feedback Transformer (LFT)
Banaxi-Tech
• • 6 published an article 7 days ago
Article
BananaMind 2 Pro: We've (almost) matched SmolLM2 at 20x fewer tokens... Trained On a 5070 Ti
Banaxi-Tech
• • 6 published an article about 1 month ago
Article
Extreme Overtraining in Tiny Language Models
Banaxi-Tech
• • 16 published an article 2 months ago
Article
The influx of specialist models on the Open SLM Leaderboard
Banaxi-Tech
• • 10