A collection of memory, parameter, and computationally efficient models.
oscar lo
oscar128372
AI & ML interests
working on SLMs because I have no money
Recent Activity
new activity about 3 hours ago
Compactbot/model-requests:New model request repliedto Banaxi-Tech's post about 2 months ago
We're announcing BananaMind 2 Micro, our smallest model in the BananaMind 2 model family.
This model is not released yet, training has not started yet.
It uses only 2.9M parameters, while being overtrained on 75B tokens to get the maximum intelligence per parameter.
The key changes are:
No more AdamW, the model will use the Muon optimizer offering up to 2x faster convergence and higher lr.
LR goes to 2.2e-2.
We're adding the XSA refresh gate from the TX4 architecture into our own.
Training will start on August 3, release date is estimated to be August 4-6.
On August 3 we will also release our Public Preview of BananaMind 2 Pro.
Follow us to know when our models release
https://huggingface.co/BananaMind
@Banaxi-Tech
repliedto Banaxi-Tech's post 2 months ago
We're announcing BananaMind 2 Micro, our smallest model in the BananaMind 2 model family.
This model is not released yet, training has not started yet.
It uses only 2.9M parameters, while being overtrained on 75B tokens to get the maximum intelligence per parameter.
The key changes are:
No more AdamW, the model will use the Muon optimizer offering up to 2x faster convergence and higher lr.
LR goes to 2.2e-2.
We're adding the XSA refresh gate from the TX4 architecture into our own.
Training will start on August 3, release date is estimated to be August 4-6.
On August 3 we will also release our Public Preview of BananaMind 2 Pro.
Follow us to know when our models release
https://huggingface.co/BananaMind
@Banaxi-Tech
Organizations
models 21
oscar128372/axon-pico-3m
Text Generation • Updated • 1
oscar128372/axon-nano-6m
Text Generation • Updated • 22 • 1
oscar128372/difl-qwen2.5-3b-math
Updated
oscar128372/Axion-4B-v0.09
Text Generation • 4B • Updated • 13 • 1
oscar128372/Qwen2.5-CoderX-7B-v0.7
Text Generation • 8B • Updated • 20 • 2
oscar128372/Qwen2.5-CoderX-7B-v0.7-LORA
Updated
oscar128372/Qwen2.5-CoderX-7B-v0.5
Text Generation • Updated • 30 • 2
oscar128372/Qwen2.5-CoderX-14B-v0.5
Text Generation • 15B • Updated • 16 • 2
oscar128372/Nova-1.5-Conversational-7B
Text Generation • Updated • 10 • 1
oscar128372/Nova-1.5-7B
Text Generation • 8B • Updated • 7 • 1
datasets 15
oscar128372/SmallBase-1.1
Viewer • Updated • 240 • 20 • 1
oscar128372/SmallBase-1
Viewer • Updated • 140 • 7 • 1
oscar128372/pytorch_to_triton
Preview • Updated • 8
oscar128372/chess_spatial_reasoning_400kv1
Updated • 42 • 5
oscar128372/math
Viewer • Updated • 157 • 3
oscar128372/OoE
Viewer • Updated • 21 • 4
oscar128372/dataset
Viewer • Updated • 15 • 5
oscar128372/dpo
Viewer • Updated • 70 • 3
oscar128372/Axion-A
Viewer • Updated • 117 • 8 • 1
oscar128372/dataset2
Viewer • Updated • 71 • 2