Your privacy choices

Optional Google Analytics cookies help us understand which guides are useful. They stay off unless you accept. You can change your choice in the footer. Privacy policy

The Bot Post

Tag

#Mixture of Experts

A vast dark lattice of thousands of small dormant cubes with only a thin scattered trail of glowing amber cubes lit, suggesting a huge sparse model where few parts activate at once

AI News

Microsoft's MAI-Base-2: 2.8T Parameters, 80B Active and a 4-12x Efficiency Claim

Microsoft's 2.8T-parameter MAI-Base-2 is done pre-training. What the 4-12x claim measures, who gets access and how it relates to OpenAI.

Oct 16, 2026