SpaceX has almost finished writing v1.0 of an in-house AI training stack in C

via

Nitter

SpaceX has almost finished writing V1.0 of an in-house AI training stack in C that exact-maps to 220k GB300s with 800G NICs, making heavy use of pipeline parallelism and getting as close to bare metal as possible. The potential speed improvement vs JAX for large training runs is over an order of magnitude.

Discussion

0 comments

Replying to cancel

GIF Post

Powered by

More from Nitter

The craziest steroid Olympics ended in total embarrassment

Nitter·14

Russian censors target Visual Novel titles on Steam

Nitter·26

APKPure is distributing a malicious copy of Telegram

Nitter·20

The "Megalodon" Campaign: 5718 malicious commits to 5561 GitHub repos

Nitter·12

Qwen 3.7 Max is on OpenRouter: $2.5 in, $7.5 out

Nitter·13

FBI faked a cryptocurrency to catch fraudulent market makers

Nitter·13