Meta AI Introduces MetaRoCE: A Clean-Sheet RDMA Transport Built for AI-Scale Ethernet
Training and serving frontier fashions is now a networking drawback as a lot as a compute drawback. Collective operations like all-reduce and all-to-all synchronize hundreds of accelerators throughout coaching, and the slowest switch units the tempo for your entire job. Even small quantities of community friction instantly strand important compute capability. This week, Meta launched…
