Hardware Scaling Trends and Diminishing Returns in Large-Scale Distributed Training

Jared Fernandez, Luca Wehrstedt, Leonid Shamis, Mostafa Elhoushi, Kalyan Saladi, Yonatan Bisk, Emma Strubell, Jacob Kahn
April 2025
PDF
Type
Conference paper
Efficiency Energy Training
Jared Fernandez
Jared Fernandez

PhD student at CMU LTI working on ML efficiency.

Related