Energy Considerations of Large Language Model Inference and Efficiency Optimizations

Jared Fernandez, Clara Na, Vashsisth Tiwari, Yonatan Bisk, Sasha Luccioni, Emma Strubell
April 2025
PDF
Type
Conference paper
Publication
Energy Considerations of Large Language Model Inference and Efficiency Optimizations
Energy Efficiency Inference
Jared Fernandez
Jared Fernandez

PhD student at CMU LTI working on ML efficiency.

Related