Report Estimated Electricity Use and Carbon Emission

[peterzahemszky]

Feature request

Report estimated electricity usage and carbon emission based on public data regarding energy used for training and electricity consumption per input and output token

Possible implementation:

• track input and output token count
• hard-code approximate electricity intensity of supported models
• estimate electricity use from input & output token counts
• convert electricity use to carbon emission using real-time or historical average intensity using existing third-party APIs

Blocked by #756

Motivation

• Enhance transparency of energy consumption of model training and inference
• Provide insights into the climate impact of model & region choice
• Facilitate more sustainable AI practices by highlighting energy efficiency

[hinthornw]

Hi there! This would be cool! I don't think we'll be able to tackle this in a reliable way, however, (at least not any time soon) both because it's hard to get reliable publicly available data and because those numbers are prone to change

[hinthornw]

Gonna move to discussions since it's not currently scheduled for work