I think it's also worth comparing to the CO2 impact of consuming meat, especially beef, which is pretty high.

(It's the training, not the inference, that's the biggest energy usage.)