I don't like the externalities of something like this, or in fact a lot of projects riding on AI hype.
The carbon footprint of typing a post out by hand, for example, is negligible in comparison to the carbon footprint of a massive datacentre running hundreds of prompts for many minutes to perform otherwise trivial tasks. A laptop that is already quite powerful is barely using any of its own compute in favour of requiring an utterly enormous amount somewhere else in the world.
It just feels like a colossal waste especially when you're going back to the same LLM many times to refine or correct its output.
The carbon footprint of typing a post out by hand, for example, is negligible in comparison to the carbon footprint of a massive datacentre running hundreds of prompts for many minutes to perform otherwise trivial tasks. A laptop that is already quite powerful is barely using any of its own compute in favour of requiring an utterly enormous amount somewhere else in the world.
It just feels like a colossal waste especially when you're going back to the same LLM many times to refine or correct its output.