ShortGPT - Automatically reduce your AI footprint

Problem: LLMs and other generative AI uses a lot of energy and water during training and production. This is a crucial issue given the ongoing climate change crisis.

Solution: We have created a simple Chrome extension. The extension reduces the length of the ChatGPTs responses, increases the speed of responses and makes the answers more to the point. It requires no input from the user and doesn't alter the user experience in any way, as it works automatically in the background.

Impact: We have investigated the relationship between LLM output length and computational difficulty and found a very strong correlation between the two. Using our extension we can thus reduce the computational difficulty of the processing which needs to be done by ChatGPT's servers. This leads directly to a reduction in energy usage by those servers. Since ChatGPT is the world's largest LLM, widespread adoption of this tool would make a large impact.

Feasibility: Since it is a fully frontend-based Chrome extension, the operation of the Chrome extension doesn't require any operational costs from our side. The endeavour has been, from the get-go, meant as a non-profit project and the extension is already available on our website at https://greenify-gpt-fe-1.vercel.app/.

What you built: We have built the following systems: - a Chrome Extension (https://github.com/LukasCelnar/shortgpt-extension) - a Landing page website with a link to download the extension (https://github.com/MatoushAlpha/GreenifyGPT-FE-1, https://vercel.com/matoushalpha/greenify-gpt-fe-1) - a Backend Script used for calculating the correlation between character input + output length and the computational complexity of an LLM system (https://github.com/LongPilus/ShortGPT_calculator/)

What you had before: All code is original and was created during the hackathon.

What comes next: We wish to purchase a domain and use our personal social media to drive traffic to download our free product.

Video: https://youtu.be/BB8UcXgHB9A