This Blog:
Once “too scary” to release, GPT-2 gets squeezed into an Excel spreadsheet
OpenAI’s GPT-2 running locally in Microsoft Excel teaches the basics of how LLMs work.
by Benj Edwards – 3/15/2024, 3:56 PM
Summary by Copilot: (Edited)
Ishan Anand, a software developer, has created a Microsoft Excel spreadsheet that runs “GPT-2” a precursor to ChatGPT. This spreadsheet, named “Spreadsheets-are-all-you-need,” is designed to educate people about how Large Language Models (LLMs) work. The spreadsheet runs “GPT2-Samll” created with 124 million parameters, smaller than GPT-2 and its 1.5 billion parameters. Users can input words and see predictive results displayed in different cells. The spreadsheet supports 10 tokens of input, demonstrating basic principles of how LLMs work. The spreadsheet does not require any API calls to cloud AI services and runs locally, but is about 1.2 Gb in size. It runs best under Windows and can crash easily.
The following 9:56 minutes video has a detailed explanation on how to use and understand the spreadsheet: