(2023-01-29) Hut Training NanoGPT On My Journal

Hut (Roman Zimbelmann): Training nanoGPT on my Journal. I'm looking into building a helpful chat bot that runs 100% offline, purely on the CPU of my 7-year-old laptop.

Then Andrej Karpathy released his enlightening lecture "Let's build GPT: from scratch, in code, spelled out.", along with the git repo "nanoGPT", which makes it seem so easy to just build a somewhat decent language model on your own, even on a laptop, so I just gave it a try.

After half a day of training the neural network on my personal notes, I got pretty good results already

Inspired by Dan Shipper's post "Can GPT-3 Explain My Past and Tell My Future? ", I added some writing prompts. (2023-01-20) Shipper Can Gpt3 Explain My Past And Tell My Future