Month: December 2023

ChatGPT Explained: A Normie’s Guide To How It Works

Probability Distributions and Token Windows

Once you understand a few core concepts, modern chatbots are less mysterious.

https://www.jonstokes.com/p/chatgpt-explained-a-guide-for-normies

Australian scientists have their hands on a groundbreaking supercomputer that aims to simulate the synapses of a human brain at full scale.

The neuromorphic supercomputer will be capable of 228 trillion synaptic operations per second, which is on par with the estimated number of operations in the human brain.

https://interestingengineering.com/innovation/human-brain-supercomputer-coming-in-2024

GPT-4’s performance may have dropped in December as it learned to do less work during the holidays

AGI Achieved ??? xD

OMG, the AI Winter Break Hypothesis may actually be true?

There was some idle speculation that GPT-4 might perform worse in December because it "learned" to do less work over the holidays.

Here is a statistically significant test showing that this may be true. LLMs are weird.🎅 https://t.co/mtCY3lmLFF

— Ethan Mollick (@emollick) December 11, 2023