Explore AI

How ChatGPT Thinks

The simple trick: guess the next word. Repeat.

How ChatGPT Thinks — interactive video preview

What you'll learn

  • Next-Token Prediction
  • LLMs
  • Text Generation

In this video

Okay, so ChatGPT seems super smart, right? Here's a secret — under the hood, it's really doing just one tiny thing. Over and over and over. Watch.

Look at this sentence appearing — "The cat sat on the..." and then a question mark. That's the whole game. ChatGPT looks at the words so far, and tries to guess what word should come next. Just like filling in a blank.

See how the words pop up with bars next to them? Those bars are how confident ChatGPT feels. "Mat" gets the longest bar — that's its top guess. "Chair" and "roof" are possible too, just less likely. Every word gets a score.

Your turn — go ahead, tap any word and add it to the sentence. Try the top one, or pick something wilder like "roof". Normally the AI grabs the highest-ranked guess, but you get to play AI for a sec.

Here's the cool part. Once it picks "mat", it just does the same thing again — guess the next word after that. Then again. Watch the sentence grow itself, one word at a time. That's literally how whole stories appear.

Try sliding this. "Temperature" is a knob that decides how risky the AI plays. Cold means it always picks the safest word. Crank it up hot, and suddenly cats are sitting on spaceships. Same trick — just braver guessing.

And that's it. Guess a word, stick it on, guess again. ChatGPT does this thousands of times a second. No magic, no thinking like you do — just the same tiny trick, repeated really really fast.

Topics

#Next-Token Prediction#LLMs#Text Generation

Ready to try it yourself?

How ChatGPT Thinks is a hands-on interactive video — watch it, then play with the idea live in your browser. Free, no sign-up.

Open in Kekula →