You glance at a photograph of an animal you’ve never seen before. It’s a single image, taken from one angle. Yet, almost instantly, your brain conjures the rest: what the other side looks like, how it moves, even what its offspring might resemble. None of that information exists in the photograph. So where does it come from?

The video You’ve Never Seen This Animal—So How Does Your Brain Know What It Looks Like? suggests the answer lies in predictive processing, a theory that frames the brain as a prediction machine. But while the idea is compelling, the reality is more nuanced—and far more interesting—than a simple story of "imagination."


The Brain as a Prediction Engine

Predictive processing posits that the brain doesn’t passively record reality. Instead, it constantly generates predictions about what it expects to see, hear, or feel, then compares those predictions to incoming sensory data. When predictions match reality, the brain confirms its model of the world. When they don’t, it updates its expectations.

This framework explains why you can infer the missing half of an animal from a single photograph. Your brain doesn’t start from scratch—it relies on an internal model of how the world works. This model is built from a lifetime of experience: gravity, symmetry, anatomy, and motion. When you see a new animal, your brain doesn’t just see pixels; it sees a probable reality, shaped by everything you’ve learned.

Illustration of a brain generating predictions about a partially visible animal, with neural pathways lighting up.
Your brain doesn’t just see what’s there—it predicts what *should* be there. | Source: istockphoto.com
🔍
What the evidence actually shows: - Predictive processing is supported by decades of neuroscience research, including studies on perception, attention, and even hallucinations (Clark, 2013; Hohwy, 2013). - The brain’s internal model is not magic—it’s built from statistical regularities in the environment. For example, we expect objects to have consistent shapes and animals to move in biologically plausible ways. - This isn’t just about vision. Predictive processing applies to all senses, from touch to hearing, and even to higher-level cognition like decision-making.

Why Humans Learn Faster Than AI (For Now)

The video contrasts human learning with AlphaZero, the AI that mastered chess by playing millions of games against itself. A human beginner, by comparison, can grasp the basics of chess in just a few games. Why the difference?

The answer lies in sample efficiency. Humans don’t learn from scratch—we bring decades of prior knowledge to every new task. Before your first chess game, you already understand rules, goals, spatial reasoning, and intentional opponents. AlphaZero, on the other hand, starts with only the literal syntax of the game. It has no internal model of the world, no intuition about strategy, and no ability to generalize beyond the data it’s trained on.

This is why humans can adapt to new rules—like a "Dragon" piece in chess—almost instantly. Our brains weave new information into existing knowledge, while AI systems often require re-engineering or massive retraining. But this flexibility comes at a cost: our predictions aren’t always right.

Side-by-side comparison: a human brain learning chess in 10 games vs. AlphaZero requiring 44 million games to master chess.
Humans learn fast because we don’t start from zero—but our predictions can be wrong. | Source: deepmind.google
⚠️
Why this matters: - AI is not (yet) a prediction machine. While systems like AlphaZero excel at narrow tasks, they lack the generalizable internal models that humans develop naturally. - Sample efficiency is a major challenge in AI research. Some scientists believe the next frontier isn’t more data, but better internal models—though how to build them remains an open question. - Human learning is efficient but error-prone. Our predictions can lead to optical illusions, false memories, or biased judgments.

The Limits of Prediction

Predictive processing explains why we’re so good at filling in gaps—but it also explains why we get things wrong. Optical illusions, for example, exploit the brain’s tendency to see what it expects to see. If your internal model predicts a certain pattern, your brain may override contradictory sensory data to confirm it.

This isn’t a flaw; it’s a trade-off. The brain operates on roughly 20 watts of power—about the same as a dim lightbulb. It can’t afford to calculate every possibility from first principles. Instead, it predicts first, corrects later, sacrificing occasional accuracy for speed and efficiency.

The video’s claim—that intelligence is measured by how much reality you can imagine before experiencing it—is poetic, but it’s not the whole story. Intelligence also requires flexibility, error correction, and the ability to update predictions when they’re wrong. The brain’s internal model isn’t static; it’s a dynamic, ever-updating framework that balances prior knowledge with new evidence.

🤔
What we still don’t know: - How does the brain build its internal model? While predictive processing offers a framework, the neural mechanisms behind it are still being uncovered. - Can AI ever develop human-like internal models? Some researchers are exploring Bayesian neural networks and world models, but these are early-stage efforts. - Why do some predictions fail spectacularly? From hallucinations to false memories, the brain’s predictive errors are still not fully understood.

This post is for subscribers only

Subscribe now and have access to all our stories, enjoy exclusive content and stay up to date with constant updates.

Subscribe now

Already a member? Sign in