World models.
One research library.

Explore the models, papers, and open resources
shaping predictive and interactive intelligence.

Observe, predict, actObservations and candidate actions condition a world model. Predicted states and imagined rollouts can guide the next action. The feedback path illustrates planning, which is not required of every world model. ObservationActionWorld modelPredicted statesRolloutsPlan through imagined futures
Observe. Predict. Act.
A living research collection
1,557Entries
6Collections
1,498arXiv papers

Explore the library

All entries

Browse the complete collection.

1,557 entries

Compares predictive world-model representations with human behavior and macaque cortex, identifying strengths in appearance-invariant motion coding and a remaining temporal-integration gap.

arXiv 2026
Paper

Origin of the concept. First articulation that organisms carry a "small-scale model" of external reality in their heads, enabling them to try out alternatives and react to future situations before they arise.

1943
Paper

Classic behavioral evidence that animals learn map-like internal representations of the environment rather than mere stimulus-response chains — the ancestral "world model" in psychology.

Psychological Review 1948
Paper

Landmark neuroscience synthesis identifying the hippocampus (place cells) as the neural substrate of Tolman's cognitive map; foundation for spatial world-model research.

1978
Source

Cognitive-science theory that reasoning operates over constructed internal models of situations rather than formal logic rules — a direct intellectual ancestor of "mental world modeling."

1983
Source

First computational formalization of a spatial world model for a physical agent.

Computer 1989
Paper

Foundational representation: encode the future occupancy of states rather than immediate reward.

Neural Computation 1993
Source

Canonical evidence that the brain uses forward models to predict sensory consequences of motor commands — the neuroscience blueprint for action-conditioned prediction.

Science 1995
Paper

The concrete computational predictive-coding model (predating Friston's free-energy generalization): higher cortical areas predict lower-level activity and feed back prediction errors.

Nature Neuroscience 1999
Paper

Neuro-scientific grounding: the brain as a hierarchical Bayesian inference machine minimizing prediction error.

Nature Reviews Neuroscience 2010
Paper

Humans use fast approximate physics simulators as a world model for intuitive physics.

PNAS 2013
Paper

Seminal work. Learn a compressed (V) perception model + recurrent (M) world model, train a small controller (C) entirely inside imagination. Introduced MDN-RNN for stochastic world model.

arXiv 2018
PaperProject

Counts reflect curated entries; a paper may appear in multiple categories. The full list contains 1,498 distinct arXiv IDs, including linked reports and resources. Last curated September 15, 2026.

01 / The taxonomy

Three paradigms.
A shared foundation.

How a world is represented.
How its predictions are used.

Core modeling stepConceptual patterns · Membership can overlap
00

Mind

Experience updates an internal model, which generates predictions and receives feedback.

Internal models of the world connect perception, prediction, and action. Cognitive foundations frame the computational work that follows.

Explore collection ↗
01

Generative

Context and an action condition a generative model that produces a sequence of future observations.

Generate observable futures: video, 3D scenes, occupancy, and other signals. Actions and context can steer how the world unfolds.

Explore collection ↗
02

Representational

An encoder maps an observation to a latent state. A predictor uses an action to predict the next latent state.

Predict how compact world states evolve. Latent dynamics and predictive representations support reasoning without rendering every detail.

Explore collection ↗
03

Agentic

An agent uses imagined rollouts to plan an action, acts in the environment, and updates its world model from observations.

Use a world model to compare imagined outcomes, choose actions, and learn from interaction. Close the loop between prediction and control.

Explore collection ↗
Surveys and benchmarks complete the map.

Read across paradigms, then examine how their predictions are evaluated.

Browse benchmarks ↗

Generative and representational describe what is modeled; agentic describes how a model is used. The categories overlap. Mind World Models provides historical and cognitive context. Read the full definitions ↗

02 / Open research

Built for shared discovery.

A community-maintained library from OpenEnvision.
Help make the map more complete.

Contribute on GitHub ↗
OpenEnvision LibraryMultimodal Modeling ↗Keep exploringOpen tools, datasets & related lists ↗Reading guideRoadmaps, glossary & open questions ↗
From the research library