Building a Latent World Model of Doom
A new world model has been developed using 20 million parameters trained on two hours of DOOM gameplay. The model is open source, with all code, weights, and datasets publicly available. It utilizes deep neural networks to predict game states based on previous actions and states.
- ▪The world model can run on laptops and smartphones.
- ▪DOOM was chosen for its simple visuals and abundant gameplay footage.
- ▪The model employs a vision transformer and a multi-layer perceptron for state and action encoding.
Opening excerpt (first ~120 words) tap to expand
video.hover-video::-webkit-media-controls { display: none !important; } video.hover-video:hover::-webkit-media-controls { display: flex !important; } .side-by-side { display: grid; grid-template-columns: repeat(2, minmax(0, 1fr)); gap: 0.75rem; max-width: 520px; width: 100%; margin: 0 auto; } .side-by-side .media-item { min-width: 0; } .side-by-side .media-item img, .side-by-side .media-item video { width: 100%; height: auto; } .blog-figure { max-width: 480px; width: 100%; margin: 0 auto 1.25rem auto; text-align: center; } .blog-figure img, .blog-figure video { width: 100%; height: auto; display: block; } .blog-figure figcaption { margin-top: 0.35rem; } .schema-wrapper { background: white; padding: 1.5rem; } .schema-figure { max-width: 800px; } @media (max-width: 640px) { .side-by-side {…
Excerpt limited to ~120 words for fair-use compliance. The full article is at Lucrbvi.