DeepMind Unveils Genie 4: Real-Time Worlds With Native Audio and Dialogue
Google DeepMind has announced Genie 4, a new world model that pushes real-time interactive simulation to a new level of realism. Genie 4 is natively multimodal: music, ambient noises and interactive dialogue are generated simultaneously with the world itself, while the Gemini family anchors its realism — Gemini Omni grounds simulations in real-world appearance and behavior, with other Gemini models supplying the reasoning that keeps the world coherent.
- Genie 4 announced as a new-generation world model with native multimodal generation
- Natural language reshapes simulations in real time: weather, camera, new characters and objects
- First real-time world model to generate audio natively, including adaptive dialogue
- Gemini 3.8 Flash acts as a guiding agent: decomposing goals and verifying each step
- Advanced physics simulation: aerodynamics, collisions and naturally moving characters
- Rolling out as a research preview to trusted testers; Google AI Ultra subscribers next via Project Genie
- All generated video and audio carry SynthID watermarking
Four Capabilities Forward
Genie 4 advances four fronts. Real-time steering: natural language modifies a simulation on the fly — changing weather, moving the camera or introducing new people and objects — while Gemini contextually adapts prompts and keeps the world progressing between inputs. Physics and human action: built on an advanced physical understanding of the world, Genie 4 simulates scenarios such as aerodynamics and collisions, and its most dramatic leap is characters that move naturally, respond organically and can be steered interactively. Native audio: Genie 4 is DeepMind’s first real-time world model to generate audio natively — every world carries its own ambience, from wind in trees to crashing waves, and characters hold real-time conversations that adapt to inputs and events. Complex events: Gemini 3.8 Flash serves as a guiding agent in the loop, continuously observing the scene, breaking goals into steps and verifying each one from incoming frames, unlocking worlds with reliable causality, procedural behaviors and multi-step reasoning.
From Film Pre-Visualization to Robot Training
Trusted testers are already exploring applications across disciplines: filmmakers use Genie 4 as a rapid draft mode, running multiple takes in real time while adjusting camera angles, lighting, dialogue and action; photojournalists are turning single 2D archival photographs into grounded simulations within seconds, including visualizations of short-term environmental events like flash floods and wildfires; game developers go from idea to an explorable prototype in seconds without writing engine code; and enterprise partners are evaluating it for rapid zero-to-one scenario generation, alongside robotics training environments. DeepMind frames world simulation as a crucial aspect of building AGI.
Early, Experimental — With SynthID
The company is candid that Genie 4 remains an early, experimental model: visual details and object permanence can drift over long sessions, after complex prompt edits or during navigation, and complex physical interactions, real-time audio accuracy, legible text rendering, spatial accuracy and long-term consistency remain active research areas. All generated video and audio carry SynthID, DeepMind’s imperceptible watermark, and the preview has been limited to trusted testers before broader release. The longer-term direction is hybrid world models: Gemini maps structure and plans the narrative timeline while Genie renders the immediate physical reality pixel by pixel — an approach DeepMind believes can unlock world models far more coherent, controllable and grounded than either family alone. Genie 4 will reach Google AI Ultra subscribers through Project Genie and early access partners on the Gemini API and Google AI Studio, with a waitlist now open.
Source: Google DeepMind
(Cover image is AI-generated, for illustrative purposes only)
