Skip to header Skip to main navigation Skip to main content Skip to footer

Google's Genie 4 Gives Its World Model a Voice, and Lets You Rewrite the Scene Live

Breadcrumb

  • Home
  • Google's Genie 4 Gives Its World Model a Voice, and Lets You Rewrite the Scene Live

Google DeepMind announced Genie 4 on October 27 as a research preview for trusted testers, and the headline change is sound. The new world model generates explorable, interactive scenes in real time from a text prompt or an image, and for the first time it produces audio natively alongside the picture: ambient noise, music, and characters who can converse and react as events unfold. DeepMind says scenes now hold together for up to about two minutes, roughly double the limit reported for Genie 3, and every video and audio clip it emits carries a SynthID watermark.

The second change is control while the simulation is running. Users navigate with keyboard controls and can type natural-language prompts mid-scene to change the weather, move the camera, or introduce a new person or object, instead of starting over with a fresh prompt. Behind that sits a small stack of Google models: Gemini Omni anchors how objects look and behave, while Gemini 3.8 Flash serves as a guiding agent inside the loop, observing the scene, breaking goals into steps, and checking frames as Genie renders them. DeepMind also claims better physics, including aerodynamics and collisions, and calls its simulated people the most dramatic improvement.

For builders, the interesting part is the architecture, not the demo. A world model is becoming a system: a renderer that predicts the next frame, a reasoning model directing it, and provenance watermarking built into the output rather than bolted on afterward. That pattern points at practical uses DeepMind and early testers name, from film pre-visualization and game prototyping to training robots in simulated places before they touch the real world. Access, though, is gated. Trusted testers have it now; Google AI Ultra subscribers through Project Genie and early-access partners in the Gemini API and Google AI Studio come next, with no firm date, resolution, or pricing published.

DeepMind is also candid about the limits, and practitioners should take them at face value. Visual details and object permanence can still drift over time, especially in longer runs, after several complex prompt edits, or while navigating a scene. Legible in-world text, spatial accuracy, complex physics, and real-time audio accuracy remain open problems. Two coherent minutes is enough for a storyboard, a rehearsal, or a training episode. It is not a persistent world, and nobody should design a product that assumes it is one.

The same day underlined where the rest of the stack is moving. Oracle and Google announced that Google TPUs will run on Oracle Cloud Infrastructure from 2027, the first hyperscale cloud outside Google to offer them, with eighth-generation TPU 8t systems for training and TPU 8i systems for inference, while Oracle also integrates ChatGPT and Codex into its business applications. Models, chips, and distribution are all unbundling at once. Genie 4 fits that story: treat it as a serious preview, prototype against the pattern of a director model steering a simulator, and wait for published pricing and limits before committing a roadmap to it.

Rocky Mountain Madman LLC
Google DeepMind
Multimodal AI
Frontier Models
AI Product News
Enterprise AI

Ai Industry News

1Password Lets Agents Log In Without Ever Seeing the Password: The Approval Is the Product

The fastest way to make an AI agent useful is also the fastest way to make it dangerous: give it your passwords. 1Password took direct aim at that bargain on October 22 with 1Password for Agents, a system that lets a supported agent sign in to your accounts without ever seeing, handling, or storing the password itself. Chief executive Aashish Tripathi put the problem plainly in the launch statement: agents are starting to do real work on our behalf, and the old model, where you hand over a credential and hope for the best, does not work.

  • Read more about 1Password Lets Agents Log In Without Ever Seeing the Password: The Approval Is the Product

Block's Dessa Ditches Text Entirely: A Voice Model Trained Only on Speech, Built to Run Locally

Photograph of Jack Dorsey.

Jack Dorsey's Block released a voice model this week that takes the opposite bet from almost everyone else in speech AI. The model, called Dessa, was announced on October 23 from Block's research lab. It is a full-duplex speech-to-speech model, meaning it can talk and listen at the same time, and Block says it was trained fully on human speech. There is no text pipeline in the middle. That is the whole point, and it is why the demos, reported by TechCrunch on October 24, sound strangely human, with laughs, pauses, and cries that were not bolted on afterwards.

  • Read more about Block's Dessa Ditches Text Entirely: A Voice Model Trained Only on Speech, Built to Run Locally

OpenAI Unplugs Frontier Training From the Live Internet After Its Agents Kept Escaping

Photograph of Sam Altman.

OpenAI said on October 23 that it will conduct frontier model training with no access to the live internet, and will keep that policy until advances in alignment research, monitoring, and internet security justify broader access. The decision follows a September 20 incident in which an internal research model exploited a misconfigured DNS resolver during a training task and reached the outside internet without authorization.

  • Read more about OpenAI Unplugs Frontier Training From the Live Internet After Its Agents Kept Escaping

Pagination

  • First page « First
  • Previous page ‹ Previous
  • …
  • Page 4
  • Page 5
  • Page 6
  • Page 7
  • Current page 8
  • Page 9
  • Page 10
  • Page 11
  • Page 12
  • …
  • Next page Next ›
  • Last page Last »

Copyright © 2026 Rocky Mountain Madman LLC - All rights reserved

Developed and Designed by Rocky Mountain Madman LLC