Skip to header Skip to main navigation Skip to main content Skip to footer

Google's Genie 4 Gives Its World Model a Voice, and Lets You Rewrite the Scene Live

Breadcrumb

  • Home
  • Google's Genie 4 Gives Its World Model a Voice, and Lets You Rewrite the Scene Live

Google DeepMind announced Genie 4 on October 27 as a research preview for trusted testers, and the headline change is sound. The new world model generates explorable, interactive scenes in real time from a text prompt or an image, and for the first time it produces audio natively alongside the picture: ambient noise, music, and characters who can converse and react as events unfold. DeepMind says scenes now hold together for up to about two minutes, roughly double the limit reported for Genie 3, and every video and audio clip it emits carries a SynthID watermark.

The second change is control while the simulation is running. Users navigate with keyboard controls and can type natural-language prompts mid-scene to change the weather, move the camera, or introduce a new person or object, instead of starting over with a fresh prompt. Behind that sits a small stack of Google models: Gemini Omni anchors how objects look and behave, while Gemini 3.8 Flash serves as a guiding agent inside the loop, observing the scene, breaking goals into steps, and checking frames as Genie renders them. DeepMind also claims better physics, including aerodynamics and collisions, and calls its simulated people the most dramatic improvement.

For builders, the interesting part is the architecture, not the demo. A world model is becoming a system: a renderer that predicts the next frame, a reasoning model directing it, and provenance watermarking built into the output rather than bolted on afterward. That pattern points at practical uses DeepMind and early testers name, from film pre-visualization and game prototyping to training robots in simulated places before they touch the real world. Access, though, is gated. Trusted testers have it now; Google AI Ultra subscribers through Project Genie and early-access partners in the Gemini API and Google AI Studio come next, with no firm date, resolution, or pricing published.

DeepMind is also candid about the limits, and practitioners should take them at face value. Visual details and object permanence can still drift over time, especially in longer runs, after several complex prompt edits, or while navigating a scene. Legible in-world text, spatial accuracy, complex physics, and real-time audio accuracy remain open problems. Two coherent minutes is enough for a storyboard, a rehearsal, or a training episode. It is not a persistent world, and nobody should design a product that assumes it is one.

The same day underlined where the rest of the stack is moving. Oracle and Google announced that Google TPUs will run on Oracle Cloud Infrastructure from 2027, the first hyperscale cloud outside Google to offer them, with eighth-generation TPU 8t systems for training and TPU 8i systems for inference, while Oracle also integrates ChatGPT and Codex into its business applications. Models, chips, and distribution are all unbundling at once. Genie 4 fits that story: treat it as a serious preview, prototype against the pattern of a director model steering a simulator, and wait for published pricing and limits before committing a roadmap to it.

Rocky Mountain Madman LLC
Google DeepMind
Multimodal AI
Frontier Models
AI Product News
Enterprise AI

Ai Industry News

India Targets AI Regulation Paper in 30 Days and 10,000 GPUs for Public AI

Cartoon illustration of a giant computer chip wearing an official document as a cape before a grand government building with balance scales.

While Washington argues about what to call AI, New Delhi is doing something more consequential: writing the rulebook and buying the chips to enforce it.

India's Union Minister Ashwini Vaishnaw announced on October 8 that the government will publish an AI regulation consultation paper within thirty days. Speaking at an event in New Delhi, he told his department to produce a document focused primarily on safety — covering AI safety, deepfakes, liability gaps, and skilling — as the foundation for a future techno-legal framework.

  • Read more about India Targets AI Regulation Paper in 30 Days and 10,000 GPUs for Public AI

Meta's AI Ad Tools Go In-Chat: Advantage+ Video GA and Shopify Checkout at Ad Week

Cartoon illustration of a robot salesperson handing a shopping bag and a credit card to a customer inside a chat bubble with floating video play buttons.

Meta's AI now makes the ad and buys the product. At Advertising Week New York on October 6, the company showed brands how the whole funnel collapses into a chat window.

  • Read more about Meta's AI Ad Tools Go In-Chat: Advantage+ Video GA and Shopify Checkout at Ad Week

Meta and Sierra Draft the Personal Agent Protocol, an Open Sign-In Standard for Agents

Cartoon illustration of a robot agent presenting a passport-style ID card to a shopkeeper at a storefront checkout while a scanner glows.

Your AI agent is about to walk into a store. Meta and Sierra want to make sure it knows how to knock.

On October 6, at Sierra Summit in San Francisco, Sierra and Meta announced the Personal Agent Protocol — PAP, an open standard for how a person's AI agent signs in to a business and gets a task done there. Sierra co-founders Bret Taylor, the former Salesforce co-CEO, and Clay Bavor published the announcement with founding partners Walmart, Stripe, Shopify, Genesys, Rocket, and Instinct.

  • Read more about Meta and Sierra Draft the Personal Agent Protocol, an Open Sign-In Standard for Agents

Pagination

  • First page « First
  • Previous page ‹ Previous
  • …
  • Page 18
  • Page 19
  • Page 20
  • Page 21
  • Current page 22
  • Page 23
  • Page 24
  • Page 25
  • Page 26
  • …
  • Next page Next ›
  • Last page Last »

Copyright © 2026 Rocky Mountain Madman LLC - All rights reserved

Developed and Designed by Rocky Mountain Madman LLC