Close Menu
NERDBOT
    Facebook X (Twitter) Instagram YouTube
    Subscribe
    NERDBOT
    • News
      • Reviews
    • Movies & TV
    • Comics
    • Gaming
    • Collectibles
    • Science & Tech
    • Culture
    • Nerd Voices
    • About Us
      • Join the Team at Nerdbot
    NERDBOT
    Home»Nerd Voices»NV Tech»A Look at Google Deep Mind’s Genie & Its Use of Large Language Models
    NV Tech

    A Look at Google Deep Mind’s Genie & Its Use of Large Language Models

    Nerd VoicesBy Nerd VoicesMay 23, 20244 Mins Read
    Share
    Facebook Twitter Pinterest Reddit WhatsApp Email

    Rather than adding inductive biases, we focus on scale. We use a dataset of >200k hours of videos from 2D platformers and train an 11B world model. In an unsupervised way, Genie learns diverse latent actions that control characters in a consistent manner. pic.twitter.com/71a3iuAGZA

    — Tim Rocktäschel (@_rockt) February 26, 2024

    If you think text-to-video is the furthest we could get with today’s artificial intelligence (AI) technology, think again. GoogleDeepMind recently unveiled Genie – a generative interactive environment trained on Internet videos. In short, it’s an early prototype for a full-blown text-to-video-games model.

    Genie takes any text, image, photograph, or sketch prompt and generates a controllable virtual world out of it. But don’t expect the output to have triple A graphics just yet. The model is only capable of creating 2D platformers for now – just like the classic Super Mario Bros games we used to play. 

    How is this all possible? DeepMind shares that the model has 11B parameters, and was trained on over 200,000 hours of videos from 2D platformer games. Several models work behind the scenes – first, a tokenizer is used to compress each frame of the videos into discrete tokens, or units of data that serve as a basis for encoding and decoding. From there, a latent action model encodes the transitions between two frames as one of eight latent actions. A third dynamics model is then used to predict future frames. 

    This training allowed Genie to “learn diverse latent actions that control characters in a consistent manner.” Currently, the games generated by Genie only run at only 1FPS, but DeepMind’s Tim Rocktäschel clarifies that the model is not confined to 2D platform games. They trained another Genie on robotics data, and it was able to create controllable simulator games.

    Genie is the latest example of a “world model” in AI, where predictions guide the model’s actions. Developed following the concepts of unsupervised learning, this generative tool teaches itself, to the extent it can logically create a virtual environment in which to operate. 


    It’s safe to say this marks a significant milestone in AI gaming. The transition from raw data to a playable game isn’t instantaneous, but the prospect of generating full-fledged custom games from plain ASCII text is nothing short of groundbreaking. 

    It paves the way for an era where we can automate the design of custom games, transforming game narratives, characters, and environments in mere seconds. It’s not hard to envision a future filled with AI-driven dynamic gaming where characters and scenarios evolve in real time based on player choices and actions.

    In the realm of large language models (LLMs), Genie is a trailblazer as well. Taken as a whole, the model’s innovative use of LLMs demonstrates their potential to unravel intricate patterns and datasets, combine them and create something new. The large language models post by MongoDB explains how LLMs function similarly, working to predict the next word in a sentence based on the context provided. Genie takes this a notch higher and implements it in gaming – it predicts not just words but also actions and transitions in its game environment.

    Genie’s release comes on the heels of OpenAI’s Sora, a text-to-video model that translates text into “realistic and imaginative scenes.” Sora combines a diffusion model and a transformer architecture, where the diffusion model generates video pixels and the transformer predicts future frames. While the scenes look uncannily real, The DeepMind team pointed out that such outputs need actions, hence the birth of Genie.

    The implications of a text-to-video-games model are huge. Whether this technology or any AI progress is related to the massive layoffs in the game development industry in recent years remains a speculative question. An undoubtedly contentious issue, and one we cannot ignore as we edge closer to an era where a substantial part of the game development may happen by machine inference.

    As gamers, we can’t help but be intrigued by the possibility of truly intelligent, dynamic games crafted by the likes of Genie. Yet, it’s crucial that we view these advances with a healthy dose of caution. Not just thinking about the implications for game development, but largely about the broader impacts of AI on our society. Since there’s no public release date for Genie yet, we’ll just have to wait and see how this will all progress.

    Do You Want to Know More?

    Share. Facebook Twitter Pinterest LinkedIn WhatsApp Reddit Email
    Previous ArticleDriving Growth: Navigating Asset Finance Solutions
    Next Article Exploring the Latest Innovations in Mobility Scooters for Enhanced Comfort
    Nerd Voices

    Here at Nerdbot we are always looking for fresh takes on anything people love with a focus on television, comics, movies, animation, video games and more. If you feel passionate about something or love to be the person to get the word of nerd out to the public, we want to hear from you!

    Related Posts

    Faber Residence: Your Serene Escape Near Vibrant Amenities

    July 16, 2025

    Best Practices for Ensuring Safe Online Experiences

    July 16, 2025

    Why You Should Have A Windproof Travel Umbrella On Rainy Days

    July 16, 2025

    What Counts as an Internet Crime? Common Offenses and Legal Defenses

    July 16, 2025

    Is Cash Still King? Where to Park Your Money When Everything Feels Risky

    July 16, 2025

    The Role of AI in Redefining Music Production Workflows

    July 16, 2025
    • Latest
    • News
    • Movies
    • TV
    • Reviews

    “Stranger Things” Final Season Gets Official Teaser

    July 16, 2025

    Faber Residence: Your Serene Escape Near Vibrant Amenities

    July 16, 2025

    Best Practices for Ensuring Safe Online Experiences

    July 16, 2025

    Why You Should Have A Windproof Travel Umbrella On Rainy Days

    July 16, 2025

    Nominations for the 77th Annual Emmys

    July 15, 2025

    UNO Denies Las Vegas Casino but Announces Social Clubs

    July 14, 2025
    Human Skin Bear

    A Teddy Bear Seemingly Wrapped in Human Skin Found

    July 14, 2025

    Legendary May Be Considering Lionsgate Acquisition

    July 12, 2025

    Sarah Jessica Parker Gives Surprising “Hocus Pocus 3” Update

    July 15, 2025

    Jeffrey Combs Joins “Mystery of the Mothman” Cast

    July 15, 2025

    Nintendo Files Copyright for “Donkey Kong” Movie

    July 14, 2025

    Aaron Sorkin Set to Direct New Follow-Up to The Social Network at Sony Pictures

    July 13, 2025

    “Stranger Things” Final Season Gets Official Teaser

    July 16, 2025

    HBO Reveals First Look at New Harry Potter Actor in Costume

    July 14, 2025

    Zach Braff, Donald Faison, Sarah Chalke Return for “Scrubs” Reboot

    July 11, 2025

    Larry David Returns to HBO with American History Sketch Show

    July 10, 2025

    “Superman” Big, Beautiful Mess Bursting With Color, Hope [Review]

    July 11, 2025

    James Gunn’s “Superman” Brings Updated Meaning to the Man of Steel [Spoiler-Free Review]

    July 8, 2025

    The F11PRO 2 Drone – Pro-Level Performance Meets Sleek Design

    July 3, 2025
    "M3GAN," 2025

    “M3GAN 2.0” A Sequel That Forgets to Have Fun [Review]

    June 29, 2025
    Check Out Our Latest
      • Product Reviews
      • Reviews
      • SDCC 2021
      • SDCC 2022
    Related Posts

    None found

    NERDBOT
    Facebook X (Twitter) Instagram YouTube
    Nerdbot is owned and operated by Nerds! If you have an idea for a story or a cool project send us a holler on [email protected]

    Type above and press Enter to search. Press Esc to cancel.