Exciting news in the gaming world! Microsoft has launched Muse, its groundbreaking generative AI model specifically designed for video game development. This innovative project, spearheaded by the Microsoft Research Game Intelligence and Teachable AI Experiences teams alongside Xbox Game Studios’ Ninja Theory, introduces the World and Human Action Model (WHAM).
Muse – A New Era in Gameplay
According to a Nature paper by Katja Hofmann, the Senior Principal Research Manager and head of the Game Intelligence team, Muse can generate game visuals and controller actions through an advanced understanding of 3D game environments. Leveraging WHAM-1.6B, which boasts 1.6 billion parameters, Muse was trained on over 1 billion images and controller actions, equivalent to more than seven years of Ninja Theory’s gameplay data from the game Bleeding Edge.
Collaboration and Open-Source Access
This remarkable model is a product of collaboration between Ninja Theory and Microsoft Research in Cambridge, UK. It utilizes ethically sourced gameplay data, ensuring player consent through the End User License Agreement. To foster further innovations, Microsoft is open-sourcing Muse’s weights, sample data, and the WHAM Demonstrator, which is available on Azure AI Foundry.
How Muse Works
Muse demonstrates its capabilities by generating gameplay sequences lasting up to two minutes. By using just 10 frames of human gameplay, it intelligently predicts game evolution, capturing the essence of Bleeding Edge’s dynamics. This allows for a diverse range of behaviors and visuals, ensuring gameplay respects physics while adapting to user modifications.
The Research Journey Behind Muse
Initiated in December 2022, Muse was inspired by the release of ChatGPT. The researchers scaled training significantly, showing remarkable advancements from basic recognition to mastering complex game mechanics. Ninja Theory’s technical director, Gavin Costello, expressed excitement about the technology’s potential in reshaping gameplay experiences.
Muse’s Impact on Gaming
Muse is set to revolutionize AI-driven game design. Already in use for developing a real-time playable AI model, it holds promise for reviving classic games and aiding developers in prototyping new ideas. Fatima Kardar, Corporate Vice President of Gaming AI, emphasizes that this could dramatically change how we preserve and experience gaming history.
Availability and Access
Muse is now available for researchers and developers, with its model weights and data accessible on Azure AI Foundry. Keep an eye out for interactive AI game demos on Copilot Labs soon! For those seeking the latest deals and offers, don’t forget to check out looffers.com for amazing discounts on gaming products and more!
