Roblox today revealed more details about its work on AI tools, in particular its moves towards creating 4D generative AI. According to the company’s announcement, the fourth dimension of generative AI is interaction, meaning it’s working on AI creations that can interact dynamically with the world in which they exist. This would allow game developers to set the state for unscripted interactions within the world.
Morgan McGuire, Roblox’s chief scientist, describes the current state of the company’s creation tools in a blog post, “The power of Roblox’s online platform is interaction — between people, objects, and environments. Unlike traditional online video games, Roblox’s powerful runtime engine leverages a unique programming and simulation model focused on interaction. This model is inspired by the concept of a metaverse, where elements meet in complex, many-to-many, and spontaneous ways, rather than in proscribed and limited ways.”
According to the same post, Roblox is working on some of the roadblocks to achieving 4D genAI, which include functionality, control and interactivity. The objects generated — and the generation process is the one that needs greater control, according to McGuire — need to be able to work the way the developer expects them to, while interacting with the world in ways that makes sense. McGuire says the company is working to train its AI generator in a multimodal manner while adding purpose-build optimizers.
Roblox founder David Baszucki chimed in with an explanation on X of how a 4D genAI-created object would work: “Roblox is now working on 4D generative AI, where that race car has an engine, moveable parts and a physics rig that enables it to drive down a track — all generated with just a text or voice prompt.”
Source link