From text to animated 3D: next step in generative AI | | | | Turtles AI

  Masterpiece Studio, recently announced the creation of the world's first 3D generative AI that can now produce animations for game-ready 3D models from text prompts. According to this company, its breakthrough technology is set to revolutionize 3D creation by making it easier for anyone to create 3D objects, assets, and experiences. Today, there are many systems for moving from text to images, using generative models. These are models generated by deep-learning training, to which we will soon devote an in-depth thematic technical article, capable of producing images from textual descriptions. Our images accompanying articles are typically produced in this way, although they are based on specific and more elaborate processing than is briefly explained here. At a high level, the Masterpiece Studio team is reimagining what it means to be a 3D creator. They are focused on building effortless experiences for anyone who wants to create 3D, starting with rethinking how 3D should be approached in the first place. At a low level, this means simultaneously hiding complexity while making it controllable by creators in a simple way. The team is designing new product experiences to help more people express themselves with 3D models. The result will be an expansion of people's capacity to create useful content and new economic opportunities for all. Masterpiece Studio's mission is to unlock 1 billion 3D creators by empowering more people to create 3D objects, assets, and experiences. Today's generative 3D models are not usable in games and real-time environments without requiring an experienced 3D modeler for corrections. The team at Masterpiece Studio has addressed this issue by building the first generative AI to create game-ready 3D objects. Their platform includes an entire toolset to help creators generate 3D content that is usable in games today, and in the future, they plan to expand to training, education, social media, and commerce. The approach at Masterpiece Studio follows three stages: Generate, Edit, and Share. The first step generates the content, often a text prompt but can be other methods like photos, videos, or 2D graphics. Text prompts are imperfect, but they are a good starting point. The second step enables the refinement of the content, correcting issues in the originally generated content and adjusting the content to meet exact needs. The third step allows the content to be interoperable, so it can be deployed in a game, virtual world, 3D platform, or other 3D project. This generative AI can now specifically create game-ready 3D models and animations with just a few words. This technology enables users to instantly share and use the 3D models they generate for their creative projects. In a recent demonstration, Masterpiece Studio showcased an AI-generated character running in an existing virtual environment within Unreal Engine. This example illustrates that the AI-generated character is a game-ready asset that can run in a gaming engine. While there are currently many exciting new tools using generative AI, none of them yet produce game-ready 3D assets. Until now. Masterpiece Studio's generative AI is the first of its kind to create game-ready 3D objects. Although the company has not yet released the technology to the public, it plans to do so in the near future. The company is also seeking to expand its team and is looking for researchers and engineers in machine learning and 3D modeling algorithms to join them. The company is aware that creators may have questions about creating 3D alongside generative AI and what their feature set is capable of. They encourage feedback and shaping the future of 3D with passionate creators.