The following is from the original text:
NVIDIA ACE (Avatar Cloud Engine) is a set of technologies that helps developers turn digital identities into reality using generative AI. Through ACE, non-player characters (NPCs) can be transformed into dynamic interactive characters that can initiate conversations or provide game knowledge to help players complete tasks.
At CES 2024, we announced the launch of ACE product-level microservices, providing top digital avatar developers NVIDIA Audio2Face (A2F) and NVIDIA Riva Automatic Speech Recognition (ASR).
We have also partnered with Convai to release the latest version of the Kairos demo to show how the next generation of AI NPC will revolutionize the game. Convai is an NPC developer platform that allows developers to easily allow characters in the 3D world to have human-like dialogue, perception and action capabilities.
NVIDIA ACE microservices are officially launched
Through ACE, middleware software, tools, and game developers can adopt state-of-the-art AI models (such as A2F and Riva ASR) and use them in digital avatars for games and applications.
Riva ASR allows players to talk to an AI character through a microphone rather than typing into it. The purpose of the ASR model is to allow gamers to speak freely and naturally, thereby achieving immersive dynamic conversations.
Audio2Face creates expressive facial animations for game characters based solely on sound sources such as text-to-speech models. A2F can be used for simultaneous generation of immediate facial expressions and lips, as well as offline creation of facial performances. Due to the uncertainty of NPC voice lines, timeliness has become a necessary requirement for AI NPC. In addition to free-form AI dialogue, developers also need models such as A2F to produce realistic facial performances.
Top game and interactive digital avatar developers adopt NVIDIA ACE
Leading interactive avatars and game developers are pioneering how ACE and generative AI technology can change the way players interact with characters. In addition to Convai, other developers adopting ACE include Charisma.AI, Inworld, miHoYo, NetEase Games, OurPalm, Tencent, Ubisoft, and UneeQ
Purnendu Mukherjee, founder and CEO of Convai, said: “Characters in the virtual world backed by generative AI will create a variety of use cases and experiences that were not possible in the past. Convai will use Riva ASR and A2F to create lifelike NPCs with low-latency response times and vivid and natural animations.”
Tencent Games said: “This is an important milestone in the use of artificial intelligence technology in games. NVIDIA ACE and Tencent Games will lay the foundation for the industry and create distinctive and lifelike digital identities and interactive methods for game creation.”
“For years, NVIDIA has been a leader in game technology, offering new and innovative ways to make games. NVIDIA is making games smarter and playable through the adoption of game AI technology, ultimately creating more immersive experiences.” –Hu Zhipeng, senior vice president of Netease and head of Leihuo Business Group
If you want to learn more, you can click on the link below the video.
Thank you for watching this video. If you like it, please subscribe and like it. thank
Original text:https://www.nvidia.com/zh-tw/geforce/news/nvidia-ace-architecture-ai-npc-personalities/
Oil tubing: