Summary

  • Nvidia's generative AI creates dynamic NPCs for games, adapting them based on player actions for unique experiences.
  • Real-world uses of Nvidia's technology include digital healthcare agents and customer service avatars.
  • Ubisoft and other game developers are leveraging Nvidia's generative AI technologies for immersive gameplay.

Recently, Nvidia showcased its generative AI-based digital human technologies that can create dynamic, lifelike characters for use in games and other applications. With help from participating studios, Nvidia showed demos that leveraged these AI technologies to create immersive interactions with computer-generated avatars.

Digital human technologies is an umbrella term that includes Nvidia’s Avatar Cloud Engine (ACE), NeMo, and RTX tech. Among them, ACE facilitates speech recognition and animation tasks, NeMo revolves around natural language processing, and RTX technology is what enables devs to render high-fidelity models. Over the past few years, Nvidia has continued working on these technologies and sometimes shown them in action at events.

GeForce-Now
Two Years Later, Every Game The Nvidia GeForce Now Leak Got Right and Wrong (So Far)

The Nvidia GeForce Now leak was one of the most substantial leaks in gaming history, and several of the revealed titles have since released.

By 

At GDC 2024, an Unreal Engine 5-based demo from Inworld AI and Nvidia Covert Protocol showcased modular NPCs that adapt themselves with respect to the player’s actions – making sure each player experiences a unique playthrough. This demo uses Nvidia’s microservices to detect player voice input and animate NPC dialogues. Additionally, this dynamic NPC behavior is influenced by a character’s personality, emotional state, and the context of the interaction with the player.

Besides game demos, other possible real-world uses of Nvidia’s digital human technologies were shown at another recent event, GTC 2024. First off, Hippocratic AI revealed a look at a digital healthcare agent designed for handling specific tasks, such as care coordination and post-discharge management. It relies on Nvidia’s ACE, Audio2Face, Omniverse Streamer Client, and more technologies for the same. On top of that, UneeQ’s collaborative work on a digital avatar for customer service needs, which uses Nvidia’s tech and Synanim ML, also took the stage with a demo.

Games Will Soon Use Nvidia’s Generative AI Technologies

Among the big names, Ubisoft games may feature generative AI-fueled NPCs in the future. It shared three tech demos of NEO NPCs, its own variation of dynamic characters built using Inworld AI and Nvidia technologies. Bloom and Iron, the NEO NPCs reflected their conversation memory, contextual awareness, methodical decision-making, among other things in these demos.

Apart from that, there are announced games that will leverage these generative AI technologies to engage players. World of Jade Dynasty from Perfect World Games is set to use Nvidia’s Audio2Face technology to produce accurate lip-syncing for new languages. Adding to the list, this technology will also be used to create accurate facial animations for Unawake by RealityArts Studio and Toplitz Productions. As Nvidia's generative AI technologies pick up pace, more titles could adopt the same. It will be interesting to see to which degree the development pipeline will be optimized with these changes taking place.

  • Image
    GeForce RTX 3090 Founders Edition
    NVIDIA GeForce RTX 3090 Founders Edition
    Display card main info widget
    Brand
    NVIDIA
    Cooling Method
    Air
    Display card main info widget end

    Benefiting from NVIDIA's Ampere technology, the GeForce RTX 3090 is one of the first graphics cards capable of pushing 60 fps or higher at 8k resolutions. With more ray tracing and tensor cores, the RTX 3090 is a beast of a GPU for anything from gaming to intensive video editing. The 24 GB of memory in this graphics card allows professionals to reach their creative peaks, while NVLink maximizes the combined horsepower of CPU and GPUs. 

    Checkbox: control the expandable behavior of the extra info
    GPU Speed
    1395 MHz
    Interface
    PCIe 4.0 x16
    Memory
    24 GB GDDR6X
    Power
    350 W
    Boost Speed
    1695 MHz
    CUDA Cores
    10496
    See at Amazon
  • Image
    NVIDIA GeForce RTX 4090 Founders Edition
    NVIDIA GeForce RTX 4090 Founders Edition
    $2450 $2500 Save $50
    Display card main info widget
    Brand
    NVIDIA
    Display card main info widget end

    NVIDIA's top-of-the-line GPU, the GeForce RTX 4090 Founders Edition, contains 16,384 CUDA Cores. It can support up to 8K gaming and allows for actual, smooth ray-tracing gameplay. The Founders Edition card is also an excellent GPU variant in terms of cooling, VRMs, and value.

    Checkbox: control the expandable behavior of the extra info
    Cooling Method
    Air Cooled
    GPU Speed
    2235 Mhz
    Interface
    PCI-Express 4.0
    Memory
    24 GB GDDR6X
    Power
    600W
    Boost Speed
    2520 Mhz
    CUDA Cores
    16384
    See at Amazon $2450 at Newegg