Nvidia Open-Sources AI Tool That Creates Realistic 3D Avatar Facial Animations from Voice Audio
Summary
Nvidia open-sources Audio2Face, a groundbreaking AI tool that automatically generates realistic facial animations and lip movements for 3D avatars using only voice audio input, giving developers free access to create lifelike digital characters for games, apps, and livestreams.
Key Points
- Nvidia open-sources Audio2Face, its AI-powered tool that generates realistic facial animations for 3D avatars based on audio input
- The technology analyzes acoustic features of voices to create animation data that maps to facial expressions and lip movements for 3D characters
- Developers can now access the models, software development kits, and training framework to customize the tool for games, apps, and livestreams