Beyond Simple Motions: How SentiAvatar Redefines 3D Digital Human Action Generation

SentiAvatar introduces a two‑stage plan‑then‑infill framework that separates sentence‑level semantic planning from frame‑level prosody‑driven motion infill, leveraging a 200K‑sequence Motion Foundation Model and the newly released 21k‑clip SuSuInterActs dataset to achieve state‑of‑the‑art, real‑time expressive 3D digital human animation.

3D digital humansMotion Foundation ModelSentiAvatar

0 likes · 13 min read

Beyond Simple Motions: How SentiAvatar Redefines 3D Digital Human Action Generation

DaTaobao Tech

Mar 13, 2024 · Artificial Intelligence

AI Portrait Customization Technology for 3D Digital Humans

The paper introduces an AI‑driven portrait customization pipeline for 3D digital humans in Taobao Life 2 that leverages Stable Diffusion with a novel reference‑image injection and blend‑diffusion technique to preserve identity, diversify backgrounds, cut generation time to about 20 seconds, and support multiple artistic styles, achieving high‑quality, production‑ready avatars.

3D digital humansAI portrait customizationLoRA models

0 likes · 9 min read

AI Portrait Customization Technology for 3D Digital Humans