Digital Humans and XR Interaction Forum at DataFunCon2023

Accelerated by AI, digital human technology is continuously delivering business innovation and economic benefits, becoming more realistic, interactive, and evolving toward AI‑Beings with multimodal capabilities.

At DataFunCon2023, the Digital Humans and XR Interaction Forum features experts sharing the latest developments from foundational frameworks to top‑level applications.

Speaker: Zhao Zhongzhou (Alibaba DAMO Academy, Digital Human Interaction Algorithm Lead) Zhao has over a decade of HCI experience, leading the creation of industry‑first virtual e‑commerce hosts and sign‑language digital humans, focusing on multimodal interaction, affective computing, and cognitive reasoning.

Talk Title: From Avatar to AI Being: The Evolution of Digital Human Interaction

In this talk, Zhao will discuss challenges such as real‑time interaction, emotion computation, personality modeling, and the future of digital humans empowered by large language models.

Outline:

Overview of digital human technology, applications, and challenges

Full‑duplex real‑time interaction breaking latency barriers

Emotion and cognitive computing for human‑like brains

Unified personality representation for multimodal expression

LLM‑driven path toward digital human AGI

Audience Benefits: Learn current digital human status, full‑duplex interaction principles, emotion and personality computing techniques, and LLM integration trends.

Speaker: He Zhan (NVIDIA China, Omniverse Business Lead) He oversees Omniverse and RTX enterprise product lines in China, with deep expertise in AI, machine learning, and digital twin applications.

Talk Title: Digital Virtual Human Technology Transformation in the LLM and Generative AI Era

He will explore how large‑scale language models and generative AI empower digital virtual humans, and how computer vision, graphics, physics simulation, AI, XR, and cloud‑native technologies converge.

Speaker: Jian Weihua (Kuaishou, Visual Interaction Tech Lead) Jian has over 10 years in video AI and XR, previously at Huawei and Tencent, now leading 3D digital human solutions and virtual world interaction platforms at Kuaishou.

Talk Title: Kuaishou 3D Digital Human Live Streaming and Interaction Solution

He will present the KVSS architecture, virtual studio solution, and the Kuaishou Metaverse Interactive Platform, demonstrating how 3D digital humans enable live streaming, social interaction, and metaverse applications.

Speaker: Ding Yu (NetEase Fuxi, Chief Virtual Human Expert) Ding focuses on virtual human research, with over 50 publications, multiple top‑conference awards, and pioneering 135 facial expression standards.

Talk Title: Frontiers of Voice‑Driven Facial Expression Synthesis

The talk covers voice‑to‑video generation, 2D pixel‑level synthesis, 3D animation, lip‑sync, eyebrow/eye synthesis, and head pose, highlighting recent advances, challenges, and application scenarios.

Audience Benefits for All Sessions: Gain insights into digital human development, interaction technologies, multimodal expression, LLM integration, and future trends in AI‑driven virtual beings.