Kuaishou Virtual World Interaction Platform (KMIP): Technical Overview, Architecture, and Application Cases

Background and Current Status – Virtual world interaction refers to immersive multi‑person activities in a digital space, involving both real users and digital avatars for social, gaming, and exhibition purposes. Leading products such as Roblox, Zepet, Rival Peak, Tencent Music’s Tmeland, NetEase YaoTai, and Baidu Xirang illustrate the market landscape.

Kuaishou extends its short‑video and live‑stream ecosystem to a new virtual world form, enabling experiences like cloud dancing parties, online concerts, and interactive live games without altering users' familiar habits.

Technical Solution Overview – Kuaishou’s solution is split into a platform side (KMIP) built on PaaS foundations and a software side offering products such as the Kuaishou Virtual Broadcast Assistant (KVS) and the Kuaishou Face‑Capture Assistant (KFC).

KMIP Platform Architecture – The platform consists of three layers:

Infrastructure Layer : Manages compute, network, and storage resources, supporting both self‑built and third‑party clouds.

Compute Layer : Core capabilities including AI Engine, Graphics Engine, Audio‑Video, and Asset Library, providing AI‑driven rendering, RTC, and edge‑computing functions.

Access Layer : Handles authentication, intelligent scheduling, and cloud‑edge collaboration.

Key Platform Features

Multi‑Terminal Access : Supports PC, mobile, XR and other devices, catering to both creators (high‑end needs) and viewers (low‑threshold participation).

RTC Structured Data Transmission : Transfers motion capture, voice, text, control parameters, ensuring low‑latency, reliable interaction.

Multiple Rendering Modes : Offers client‑side, cloud‑side, and hybrid rendering to suit diverse scenarios.

Support for Various Roles : Enables real humans (via green‑screen) and digital avatars (IP, Avatar, etc.) to participate.

Massive‑Scale Co‑Screen : Allows thousands of participants to share a virtual space with first‑person or third‑person views.

Software Solutions

Kuaishou Virtual Broadcast Assistant (KVS) – A PGC‑focused tool that provides end‑to‑end digital‑human driving, high‑definition multi‑platform streaming, rich effects, 3D scene integration, and seamless connection to Kuaishou live‑room data.

Kuaishou Face‑Capture Assistant (KFC) – A UGC‑oriented tool that captures head, body, and hand motions using a single camera, supports DIY face modeling, Live2D/VRM imports, and features a “hanging‑mode” where the avatar remains on the desktop when the app is minimized.

Project Cases

Case 1 – Host‑to‑Host Interaction : Multiple virtual hosts co‑stream on the same digital stage, supporting both PC and mobile.

Case 2 – Host‑to‑Audience Interaction : Virtual avatars of hosts and audiences join cloud‑dance parties and concerts, enhancing engagement.

Case 3 – Innovative Scenarios : Interactive dramas and avatar‑driven experiences where audience actions influence story branches.

Summary and Outlook

The evolution from text‑image content to video, live‑stream, and now XR‑driven immersive experiences signals exponential growth in interactivity. Kuaishou aims to integrate resources, co‑develop digital‑human and XR solutions, and invite ecosystem partners to collaborate on future virtual‑world innovations.