1 views collected around this technical thread.
This article explains the required preparations, server configuration, and step-by-step PHP code to handle AR resource uploads, as well as the integration of WeChat Mini Program AR plugins and JavaScript calls, enabling developers to create AR experiences within Mini Programs.
2023’s mobile app development landscape is shaped by emerging trends such as the metaverse, blockchain integration, advanced AR, AI-driven voice and chatbots, and innovations in frameworks like Swift, Jetpack Compose, Kotlin Multiplatform, React Native, and Flutter, all influencing the future of iOS and Android solutions.
The 2022 mobile app development landscape is shaped by 5G adoption, foldable devices, AR/VR, wearables, food delivery, entertainment, AI/ML, security, super apps, mobile commerce, P2P payments, blockchain, predictive analytics, mobile learning, and IoT‑enabled apps, all driving faster, richer, and more secure user experiences.
MetaSight introduces a real‑time video‑stream subject recognition system that replaces the traditional capture‑upload‑search flow with continuous, on‑camera product identification, using a sub‑10 MB edge model, global IDs for frame continuity, edge‑cloud collaboration, and batch processing to cut interaction steps, lower server load, and pave the way for future AR/XR shopping experiences.
The article presents a mobile‑vision solution that combines lightweight detection, line detection, segmentation and 3‑D point‑cloud reconstruction to measure foot length within 3 mm error, and a MANO‑based hand‑try‑on system that predicts full mesh vertices for real‑time watch, phone and ring fitting on smartphones.
This article explains the WebXR standard for rendering 3D scenes in browsers, covers its history, browser support, step‑by‑step usage with WebGL, details the WebXR Device API objects such as XRSystem, XRSession, XRReferenceSpace, and demonstrates a panoramic VR image viewer with full code examples.
This article presents a comprehensive guide to Unity rendering pipelines, key terminology, and practical performance‑optimization techniques—including AR, texture, memory, heat, and package‑size improvements—applied to the VI Sales Crown product, with detailed tools, methods, and measurable results.
This guide introduces WebXR’s 3DoF/6DoF concepts, walks through building a basic A‑Frame scene, then shows how to add Mind‑AR face‑tracking with WebAssembly, WebGL2/WebGPU and event listeners, and even wraps it in a React component, outlining the three core steps for creating performant web‑based AR experiences.
Across social video calls, collaborative gaming, virtual furniture placement, and AR‑enhanced navigation, the article shows how 5G‑powered AR can boost presence, accuracy and convenience, while design strategies—optimal viewing angles, realistic scaling, safety‑aware cues, multimodal feedback, and gesture‑based mode switching—ensure intuitive, safe, and seamless user experiences in diverse scenarios.
In this translated AMA, Three.js creator Ricardo Cabello discusses his journey from the Demoscene to Google, the evolution of Three.js, challenges of open‑source maintenance, performance optimizations, WebGL versus WebGPU, VR/AR prospects, and the future role of web graphics in the metaverse.
‘All‑Things AR’ (万物AR) is a Kuaishou Y‑tech solution that lets users capture any real‑world object with a phone, automatically segments it using a custom AI model, and renders an animated 3D avatar via a lightweight SLAM‑based pipeline, enabling low‑cost, high‑quality AR experiences.
The article traces the Metaverse from its literary origin in Neal Stephenson's 1992 novel, explains the current investment frenzy by major tech firms, defines the concept through examples like the Oasis and Roblox's eight attributes, and outlines the key technologies—5G, edge computing, VR/AR/MR, blockchain, and AI—required to realize it while highlighting cost challenges.
The paper presents ARShoe, the first practical real‑time augmented reality shoe try‑on system for smartphones, detailing its multi‑branch neural network, foot pose estimation, rendering pipeline, a newly built foot dataset, and extensive experiments demonstrating high accuracy and over 30 FPS performance on multiple devices.
The article presents a mobile‑first solution that converts a single RGB photograph into an interactive 3D photo by combining learning‑based monocular depth estimation, multi‑task image‑and‑depth restoration, face‑specific refinement, and a custom KwaiNN inference engine to achieve real‑time rendering on all smartphone models without requiring depth sensors.
The article details Kuaishou Y‑tech's YKit AI SDK architecture, its unified interface, modular design, performance optimizations, and three real‑world case studies that illustrate how the SDK enables large‑scale, high‑quality short‑video effects across diverse devices while addressing challenges of effect variety, performance, and cost.
iQIYI’s AR+AI powered video interactive mini‑games blend a custom VideoAR engine with real‑time AI‑driven face and gesture detection, use lightweight Lua for game logic, and offer rapid hot‑updates, enabling diverse IP integrations that have attracted over a million participants and boosted viewer engagement.
This article explains how KAIFX, a synthetic data platform built on computer graphics and AI techniques, tackles challenges of data scarcity, realism, labeling bias, and management to boost AR and 3D face reconstruction model performance.
The presentation explains AR fundamentals, distinguishes it from AI and VR, and details a shoe‑try‑on system that captures 30 fps video, uses AI key‑point detection and pose estimation to overlay 3D shoe models—created via manual, scanning, or photogrammetry methods—rendered with GPU pipelines and PBR, enhanced by green‑screen occlusion and shadow techniques, earning positive audience feedback.
The article compares academic and industrial AI research by examining leadership, team composition, research focus, funding, compute resources, and data usage, outlines core AI elements and development challenges, presents JD's AR try‑on and try‑shoe projects, and proposes collaboration models and talent‑exchange mechanisms to bridge the two worlds.
This article explains the fundamentals of virtual reality and its distinction from augmented reality, describes VR hardware, outlines depth‑estimation and eye‑tracking methods such as projection, Hough transform, AdaBoost and sample matching, discusses Sobel edge detection, and explores the importance of audio, haptic feedback, and immersive VR applications in education.