What Does a Voice Interaction Designer Actually Do? A Practical Guide
This article explores the rise of voice interaction design, outlines the responsibilities and skills of a voice UI designer, reviews industry examples from major tech firms, and recommends essential resources for anyone interested in building conversational experiences.
Even in 2017, AI remains hot, and the evolution of cool technologies promises to reshape how humans interact with machines. While finger‑based touch interaction stays dominant, a new design discipline—Voice User Interaction Design (VUI)—is emerging.
2014: Amazon launches Echo 2016: Google launches Google Home 2017: Microsoft & Harman launch Invoke 2017: Apple releases HomePod
Chinese companies have also rushed into the voice interaction field:
January – Baidu releases DuerOS January – Lenovo shows a smart speaker at CES March – Haier launches a smart home speaker May – Rokid releases the second‑generation RuoQi speaker June – JD DingDong releases its second‑generation speaker June – Ximalaya and three others launch XiaoYa AI speaker June – Tencent releases Xiaowei voice platform June – iFlytek unveils MORFEI microphone July – Alibaba releases Tmall Genie X1 and opens the AliGenie developer platform July – Xiaomi releases AI speaker
These moves show that both global and domestic giants are racing into voice interaction, hoping to be early adopters in the emerging AI era.
The role of a voice interaction designer is illustrated by examples from Amazon, Google, and the Cozmo robot team. At Amazon, the Echo team discusses UI design, voice shopping, and Alexa’s persona. Google’s VUI leader explains the differences between VUI and GUI, design principles, and workflow. Cozmo’s sound designers show how voice personality aligns with a robot’s character.
Key responsibilities include defining the product’s character and backstory, selecting appropriate voice talent, understanding technical constraints (e.g., multi‑turn dialogue limitations), writing dialogue scripts, and integrating voice with visual interfaces (multimodal design). Designers must also conduct user research and usability testing, such as limiting voice prompts to about 20 seconds based on Alexa guidelines.
Typical deliverables are:
Scenario dialogue scripts (you may not act, but you must write like a screenwriter)
Audio prototypes created with recording equipment and editing software
User research and testing reports
Recommended reading for VUI designers includes:
"Voice User Interface Design" by Michael Cohen, James Giangola, Jennifer Balogh (2004)
"Designing Voice User Interfaces: Principles of Conversational Experiences" by Cathy Pearl (2016)
"Sonic Boom" (Chinese edition "音爆") by Joel Beckerman, Tyler Gray – focuses on product sound design and branding.
Beyond books, a solid grasp of linguistics (alphabet, syntax, language families, dialects) and scriptwriting fundamentals is essential, as voice products need a consistent “machine persona” that never collapses.
Final thought: When users speak vulgar language to an AI, should the system respond, and if so, how should it reply?
Signed-in readers can open the original source through BestHub's protected redirect.
This article has been distilled and summarized from source material, then republished for learning and reference. If you believe it infringes your rights, please contactand we will review it promptly.
网易UEDC
NetEase UEDC aims to become a knowledge sharing platform for design professionals, aggregating experience summaries and methodology research on user experience from numerous NetEase products, such as NetEase Cloud Music, Media, Youdao, Yanxuan, Data帆, Smart Enterprise, Lingxi, Yixin, Email, and Wenman. We adhere to the philosophy of "Passion, Innovation, Being with Users" to drive shared progress in the industry ecosystem.
How this landed with the community
Was this worth your time?
0 Comments
Thoughtful readers leave field notes, pushback, and hard-won operational detail here.