Can Unconscious Design Make Gesture Interfaces Instinctive?

1. Development and Challenges of Gesture Interaction

Over the past 50 years, user interfaces have evolved through three stages: command-line interfaces (CLI), graphical user interfaces (GUI), and natural user interfaces (NUI). The introduction of the iPhone in 2007 popularized NUI, allowing users to interact via touch, gestures, and voice, creating more natural and human‑centric experiences.

While gestures offer engaging and natural interactions—such as the classic iPhone slide‑to‑unlock—they also suffer from discoverability and memorability issues because gestures are invisible and can be hard for novice users to recall.

Designers therefore ask: "How can users naturally discover and master gestures without cognitive burden?"

2. What Is Unconscious Design

Unconscious design, coined by Naoto Fukasawa, draws from Freud’s concept of the unconscious and aims to embed design into users' everyday behaviors so that interaction requires no conscious thought.

According to Zhang Jian, unconscious design can be divided into four types: objective sketching, unconscious grafting, perceptual substitution, and individual concept enhancement. The article focuses on the first two, which are most relevant to interaction design.

2.1 Objective Sketching

This method leverages direct perception, as described by J.J. Gibson, where perception occurs without inference. Designers create cues that trigger immediate, instinctive responses.

Example: Designing a trash can with a right‑angled corner signals users to place it in a corner, preventing accidental tipping.

2.2 Perceptual Substitution

Designers extract unconscious cues from one object (A) and amplify them to replace the perception of another object (B), allowing users to apply familiar experiences to new interactions.

Example: A CD player designed to resemble a ventilation fan lets users pull a cord, evoking the feeling of “air flowing” when the device is activated.

3. Interpreting Gesture Interaction Cases from an Unconscious Design Perspective

By dissecting common gestures—single‑finger drag, two‑finger rotate, and pinch‑to‑zoom—we see they map onto everyday physical actions that users already understand, enabling natural adoption without explicit learning.

In OPPO’s foldable‑screen split‑screen gesture, a two‑finger downward swipe at the top of the screen mimics cutting a sheet in half, aligning the mental model of a knife cutting with the finger’s motion, resulting in a satisfying and intuitive experience.

Other examples include iPad’s four‑finger grab to return to the home screen and Huawei’s circular joint‑finger screenshot, all of which rely on users' real‑world experiences translated through objective sketching or perceptual substitution.

4. Conclusion

Current mobile devices rely on capacitive touchscreens, limiting gesture variety. Emerging technologies like Apple Vision Pro demonstrate the potential for 3D, immersive gestures that go beyond 2D screens. Unconscious design offers a systematic approach to map familiar real‑world behaviors onto novel interaction techniques, helping designers create intuitive, low‑cognitive‑load gesture interfaces.

References:

新交互时代：自然用户界面中的“自然”到底是什么意思？, 2016, 曹翔

Gestural Interfaces: A Step Backward In Usability, 2010, Donald A. Norman, Jakob Nielsen

Touch Gesture Reference Guide, 2010, Craif Villamor, Dan Willis, Luke Wroblewski

简析电容触摸屏的原理及3D触控技术, 2020, 显示网

Affordance（可供性）和设计, 2011, HI‑iD

从信息与无意识交换视角解读无意识设计, 2018, 张剑