Perceive The Spatial Flow Of The Canvas Enhancing The Experience Of Roaming Chinese Landscape Scrolls Using Augmented Audio Reality Aar
Thesis Masters2025

Perceive the Spatial Flow of the Canvas—— Enhancing the Experience of Roaming Chinese Landscape Scrolls Using Augmented Audio Reality (AAR)

MSCD

Abstract

Traditional Chinese landscape scrolls embody the concept of "Wandering/ Roaming", inviting viewers to immerse themselves in compositions that convey time, movement, and spatial flow. While existing studies explore the integration of traditional aesthetic forms with novel technologies, they often treat these artworks as static, overlooking the spatial-temporal dimensions inherent in Chinese scroll paintings. This research explores how Augmented Audio Reality (AAR) can reinterpret and enhance the immersive experience of roaming scrolls. The prototype utilizes Ultra-Wideband (UWB) sensors to track the position of the user's headphones within a defined space, capturing real-time movement. An Inertial Measurement Unit (IMU) monitors tilt and orientation, enabling sound to respond spatially and adapt to user perspective. Unity serves as the development platform, managing spatialized soundscape via the Audio-Source components, corresponding with scroll elements and user interactions. Spatial-temporal movement analyses and soundscape heatmaps revealed that three categories of spatialized audio prompts most effectively guided attention and deepened engagement with the roaming experience. By merging AAR with traditional art, this framework reimagines cultural artifacts as multisensory, interactive encounters-bridging heritage and contemporary audiences.

Perceive the Spatial Flow of the Canvas—— Enhancing the Experience of Roaming Chinese Landscape Scrolls Using Augmented Audio Reality (AAR)
Figure 18: Prototype Interaction Diagram, drawn by the author, Figure 25: Loge space, College of Fine Arts floor 4, photo by the author
Figure 18: Prototype Interaction Diagram, drawn by the author, Figure 25: Loge space, College of Fine Arts floor 4, photo by the author
Explore Generative AI Models for Vector-Based 3D Architecture Data
Explore Generative AI Models for Vector-Based 3D Architecture Data
How This Connects
Qilin WuQilin WuDaragh ByrneDaragh ByrneGolan LevinGolan Levin
Perceive the Spatial Flow of the Canvas—— Enhancing the Experience of Roaming Chinese Landscape Scrolls Using Augmented Audio Reality (AAR)
Open in Constellation View