Designing Map-Based Visual Storytelling for News Articles in Mixed Reality

Abstract

This study investigates how we can design map-based visual storytelling of news articles for Mixed Reality Head-Mounted Displays (MR HMDs). It explores the significance of visual storytelling genres and interactive gestures in the design. The findings reveal that principles of storytelling and interaction cannot be directly transferred from traditional PC interfaces to MR HMDs due to fundamental differences in interface and interaction. The study highlights the effectiveness of the dynamic slideshow format and far-interaction in enhancing the storytelling experience. Participants favored hand interactions but expressed interest in alternative methods such as gaze- and voice-based interactions. The challenges faced during the project, including recruitment difficulties, testing environment limitations, and technical issues, influenced the findings. The study emphasizes the need for tailored design principles for MR storytelling and multiple interaction methods to cater to user preferences. Overall, the findings provide valuable insights into designing map-based interactions in MR for visual storytelling, with consideration for the encountered challenges and limitations.