2023
Can Muggles take perspective on Wizards?
Overview
As the prevalence of Mixed Reality (MR) head-mounted displays (HMDs) grows, the context of collocated MR gaming is evolving from private, controlled environments to spontaneous, public settings, echoing speculative fiction scenarios. Everyday locales are thus transformed into potential gaming stages, blurring the line between designated play areas and the public realm. This evolution prompts the need for game designs that cater to all present individuals, including HMD players ("Wizards") and non-HMD bystanders ("Muggles"). Addressing this scantily researched field, we developed the Multiplayer Omnipresent Fighting Arena (MOFA) framework, utilizing device asymmetry and role diversification as affordance to actively engage every participant. MOFA explores this approach through a family of prototypes: The Training, The Duel, The Duck, The Dragon, and The Ghost. Each tests how different roles and devices can give people a place in a shared game.
MOFA was honored as the "Best Interactivity Demo" at CHI 2023 and "Best In The Show" at SIGGRAPH 2024.
Playing together in the same place
MOFA treats a street, room, or gathering as a potential arena. A headset wearer and a person holding a phone can occupy different roles in the same game. This device asymmetry is central to the design: participation does not depend on everyone wearing identical equipment.
The prototypes explore magical training, duels, and encounters with shared creatures. The Ghost develops the approach into an asymmetric social exertion game, documented in the CHI PLAY 2024 demonstration. Across these works, bodily movement and the responses of nearby people give virtual actions their social setting.
Making a shared arena
The system uses local Bluetooth and Wi-Fi networking and a coordinate-registration method based on QR codes. Nearby devices share the positions and timing needed to place their virtual content in the same physical space. This work led to InstantCopresence, published at ISMAR 2023 and released as a Unity package. Development account and SIGGRAPH Best in Show award.
Publications
Botao Amber Hu, Yilan Elan Tao, Yuchen Zhang, Sizheng Hao, and Rem RunGu Lin. 2024. "MOFA The Ghost: Demonstrating an Asymmetrical Social Exertion Game in Spontaneous Collocated Mixed Reality". In Companion Proceedings of the Annual Symposium on Computer-Human Interaction in Play (CHI PLAY Companion '24). Interactivity. Read more
Botao Amber Hu, Yuchen Zhang, Sizheng Hao and Yilan Tao. 2024. "MOFA: Multiplayer Omnipresent Fighting Arena". In Proceedings of the 2024 Conference and Exhibition on Computer Graphics and Interactive Techniques (SIGGRAPH ‘24). Immersive Pavilion. 🏆 Best in Show*. Read more
Botao Hu, Yuchen Zhang, Sizheng Hao, and Yilan Tao. "InstantCopresence: A Spatial Anchor Sharing Methodology for Co-Located Multiplayer Handheld and Headworn AR." In 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct '23). Demo. 🏆 Honorable Mention*. Read more
Botao Hu, Yuchen Zhang, Sizheng Hao, and Yilan Tao. 2023. "MOFA: Exploring Asymmetric Mixed Reality Design Strategy for Co-located Multiplayer Between Handheld and Head-mounted Augmented Reality." In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (CHI EA '23). Interactivity. 🏆 Best Interactivity Demo*. Read more
Exhibitions
CHI Play 2024 Interactivity. "MOFA the Ghost". Tampere, Finland.
SIGGRAPH 2024 Immersive Pavilion. "MOFA". Denver, U.S.A..
ISMAR 2023 Demonstrations. "InstantCopresence". Sydney, Australia.
CHI 2023 Interactivity. "MOFA". Hamburg, Germany.
Media and Talks
SIGGRAPH Blog: Immersive Experiences for All Environments Read more
Credits
Concept Designer: Botao Amber Hu
Interaction Designer: Botao Amber Hu
User Experience Designer: Yilan Tao
Interaction Engineer: Yuchen Zhang
Technical Artist: Sizheng Hao
Project contributors: Botao Amber Hu, Yuchen Zhang, Sizheng Hao, Yilan Tao