research · 2022

Design of a Virtual Reality Application for Interaction Prototyping in Remote Education

Hye-Young Jo, Wooje Chang, Hoonjin Jung, Andrea Bianchi

HCI Korea — Best Paper Award

This work designs VR applications for remote physical-computing education, proposing four scenarios — a realistic theory class, a 3D library, circuit assembly, and mixed-reality practice — grounded in expert interviews and design considerations.

Problem — hands-on electronics is hard to teach remotely

COVID-19 hit STEAM education hardest where physical practice matters most. Interaction Prototyping — a physical-computing course — depends on hands-on circuit work that the sudden shift to remote teaching made difficult. We mapped the flow of the class and interviewed instructors about the difficulties before and after the pandemic, then derived design considerations for moving the studio into a virtual environment.

Solution — four VR scenarios for electronics education

We propose four interaction scenarios that give students an intuitive, safe, and immersive place to practice.

① Real-time lecture with multiple users — a shared virtual classroom for live teaching.

② 3D component library — browse and inspect electronic parts in 3D.

③ Circuit assembly — build circuits hands-on without the risk of damaging real hardware.

④ Augmented breadboard — overlay guidance onto the breadboard for mixed-reality practice.

In collaboration with the KAIST Global Strategy Institute.