NZEB Retrofit VR Simulator

Role: Primary Programmer and XR Interaction Developer

Employer: Emagine

Project Description: This project is a training simulator designed to teach students how to perform near-zero energy retrofits on a variety of house and wall types. The goal is to provide practice and training that is safe, repeatable, and waste-free.

Interesting/Unique elements

Physically Accurate: All tools are fully physics-based, meaning they bounce and react realistically with the environment when held by the player. This is used to full effect in certain steps, such as when the player needs to sweep debris from walls.

Miniature Building: In a few stages of the training, the player places elements on a miniature model in front of them. At the same time, a larger version of the model in the background updates to match the miniature as the student progresses.

X-Ray Torch: In certain stages, students need to see inside the walls they are working on. To achieve this, they use a torch that makes the targeted area of the outer wall invisible when pointed at it.

Remote View App: Teachers can monitor student activity through a companion app. The app displays all connected headsets and their current activities, and it also provides a live video feed from the student’s perspective.

Wrist Menu: A tool menu on the user’s wrist allows them to reset their position, adjust their floor height, or restart the scene. The wrist screen also continuously tracks the student’s progress and reminds them of their current task.

Pop-Up Help Tips: At any step, students are guided by pop-up messages that appear just below the user’s centre of sight. These tips may also include guiding lines to help the student understand what to do.

Previous
Previous

Pulse XR: Immersive Healthcare Learning