Project 1 - Animap
We wanted to make hands-on MR experience available to everyone after developing the If I Ride VR
User need to use hands
Experience must be Intersection of physical activity and Mixed Reality
Ideation & Prototyping
We came up with many physical activities that we can blend the AR experiences.
The first idea we tried was blending origami with MR.
I started to wireframe the application’s flow to project the experience.
When we sketched tout he experience, the problem was that it was difficult for users to continue physical activities. (once you complete folding, it was end of the experience)
Also, this experience failed to involve educational materials, it was creating a passive behavior which is just listening to the narration.
Landing on a concept
From the user interview with educators, we found that one of K-12 material is learning about biome map.
For example, their are many types of climates in Africa and different animals live in a certain region depending on the climate. There are zebras in Savanna and Crocodile in Tropical rainforest.
We challenged to deliver this materials to children.
I started to make low fidelity wireframe to project the experience again.
We use the Vuforia to connect puzzle piece images to 3D modals.
First prototype with Unity 3D
We participated children events to get feedback from children. We observed how kids react to the experience.
1) Kids wanted to see multiple puzzle pieces at once. However, it was programed to detect one puzzle piece at a time
> Changed the app to detect multiple puzzle pieces
2) Kids wanted to hear story about the animals.
> Applied voice to describe facts about the climate and animals.
>Add a button on the 3D Modal so users can replay the narrative.
Project 2 - SkullFit
Kinect + HoloLens
Interactive education game application that let you play puzzle and scavenger hunt, while learning about anatomy.
Learning body anatomy is boarding and lots of memorization for young students.