Tower Escape Game

This is a Demo Game for my Augmented Reality Interactive Assembly Instructions Project. 

Similar to how an interactive navigation system improves people's lives over a static map, customers would benefit if the company could provide them with an interactive assembly instruction system in addition to the passive print manual or demonstration videos when they are assembling the furniture they purchased.

However, an interactive assembly instruction system requires a deeper understanding of the posture estimation of targeted objects than is possible with the vast majority of RGB-only object detection. 

My approach included implementing an RGB-only 6D Pose Estimation model called singleshotpose by Microsoft and trained it on the custom dataset I created within a virtual environment built with Unity3D engine. 

I created an interactive system in Unity3D with actual users playing the game, so that we can observe how the system performed in a simulation environment with a high degree of user logic resemblance to the real world. 

The demonstration video and live performance illustrates that the synthetic data generated and the system developed provide workable solutions for pose detection in a virtual environment containing multiple puzzle pieces and a solution algorithm.