Intelligent Content Creation Tools for Augmented and Virtual Reality
The GTC is developing tools for creating intelligent characters that inhabit augmented reality worlds. The final goal is to have autonomous virtual characters that can navigate and interact with the real environment, as well as with the user.
GTC Team
Manuel Braunschweiler, Yukun Dai, Fraser Rothnie, Dr. Fabio Zünd, Prof. Robert W. Sumner
Collaborators
Ayça Takmaz (ETH MTC), Dr. Steven Poulakos (Disney Research Studios), Violaine Fayolle (Disney Research Studios), Prof. Soo-Mi Choi (Sejong University), Kyoung-Je Park (Perfect Storm Co., Ltd.)
This project tackles several problems in the realm of scene understanding, story technology, artificial intelligence, character animation and authoring UIs. To interact with the user, natural language processing is used, for which we are in close collaboration with another lab at ETH. As a first prototype, we created a virtual museum guide, which can lead the user through a small art exhibition, interact with the paintings and explain various facts about the exhibits to the user. For future prototypes, we want to target scenarios that are tailored towards peoples’ homes, such as characters for kids entertainment or a daily companion / assistant.
The project is a collaboration betweend the GTC, the Media Technology Center, DisneyResearch|Studios and the Sejong University, in Seoul.
