Title:  How to design an intelligent Augmented Reality assistant?

Abstract:  In this talk, I will discuss the lessons we learned from the Perceptually-enabled Task Guidance (PTG) project. In PTG, we designed an intelligent augmented reality (AR) assistant in the cooking domain using the Microsoft HoloLens 2 augmented with other sensors to perceive and understand the user and environment. The AR assistant leverages the knowledge from the PTG core system to guide the user via the spatial computing user interface (UI) and voice-user interface (VUI) to finish the task.

Bio: Yan-Ming Chiou is a research scientist at Palo Alto Research Center/PARC, where he explores augmented reality and computer vision applied to AR assistance systems. Dr. Chiou holds a Ph.D. in Computer Science from the University of Delaware and an M.S. degree in Communications Engineering from National Chung-Cheng University in Taiwan. His past research projects use innovative technologies, primarily augmented reality (AR) and social robots, to create educational applications.