Stats, Optimization, and Machine Learning Seminar - Sidney D'Mello

Sidney D'Mello, Institute of Cognitive Science, University of Colorado Boulder

Project Tesserae: Longitudinal Multimodal Modeling of Individuals in Naturalistic Contexts

I will describe our team’s efforts on a two-year Intelligence Advanced Research Projects Activity (IARPA) program called MOSAIC - Multimodal Objective Sensing to Assess Individuals with Context. The program’s ambitious aims are to “advance multimodal sensing to measure personnel and their environment unobtrusively, passively, and persistently both at work and outside of work, reduce the time and manpower required to process and integrate such data, and construct personalized and adaptive assessments of an individual that are accurate throughout the individual’s career.”
The premise of our team (called Project Tesserae) was to fuse information from low-cost mobile devices which individuals already use in their daily lives with accurate and robust machine learning techniques to develop generalizable models of psychological, health, and job performance measures. Towards this end, we conducted a year-long study of over 750 working professionals from across the US to explore the extent to which wearables, smartphones, Bluetooth beacons, social media, and other sensing streams can offer insights into individuals embedded in their social contexts. In this talk, I will present an overview of the Project Tesserae study design, offer insight on lessons learned, share experiences on various sensing technologies, and describe several early insights gained.
BIO: Sidney D’Mello (PhD in Computer Science) is an Associate Professor in the Institute of Cognitive Science and Department of Computer Science at the University of Colorado Boulder. He is interested in the dynamic interplay between cognition and emotion while individuals and groups engage in complex real-world tasks. He applies insights gleaned from this basic research program to develop intelligent technologies that help people achieve to their fullest potential by coordinating what they think and feel with what they know and do. D’Mello has co-edited seven books and published over 250 journal papers, book chapters, and conference proceedings (13 of these have received awards). His work has been funded by numerous grants and he serves(d) as associate editor for four journals, on the editorial boards for six others, and has played leadership roles in several professional organizations.

Tuesday, April 23 at 3:30pm to 4:30pm

Engineering Center, ECCR 257
1111 Engineering Drive, Boulder, CO 80309

Event Type



Science & Technology, Research & Innovation


Faculty, Students, Graduate Students, Postdoc

College, School & Unit

Engineering & Applied Science

Applied Mathematics
Google Calendar iCal Outlook