My projects are focused on voice assistants (such as Google's Assistant or Amazon's Alexa) for older adults in the context of home health and wellbeing. I currently advise three groups of Cornell Tech master's students working on different aspects of these projects:
- My Care Questionnaire: We are working with a geriatric oncologist at Memorial Sloan Kettering Cancer Center (MSKCC) to adapt the Electronic Rapid Fitness Assessment (eRFA), a geriatric health assessment, to voice format. The goal is for patients to have the option to complete their health assessments using smart speakers. The project currently has two branches:
- Data pipeline tools: Mike (Kae-Jer) Cho and Eric (Yen-Hao) Chen are working on voice-based interactions for patients, and generating PDFs and visualizations of the data from the voice questionnaires for doctors. See the documentation of their work here.
- Graphical user interface (GUI) for creating voice user interface (VUI) surveys: Yimeng Sun and Srishti Gupta are working on creating a GUI for non-programmers to be able to create customized VUI surveys that can be directly taken using voice assistants. See the documentation of their work here.
- The Heritage Machine: Yiran Wang and Jingchun Huang are creating a voice app to generate questions that prompt conversations about a person's heritage. For this project, we are being mentored by the director of digital and technology innovation at StoryCorps.