Presented present a system pipeline that supports reminder authoring through natural language and conversational interaction. The pipeline translates user requests into structured representations and executable logic, incorporating time-based, activity-based, sensor-based, and state-based conditions. We conducted two studies to examine how users express reminder intent and how conversational support influences the authoring process.

Explored how LLMs can be used to generate retrospective summaries from multi-modal tracking data for RFMs of older adults. We generated summaries as technology probes, and conducted interviews with 11 RFMs to gather feedback. Based on these insights, we redesigned the system into a multi-layer, multi-agent, insight-driven summary approach that builds from objective statistics and descriptions to enriched, context-aware narratives.

Explored the design of context-aware assistive technologies for meal preparation using a user-centered iterative design process. Through three iterative phases of design and feedback, evolving from low-tech lightbox to a digital screen, we gained insights into managing diverse contexts and personalizing assistance through collaboration with older adults with MCI and their care partners.

Explored users' successful and unsatisfactory experiences with assistance from an LLM-based conversational agent, Mango Mango, during cooking.

Explored the impact of game fidelity on player empathy using the commercial reminiscing game Brukel, comparing a high-fidelity 3D version with a low-fidelity text-based version.

Explored user interactions with LLM-based voice assistants during a complex task -- cooking. We identified key verbal & nonverbal behaviors, and developed an analytical framework in three dimensions: 1. Key behavior characteristics (verbal & nonverbal), 2. Interaction stages (exploration, conflict, integration), 3. Stage transitions during the task.

Introduced an application that enables users to create their own playing cards for use in evocative storytelling games that generate unique card titles, cards suits, imagery, and poetry based on the user’s input to preserve their digital cards in an online repository and print them for tabletop game play use.

Explored whether a game design with higher fidelity and a specific type of scene would correlate with a better player experience compare to low-fidelity game using a commercial gaminiscing game, Brukel.

Catch The Butterfly is a narrative game exploring the real, lived experiences of an immigrant. This game aims to provide insights to game designers interested in the gaminiscing method, and to promote empathy and understanding of immigrants.

Explored the utilization of the gaminiscing method in the design of a narrative-driven game, where every game mechanic is derived from the authentic stories of an immigrant.