Seminars and Events
Human-AI Interaction: From Supporting Surgical Training to Inspecting Social Bias in LLMs
Event Details
Speaker: Rafał Kocielnik
Location: ISI Marina del Rey, Conference Room 1135/37. In-person attendance for USC-ISI faculty, staff, and students only. Open to the public virtually via Zoom.
Friday, May 31, 2024 from 11am – 12pm
Join Zoom meeting: https://usc.zoom.us/j/99601436181?pwd=d0Y5eTZPbHRjM2t3NHc5cXRMNkE1dz09
Meeting ID: 996 0143 6181 | Passcode: 994144
Hosted by: Myrl Marmarelis
POC: Karen Lake
Abstract: In this talk, I will present my recent contributions to Human-AI interaction, focusing on two distinct projects looking at opportunities and challenges involved in the use of modern AI. In the first part of my talk, I will present my work on leveraging AI in clinician education, specifically within the surgical context. I will detail my work on utilizing multimodal deep-learning techniques to analyze formative feedback from surgeons to trainees in the context of real-world robot-assisted surgeries. This project marks a significant step forward in harnessing contemporary AI for the specialized domain of surgical education, receiving the best paper award at the ML4H conference. For the second part of my talk, I will focus on Human-AI interaction in the context of empowering domain experts (e.g., social scientists and ethicists) to inspect modern generative AI for the presence of harmful stereotypes. I will describe our BiasTestGPT framework which offers two important contributions: 1) a novel approach for generating high-quality synthetic data for social bias testing at scale and 2) a user-friendly and open-sourced interface for engaging the general public and domain experts in the inspection of modern AI. Together, these projects demonstrate opportunities in leveraging Human-AI interaction for supporting specialized domains and helping inspect the challenges in AI itself.
This event will be recorded.
It will be posted on our USC/ISI YouTube page within 1-2 business days: https://www.youtube.com/user/USCISI.
Speaker Bio
Rafał Kocielnik is a Postdoctoral Researcher at Caltech's Computing+Mathematical Sciences department, where he also collaborates with Cedars-Sinai Medical Center and Activision Blizzard gaming company. He holds an M.Sc. in Computer Science from the Polish-Japanese Academy of Information Technology, a P.D.Eng. in Industrial Design from Eindhoven University of Technology and completed his Ph.D. in Human-Centered Design & Engineering at the University of Washington, Seattle, in 2021. His focus was on designing engaging conversational interactions for health and behavior change. Awarded a CRA Computing Innovation Fellowship in 2021, his research at Caltech explores the intersection of AI and HCI with applications in surgical training, social bias testing in Generative AI, and toxicity mitigation in gaming. He has received Best Paper awards at CSCW and ML4H, with an Honorable Mention at CUI, underscoring his interdisciplinary focus and commitment to advancing AI and HCI for human-centered applications.
Visit links below to subscribe and for details on upcoming seminars: