log in  |  register  |  feedback?  |  help  |  web accessibility
Logo
Human-AI Systems for Creating and Understanding Videos
Amy Pavel
https://umd.zoom.us/j/94543765116?pwd=clY3MVV5Z1g4T2xpdnJMdjFiMFhYdz09
Monday, March 22, 2021, 1:00-2:00 pm Calendar
  • You are subscribed to this talk through .
  • You are watching this talk through .
  • You are subscribed to this talk. (unsubscribe, watch)
  • You are watching this talk. (unwatch, subscribe)
  • You are not subscribed to this talk. (watch, subscribe)
Abstract

Video is becoming a core medium for communicating a wide range of content, including educational lectures, vlogs, and how-to tutorials. While videos are engaging and informative, they lack the familiar and useful affordances of text for browsing, skimming,and flexibly transforming information. This severely limits who can interact with video content and how they can interact with it, makes editing a laborious process, and means that much of the information in videos is not accessible to everyone.

But, what future systems will make videos useful for all users?

In this talk, I will share my work creating interactive Human-AI systems that combine the benefits of multiple mediums of communication (e.g., text, video, and audio) in two key areas: 1) helping domain experts find content of interest in videos, and 2) making videos accessible to people who are blind or have visual impairments. First, I will discuss core challenges of finding information in videos from interviews with domain experts and people with disabilities. Then, I will introduce new systems that leverage AI, and the results of technical and user evaluations that demonstrate system efficacy. I will conclude with how hybrid HCI-AI breakthroughs will make digital communication more effective and accessible in the future, and how new interactions can help us to realize the full potential of recent AI/ML advances.

Bio

Amy Pavel is a Postdoctoral Fellow at Carnegie Mellon University and a Research Scientist in AI/ML at Apple. Her research explores AI-driven interactive techniques for making digital communication effective and accessible for all. Her work creating Human-AI systems to improve communication has appeared at ACM/IEEE conferences including UIST, CHI, ASSETS, and VR. She recently served as an associate chair for the UIST and CHI program committees and was selected as a Rising Star in EECS. She previously received her Ph.D. in Computer Science at UC Berkeley, where her work developing interactive video abstractions was supported by an NDSEG fellowship and an EECS Excellence Award. Read more about her research at: https://amypavel.com/

This talk is organized by Richa Mathur