log in  |  register  |  feedback?  |  help  |  web accessibility
A Neuromorphic Approach to Visual Motion and Action
Cornelia Fermüller
Zoom Link-https://umd.zoom.us/j/92977540316?pwd=NVF2WTc5SS9RSjFDOGlzcENKZnNxQT09
Tuesday, March 28, 2023, 11:00 am-12:00 pm Calendar
  • You are subscribed to this talk through .
  • You are watching this talk through .
  • You are subscribed to this talk. (unsubscribe, watch)
  • You are watching this talk. (unwatch, subscribe)
  • You are not subscribed to this talk. (watch, subscribe)

Neuromorphic Computing is a vertical approach of computer engineering of both hardware and software design that seeks to emulate principles of the human brain and nervous system for efficient, low-power, and robust computation, and in recent years various individual concepts have been adopted in main-stream engineering. In this talk I will describe my work on neuromorphic visual motion analysis. Many real-world AI applications, including self-driving cars, robotics, augmented reality, and human motion analysis are based on visual motion. Yet most approaches treat motion as extension of static images by matching features in consecutive video frames. Inspired by biological vision, we use as input to our computational methods, spatiotemporal filters and events from neuromorphic dynamic vision sensors that simulate the transient response in biology.  I will describe a bio-inspired pipeline for the processing underlying the navigation tasks, and present algorithms on 3D motion estimation and foreground-background segmentation. The design of these algorithms is guided by a) questions about where to best use geometric constraints in machine learning, and b) experiments with visual motion illusions to gain insight into computational limitations. Lastly, I will discuss the advantages of event-based vision for action understanding and describe recent work on action interpretation for AI in music education.


Cornelia Fermüller is a research scientist at the Institute for Advanced Computer Studies (UMIACS) at the University of Maryland at College Park.  She holds a Ph.D. from the Technical University of Vienna, Austria and an M.S. from the University of Technology, Graz, Austria, both in Applied Mathematics.  She co-founded the Autonomy Cognition and Robotics (ARC) Lab and co-leads the Perception and Robotics Group at UMD. She is the PI of an NSF-sponsored Network for Accelerating Research on Neuromorphic Engineering. Her research is in the areas of Computer, Human and Robot Vision. She studies and develops biologically inspired Computer Vision solutions for systems that interact with their environment. In recent years, her work has focused on the interpretation of human activities, and on motion processing for fast active robots using as input bio-inspired event-based sensors.


Website: http://users.umiacs.umd.edu/users/fer

This talk is organized by Richa Mathur