Talks

PhD Defense: Understanding and Enriching Algorithmic Reasoning Capabilities of Deep Learning Models

Jingling Li

4107 or https://umd.zoom.us/j/3855080995?pwd=VUlIVlBCTlVMRUZ3NXBISnYvZWM1QT09 Brendan Iribe Center for Computer Science and Engineering (IRB)

Monday, July 10, 2023, 1:00-3:00 pm

You are subscribed to this talk through .
You are watching this talk through .
You are subscribed to this talk. (unsubscribe, watch)
You are watching this talk. (unwatch, subscribe)
You are not subscribed to this talk. (watch, subscribe)

Abstract

Learning to reason is an essential step to achieving general intelligence. My research has been focusing on empowering deep learning models with the abilities to generalize efficiently, extrapolate to out-of distribution data, learn under noisy labels, and make better sequential decisions --- all of these require the models to have varying levels of reasoning capabilities. As the reasoning process can be described as a step-by-step algorithmic procedure, understanding and enriching the algorithmic reasoning capabilities has drawn increasing attention in deep learning communities.

To bridge algorithms and neural networks, we propose a framework, algorithmic alignment, which connects neural networks with algorithms in a novel manner and advances our understanding of how these two fields can work together to solve complex reasoning tasks. Intuitively, the algorithmic alignment framework evaluates how well a neural network's computation structure aligns with the algorithmic structure in a reasoning process. Utilizing algorithmic alignment, we are able to understand the limitations of machine learning models in the context of reasoning (e.g., generalization, extrapolation, and robustness) and know where to make improvements.

Beyond this framework, we also investigate how to make better sequential decisions, during which we introduce a class of efficient approaches --- hindsight learning --- which allows us to leverage the knowledge inside existing human-designed algorithms to make better sequential decisions under uncertainty.

Examining Committee

Chair:	Dr. John Dickerson
Dean's Representative:	Dr. Mark Fuge
Members:	Dr. Jimmy Ba
	Dr. Jia-Bin Huang
	Dr. Petar Veličković
	Dr. Tianyi Zhou

Bio

Jingling is a Ph.D. student in Computer Science at the University of Maryland, College Park, where she is fortunate to be advised by Prof. John Dickerson. Before that, she obtained her Bachelor’s degree in Computer Science and Mathematics from Bryn Mawr College. Her research focuses on understanding and enriching the reasoning capabilities of current deep learning models. She believes that having the ability to reason is an important and necessary milestone to achieving general intelligence.

This talk is organized by Tom Hurst