Advances in Bayesian Inference for Model Generalization

Speaker

Sanae Lotfi

Details

In this talk we'll hear from the lead author behind award winning ML research presented at the 2022 ICML conference.

The topic is the main insights behind the following paper: https://arxiv.org/pdf/2202.11678.pdf

The topic is the use of Bayesian Inference and model generalization. Bayesian inference has long been used to select model parameters for ML problems, both as an alternative and compliment to traditional cross validation.

This paper reveals how standard approaches for Bayesian approaches using the marginal likelihood can have unexpected pathologies for model choice, and presents a modified approach that offers better results.

The conclusions are rooted in both theoretical insights and experimental results, and provide an enlightened way to think about how optimization techniques can and cannot lead to generalized out-of-sample results.

Developing ML models that generalize well to unseen data is a critical area of expertise in data science, and this talk reveals new approaches to thinking about this problem.

Event type:
Speaker Series
Preparation:
Read the Paper
June 7, 2023
7:00 pm
-
8:00 pm
June 7, 2023
In Person
151 W. 30th St, 3rd Floor 3rd Floor, New York, NY 10001

While this event is FREE, tickets are required & space is limited!

Attend this event

About the speaker

Sanae Lotfi

Data Scientist

Sanae Lotfi is a PhD student at NYU advised by Professor Andrew Gordon Wilson, and a visiting researcher at Meta AI where she works with Brandon Amos. She is currently interested in designing robust models that can generalize well in-distribution and out-of-distribution, alongside the closely related question of understanding and quantifying the generalization properties of deep neural networks. Sanae's PhD research has been recognized with an ICML Outstanding Paper Award and is generously supported by the Microsoft Research PhD Fellowship, the DeepMind Fellowship, the Meta AI Mentorship Program and the NYU Center for Data Science Fellowship. Prior to joining NYU, Sanae obtained a Master’s degree in applied mathematics from Polytechnique Montreal, where she worked on designing stochastic first and second order algorithms with compelling theoretical and empirical properties for machine learning and large-scale optimization. Sanae also holds a Master's degree in general engineering from CentraleSupélec.

Upcoming Events

How to conduct experiments with text at scale
Online
August 23, 2023

Experimental Design with Text Message Data

How to conduct experiments with text at scale

Speaker

Laura Zheng

Learn More
How to Combine Counterfactuals with Pattern Recognition
In Person
August 10, 2023

Causal Inference and Machine Learning: The Current Frontier

How to Combine Counterfactuals with Pattern Recognition

Speaker

Gerard Torrats-Espinosa

Learn More
Join other DSML Group Attendees for a Private Dinner
In Person
August 2, 2023

DSML Group. Private Dinner

Join other DSML Group Attendees for a Private Dinner

Speaker

Jonathan Bechtel

Learn More
Fast and Easy Chatbots
In Person
July 26, 2023

Research Reading: Prototyping Conversational LLM's With Alpaca

Fast and Easy Chatbots

Speaker

Jonathan Bechtel

Learn More
Join us at Rokt on-site to learn how a leader in e-commerce technology uses ML to solve problems.
In Person
July 12, 2023

Using Machine Learning in E-Commerce w/ Rokt

Join us at Rokt on-site to learn how a leader in e-commerce technology uses ML to solve problems.

Speaker

Yan Xu

Learn More
What is the underlying graph structure of the crypto financial market?
In Person
June 28, 2023

Using Machine Learning to Study the Structure of CryptoMarkets

What is the underlying graph structure of the crypto financial market?

Speaker

Jonathan Bechtel

Learn More