Behind the Black Box: How to Understand Any ML Model Using SHAP

Speaker

Jonathan Bechtel

Details

This workshop explains how to take the highest performing ML models such as gradient boosting and neural networks and understand what contributes to their predictions at a local and global level to make their output easily understood by practitioners and non-practitioners alike.

Description

Part 1: An Introduction to Interpretable ML

  • Interpretability is why bad models are used more than they ought to be
  • The current state of interpreting non-linear ML models, and their major shortcomings
  • What's currently missing in the toolkit for understanding black box ML models

Part 2: An Introduction to SHAP

  • A brief history of understanding black box models, and how it lead to the need for SHAP
  • Why SHAP is a theoretically sound application of game theory to understand any ML model, regardless of how it generates predictions
  • A close look at SHAP's source code to understand how it's used to compute its results

Part 3: SHAP in the Wild

  • How to derive local explanations for a single model prediction (or how to be more like linear regression)
  • Creating odds ratios
  • Using SHAP to understand feature interaction effects among correlated data
  • Using SHAP with neural networks and unstructured data: understanding word contributions to a Transformed NLP model
  • Examples of SHAP being used in production

Event type:
Speaker Series
Preparation:
None
March 15, 2023
6:00 am
-
3:17 am
March 15, 2023
Online
Zoom Conference Room

While this event is FREE, tickets are required & space is limited!

Attend this event

About the speaker

Jonathan Bechtel

Data Scientist

Jonathan is a data scientist with an expertise in time series modeling and open source development. He's helped organize contributions to TensorflowJS and sktime, and enjoys evangelizing the spread of grassroots ML knowledge. He's worked with organizations such as General Assembly, NYPD, Amber Capital and Advent International to assist them with their data science needs. He has a particular passion for time series problems, since he believes they're the most practical way for companies to harness ML for business value.

Upcoming Events

How to conduct experiments with text at scale
Online
August 23, 2023

Experimental Design with Text Message Data

How to conduct experiments with text at scale

Speaker

Laura Zheng

Learn More
How to Combine Counterfactuals with Pattern Recognition
In Person
August 10, 2023

Causal Inference and Machine Learning: The Current Frontier

How to Combine Counterfactuals with Pattern Recognition

Speaker

Gerard Torrats-Espinosa

Learn More
Join other DSML Group Attendees for a Private Dinner
In Person
August 2, 2023

DSML Group. Private Dinner

Join other DSML Group Attendees for a Private Dinner

Speaker

Jonathan Bechtel

Learn More
Fast and Easy Chatbots
In Person
July 26, 2023

Research Reading: Prototyping Conversational LLM's With Alpaca

Fast and Easy Chatbots

Speaker

Jonathan Bechtel

Learn More
Join us at Rokt on-site to learn how a leader in e-commerce technology uses ML to solve problems.
In Person
July 12, 2023

Using Machine Learning in E-Commerce w/ Rokt

Join us at Rokt on-site to learn how a leader in e-commerce technology uses ML to solve problems.

Speaker

Yan Xu

Learn More
What is the underlying graph structure of the crypto financial market?
In Person
June 28, 2023

Using Machine Learning to Study the Structure of CryptoMarkets

What is the underlying graph structure of the crypto financial market?

Speaker

Jonathan Bechtel

Learn More