Data Skeptic — Data Science, Machine Learning & AI Podcast

Journal Club, episode 9

Kyle: How can AI help in a humanitarian crisis? https://www.independent.co.uk/news/science/artifical-intelligence-disaster-response-humanitarian-crisis-ai-help-a8319361.html

Lan talks about Captum, an extensive interpretability library for PyTorch models.

George's paper this week is Sanity Checks for Saliency Maps. This work takes stock of a group of techniques that generate local interpretabilty - and assesses their trustworthiness through two 'sanity checks'. From this analysis, Adebayo et al demonstrate that a number of these tools are invariant to the model's weights and could lead a human observer into confirmation bias.