Beyond Accuracy: Behavioral Testing of NLP Models with Sameer Singh - #406

2020-09-03 · 42 min · episode 406 · 14 entities

episode page audio

Asserted relationships

→ appeared on The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence podcast

0.68

evidence rules-v4
Beyond Accuracy: Behavioral Testing of NLP Models with Sameer Singh - #406
→ hosted by Sam Charrington person

0.55

evidence rules-v4
Feed author/publisher: Sam Charrington
→ discusses Science concept

0.40

evidence rules-v4
Feed category: Science
→ discusses Technology company

0.40

evidence rules-v4
Feed category: Technology
→ discusses News concept

0.40

evidence rules-v4
Feed category: News
→ discusses Tech News concept

0.40

evidence rules-v4
Feed category: Tech News
→ hosted by TWIML company

0.40

evidence rules-v4
Feed author/publisher: TWIML

Entities found in this episode

concepts 6

mentioned Science concept

0.50

evidence rules-v4
Feed category: Science
mentioned Tech News concept

0.50

evidence rules-v4
Feed category: Tech News
discusses Science concept

0.40

evidence rules-v4
Feed category: Science
discusses News concept

0.40

evidence rules-v4
Feed category: News
discusses Tech News concept

0.40

evidence rules-v4
Feed category: Tech News
mentioned NLP concept

0.35

evidence rules-v4
NLP

companys 4

mentioned TWIML company

0.70

evidence rules-v4
Feed author/publisher: TWIML
mentioned Technology company

0.50

evidence rules-v4
Feed category: Technology
discusses Technology company

0.40

evidence rules-v4
Feed category: Technology
hosted by TWIML company

0.40

evidence rules-v4
Feed author/publisher: TWIML

persons 3

mentioned Sameer Singh person

0.72

evidence rules-v4
Beyond Accuracy: Behavioral Testing of NLP Models with Sameer Singh - #406
mentioned Sam Charrington person

0.70

evidence rules-v4
Feed author/publisher: Sam Charrington
hosted by Sam Charrington person

0.55

evidence rules-v4
Feed author/publisher: Sam Charrington

podcasts 1

appeared on The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence podcast

0.68

evidence rules-v4
Beyond Accuracy: Behavioral Testing of NLP Models with Sameer Singh - #406

Episode description as stored

Today we’re joined by Sameer Singh, an assistant professor in the department of computer science at UC Irvine. Sameer’s work centers on large-scale and interpretable machine learning applied to information extraction and natural language processing. We caught up with Sameer right after he was awarded the best paper award at ACL 2020 for his work on Beyond Accuracy: Behavioral Testing of NLP Models with CheckList. In our conversation, we explore CheckLists, the task-agnostic methodology for testing NLP models introduced in the paper. We also discuss how well we understand the cause of pitfalls or failure modes in deep learning models, Sameer’s thoughts on embodied AI, and his work on the now famous LIME paper, which he co-authored alongside Carlos Guestrin. The complete show notes for this episode can be found at twimlai.com/go/406.