Tom Kwiatkowski's guest appearances

Tom Kwiatkowski

NLP Highlights

Sebastian Ruder

Ines Montani

Noah Smith

Michael Collins

Brendan O'Connor

Victor Sanh

Sam Bowman

Nathan Schneider

Matt Gardner

Chris Dyer

John Hewitt

Dan Roth

Leon Derczynski

Zhou Yu

Jon Clark

OwlTail

In this episode, Tom Kwiatkowski and Michael Collins talk about Natural Questions, a benchmark for question answering research. We discuss how the dataset was collected to reflect naturally-occurring questions, the criteria used for identifying short and long answers, how this dataset differs from other QA datasets, and how easy it might be to game the benchmark with superficial processing of the text. We also contrast the holistic design in Natural Questions to deliberately targeting specific linguistic phenomena of interest when building a QA dataset.Dataset: https://ai.google.com/research/NaturalQuestionsPaper: https://www.mitpressjournals.org/doi/full/10.1162/tacl_a_00276

In this episode, Tom Kwiatkowski and Michael Collins talk about Natural Questions, a benchmark for question answering research. We discuss how the dataset was collected to reflect naturally-occurring questions, the criteria used for identifying short and long answers, how this dataset differs from other QA datasets, and how easy it might be to game the benchmark with superficial processing of the text. We also contrast the holistic design in Natural Questions to deliberately targeting specific linguistic phenomena of interest when building a QA dataset.<br><br>Dataset: <a href="https://ai.google.com/research/NaturalQuestions" rel="nofollow" target="_blank">https://ai.google.com/research/NaturalQuestions</a><br>Paper: <a href="https://www.mitpressjournals.org/doi/full/10.1162/tacl_a_00276" rel="nofollow" target="_blank">https://www.mitpressjournals.org/doi/full/10.1162/tacl_a_00276</a>

110 - Natural Questions, with Tom Kwiatkowski and Michael Collins