Data Skeptic
Data Skeptic
Kyle Polich
StrategyQA and Big Bench
41 minutes Posted Nov 18, 2022 at 3:39 am.
0:00
41:56
Download MP3
Show notes

Did Aristotle Use a Laptop?  That's a question from the StrategyQA benchmark which highlights the stretch goals for current artificial intelligence systems.  Answering a question like that requires several cognitive steps and reasoning.  Constructing a dataset of similarly challenging questions is a major undertaking.  On today's episode, Mor Geva returns to share details about the creation of StrategyQA and the larger Big Bench dataset it has been included in.