AI2 Reasoning Challenge (ARC)
Think you have solved question answering? Try the AI2 Reasoning Challenge (ARC)! The ARC dataset contains 7,787 genuine grade-school level, multiple-choice science questions, assembled to encourage research in advanced question-answering. The dataset is partitioned into a Challenge Set and an Easy Set, where the former contains only questions answered incorrectly by both a retrieval-based algorithm and a word co-occurrence algorithm. The questions are partitioned as follows:
- Challenge Train: 1,119
- Challenge Dev: 299
- Challenge Test: 1,172
- Easy Train: 2,251
- Easy Dev: 570
- Easy Test: 2,376
For more information about this dataset please read: Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge.
To join in on the discussion about this dataset, please visit the ARC Discussion Group.
Download the data here or using the orange button in the header.
Visit the new AI2 Reasoning Challenge (ARC) Leaderboard to see the current top scores, and to submit your own!