edit
Proudly built by:

AI2 Science Questions Mercury

textbook_image

The AI2 Science Questions Mercury dataset consists of questions used in student assessments across elementary and middle school grade levels, provided under license by an AI2 research partner. Each question is 4-way multiple choice format and may or may not include a diagram element. With 5,141 total questions without diagrams and 1,811 total questions with diagrams, this set can be used on its own or combined with the other science question sets AI2 offers.

Request Data

This dataset was provided to AI2 for non-commercial research purposes only, and as such, access to this dataset requires acceptance of our End User License Agreement.

  • Elementary School Without Diagrams Mercury v1: 1,434 questions
  • Elementary School With Diagrams Mercury v1: 832 questions
  • Middle School Without Diagrams Mercury v1: 3,707 questions
  • Middle School With Diagrams Mercury v1: 979 questions

Evaluation

To evaluate your models, we have also built Aristo MINI, a light-weight question answering system that can quickly evaluate science questions with an evaluation web server and provided baseline solvers. You can extend the provided solvers with your own implementation to try out new approaches and compare results.

Release Notes

This set (v1) was first released in November of 2016.

Questions?

If you have any other questions or feedback for us about this data, please contact us at ai2-data@allenai.org.