Download - Minimum required viewing times dataset


Datacard

View the MVT dataset data card here.

MVT data collection toolbox

In addition to our dataset, we are excited to share our toolbox for running tasks on Amazon Mechanical Turk to measure Minimum Viewing Time (MVT).

License

The images used within this dataset have been sampled from ImageNet and ObjectNet and have been gently edited. The respective licenses of the source datasets apply. Particularly, in accordance with ObjectNet's license, ObjectNet images may not be used to tune the parameters of any model. Annotations produced for this dataset are released under the Creative Commons BY-SA license.



Citation

David Mayo, Jesse Cummings, Xinyu Lin, Dan Gutfreund, Boris Katz, and Andrei Barbu. How hard are computer vision datasets? Calibrating dataset difficulty to viewing time. In Advances in Neural Information Processing Systems 36. 2023.


Links



Institutions

This work was supported by the Center for Brains, Minds, and Machines, NSF STC award CCF1231216, the NSF award 2124052, the MIT CSAIL Machine Learning Applications Initiative, the MIT-IBM Watson AI Lab, the DARPA Artificial Social Intelligence for Successful Teams (ASIST) program, the DARPA Knowledge Management at Scale and Speed (KMASS) program, the United States Air Force Research Laboratory and the Department of the Air Force Artificial Intelligence Accelerator under Cooperative Agreement Number FA8750-19-2-1000, the Air Force Office of Scientific Research (AFOSR) under award number FA9550-21-1-0014, and the Office of Naval Research under award number N00014-20-1-2589 and award number N00014- 20-1-2643. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the Department of the Air Force or the U.S. Government. The U.S. Government is authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation herein.