USED: a large-scale social event detection dataset

ABSTRACT

Event discovery from single pictures is a challenging problem that has raised significant interest in the last decade. During this time, a number of interesting solutions have been proposed to tackle event discovery in still images. However, a large scale benchmarking image dataset for the evaluation and comparison of event discovery algorithms from single images is still lagging behind. To this aim, in this paper we provide a large-scale properly annotated and balanced dataset of 490,000 images, covering every aspect of 14 different types of social events, selected among the most shared ones in the social network. Such a large scale collection of event-related images is intended to become a powerful support tool for the research community in multimedia analysis by providing a common benchmark for training, testing, validation and comparison of existing and novel algorithms. In this paper, we provide a detailed description of how the dataset is collected, organized and how it can be beneficial for the researchers in the multimedia analysis domain. Moreover, a deep learning based approach is introduced into event discovery from single images as one of the possible applications of this dataset with a belief that deep learning can prove to be a breakthrough also in this research area. By providing this dataset, we hope to gather research community in the multimedia and signal processing domains to advance this application.

References

1. H. Bay, A. Ess, T. Tuytelaars, and L. Van G. Speeded-up robust features (surf). Computer Vision and Image Understanding, 110(3):346--359, 2008.
2. M. Dao, G. Boato, and F. De Natale. Discovering inherent event taxonomies from social media collections. In ICMR, page 48. ACM, 2012.
3. J. Deng, W. Dong, R. Socher, L. Li, K. Li, and L. Fei-Fei. Imagenet: A large-scale hierarchical image database. In CVPR, pages 248--255. IEEE, 2009.
4. N. Gkalelis, V. Mezaris, and I. Kompatsiaris. High-level event detection in video exploiting discriminant concepts. In CBMI, pages 85--90. IEEE, 2011.
5. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Advan. Neur. Info. proces. sys., pages 1097--1105, 2012.
6. R. Mattivi, J. Uijlings, F. G. De Natale, and N. Sebe. Exploitation of time constraints for (sub-) event recognition. In Proceedings of the 2011 joint ACM workshop on Modeling and representing events, pages 7--12. ACM, 2011.
7. T. Reuter, S. Papadopoulos, G. Petkos, V. Mezaris, Y. Kompatsiaris, P. Cimiano, C. de Vries, and S. Geva. Social event detection at mediaeval 2013: Challenges, datasets, and evaluation. In MediaEval Workshop, 2013.
8. A. Rosani, G. Boato, and F. G. De Natale. Eventmask: A game-based framework for event-saliency identification in images. Multimedia, IEEE Transactions on, 17(8):1359--1371, 2015.
9. U. Westermann and R. Jain. Toward a common event model for multimedia applications. IEEE MultiMedia, 14(1):19--29, 2007.

Index Terms

• Applied computing

  • Computers in other domains

    • Digital libraries and archives