skip to main content
10.1145/2671188.2749408acmconferencesArticle/Chapter ViewAbstractPublication PagesicmrConference Proceedingsconference-collections
research-article

Multi-view Face Detection Using Deep Convolutional Neural Networks

Published: 22 June 2015 Publication History

Abstract

In this paper we consider the problem of multi-view face detection. While there has been significant research on this problem, current state-of-the-art approaches for this task require annotation of facial landmarks, e.g. TSM [25], or annotation of face poses [28, 22]. They also require training dozens of models to fully capture faces in all orientations, e.g. 22 models in HeadHunter method [22]. In this paper we propose Deep Dense Face Detector (DDFD), a method that does not require pose/landmark annotation and is able to detect faces in a wide range of orientations using a single model based on deep convolutional neural networks. The proposed method has minimal complexity; unlike other recent deep learning object detection methods [9], it does not require additional components such as segmentation, bounding-box regression, or SVM classifiers. Furthermore, we analyzed scores of the proposed face detector for faces in different orientations and found that 1) the proposed method is able to detect faces from different angles and can handle occlusion to some extent, 2) there seems to be a correlation between distribution of positive examples in the training set and scores of the proposed face detector. The latter suggests that the proposed method's performance can be further improved by using better sampling strategies and more sophisticated data augmentation techniques. Evaluations on popular face detection benchmark datasets show that our single-model face detector algorithm has similar or better performance compared to the previous methods, which are more complex and require annotations of either different poses or facial landmarks.

References

[1]
L. Bourdev and J. Brandt. Robust object detection via soft cascade. In Proceedings of CVPR, 2005.
[2]
P. Dollár, R. Appel, S. Belongie, and P. Perona. Fast feature pyramids for object detection. IEEE Figure 11: Comparison of different face detectors on FDDB dataset. Transactions on Pattern Analysis and Machine Intelligence, 2014.
[3]
P. Dollar, Z. Tu, P. Perona, and S. Belongie. Integral channel features. In Proceedings of the British Machine Vision Conference, 2009.
[4]
D. Erhan, C. Szegedy, A. Toshev, and D. Anguelov. Scalable object detection using deep neural networks. 2014.
[5]
P. Felzenszwalb, D. McAllester, and D. Ramanan. A discriminatively trained, multiscale, deformable part model. In Proceedings of CVPR, 2008.
[6]
C. Garcia and M. Delakis. A Neural Architecture for Fast and Robust Face Detection. In Proceedings of IEEE-IAPR International Conference on Pattern Recognition, Aug. 2002.
[7]
C. Garcia and M. Delakis. Training Convolutional Filters for Robust Face Detection. In Proceedings of IEEE International Workshop of Neural Networks for Signal Processing, Sept. 2003.
[8]
C. Garcia and M. Delakis. Convolutional face finder: a neural architecture for fast and robust face detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004.
[9]
R. Girshick, J. Donahue, T. Darrell, and J. Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In Proceedings of CVPR, 2014.
[10]
R. B. Girshick, F. N. Iandola, T. Darrell, and J. Malik. Deformable part models are convolutional neural networks. CoRR, 2014.
[11]
P. E. Hadjidoukas, V. V. Dimakopoulos, M. Delakis, and C. Garcia. A high-performance face detection system using openmp. Concurrency and Computation: Practice and Experience, 2009.
[12]
C. Huang, H. Ai, Y. Li, and S. Lao. Vector boosting for rotation invariant multi-view face detection. In Proceedings of ICCV, 2005.
[13]
C. Huang, H. Ai, Y. Li, and S. Lao. High-performance rotation invariant multiview face detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007.
[14]
F. Iandola, M. Moskewicz, S. Karayev, R. Girshick, T. Darrell, and K. Keutzer. Densenet: Implementing efficient convnet descriptor pyramids. arXiv preprint arXiv:1404.1869, 2014.
[15]
V. Jain and E. Learned-Miller. Fddb: A benchmark for face detection in unconstrained settings. Technical Report UM-CS-2010-009, University of Massachusetts, Amherst, 2010.
[16]
Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. arXiv preprint arXiv:1408.5093, 2014.
[17]
Y. L. Jonathan J. Tompson, Arjun Jain and C. Bregler. Joint training of a convolutional network and a graphical model for human pose estimation. In Proceedings of NIPS, 2014.
[18]
S. R. Kaiming He, Xiangyu Zhang and J. Sun. Spatial pyramid pooling in deep convolutional networks for visual recognition. In Proceedings of ECCV, 2014.
[19]
A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Proceedings of NIPS, 2012.
[20]
S. Lazebnik, C. Schmid, and J. Ponce. Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In Proceedings of CVPR, 2006.
[21]
P. M. R. Martin Koestinger, Paul Wohlhart and H. Bischof. Annotated facial landmarks in the wild: A large-scale, real-world database for facial landmark localization. In Proceedings of IEEE International Workshop on Benchmarking Facial Image Analysis Technologies, 2011.
[22]
M. Mathias, R. Benenson, M. Pedersoli, and L. Van Gool. Face detection without bells and whistles. In Proceedings of ECCV, 2014.
[23]
M. Osadchy, Y. L. Cun, and M. L. Miller. Synergistic face detection and pose estimation with energy-based model. In Proceedings of NIPS, 2005.
[24]
R. Osadchy, M. Miller, and Y. LeCun. Synergistic face detection and pose estimation with energy-based model. In Proceedings of NIPS, 2004.
[25]
D. Ramanan. Face detection, pose estimation, and landmark localization in the wild. In Proceedings of CVPR, 2012.
[26]
S. Roux, F. Mamalet, and C. Garcia. Embedded convolutional face finder. In Proceedings of IEEE International Conference on Multimedia and Expo, 2006.
[27]
H. Rowley, S. Baluja, and T. Kanade. Neural network-based face detection. In Proceedings of CVPR, 1996.
[28]
M. Saberian and N. Vasconcelos. Multi-resolution cascades for multiclass object detection. In Proceedings of NIPS. 2014.
[29]
P. Sermanet, D. Eigen, X. Zhang, M. Mathieu, R. Fergus, and Y. LeCun. Overfeat: Integrated recognition, localization and detection using convolutional networks. In Proceedings of International Conference on Learning Representations, 2014.
[30]
Y. Sun, Y. Chen, X. Wang, and X. Tang. Deep learning face representation by joint identification-verification. In Proceedings of NIPS. 2014.
[31]
C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. CoRR, 2014.
[32]
C. Szegedy, S. Reed, D. Erhan, and D. Anguelov. Scalable, high-quality object detection. CoRR, 2014.
[33]
C. Szegedy, S. Reed, D. Erhan, and D. Anguelov. Scalable, high-quality object detection. CoRR, 2014.
[34]
Y. Taigman, M. Yang, M. Ranzato, and L. Wolf. Deepface: Closing the gap to human-level performance in face verification. In Proceedings of CVPR, 2014.
[35]
A. Torralba, K. Murphy, and W. Freeman. Sharing visual features for multiclass and multiview object detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007.
[36]
J. Uijlings, K. van de Sande, T. Gevers, and A. Smeulders. Selective search for object recognition. International Journal of Computer Vision, 2013.
[37]
R. Vaillant, C. Monrocq, and Y. LeCun. An original approach for the localisation of objects in images. In Proceedings of International Conference on Artificial Neural Networks, 1993.
[38]
R. Vaillant, C. Monrocq, and Y. LeCun. Original approach for the localisation of objects in images. IEE Proc on Vision, Image, and Signal Processing, 1994.
[39]
M. Viola and P. Viola. Fast multi-view face detection. In Proceedings of CVPR, 2003.
[40]
P. Viola and M. J. Jones. Robust real-time face detection. International Journal of Computer Vision, 2004.
[41]
B. Wu, H. Ai, C. Huang, and S. Lao. Fast rotation invariant multi-view face detection based on real adaboost. In IEEE International Conference on Automatic Face and Gesture Recognition, 2004.
[42]
J. Yan, X. Zhang, Z. Lei, and S. Li. Face detection by structural models.

Cited By

View all
  • (2025)A Generalized Zero-Shot Deep Learning Classifier for Emotion Recognition Using Facial Expression ImagesIEEE Access10.1109/ACCESS.2025.353358013(18687-18700)Online publication date: 2025
  • (2025)Research on small-scale face detection methods in dense scenesApplied Intelligence10.1007/s10489-025-06231-955:4Online publication date: 14-Jan-2025
  • (2024)AI-Based Call Center ManagementThe European Journal of Research and Development10.56038/ejrnd.v4i4.5934:4(338-351)Online publication date: 31-Dec-2024
  • Show More Cited By

Index Terms

  1. Multi-view Face Detection Using Deep Convolutional Neural Networks

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ICMR '15: Proceedings of the 5th ACM on International Conference on Multimedia Retrieval
    June 2015
    700 pages
    ISBN:9781450332743
    DOI:10.1145/2671188
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 22 June 2015

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. convolutional neural network
    2. deep learning
    3. face detection

    Qualifiers

    • Research-article

    Conference

    ICMR '15
    Sponsor:

    Acceptance Rates

    ICMR '15 Paper Acceptance Rate 48 of 127 submissions, 38%;
    Overall Acceptance Rate 254 of 830 submissions, 31%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)79
    • Downloads (Last 6 weeks)10
    Reflects downloads up to 30 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)A Generalized Zero-Shot Deep Learning Classifier for Emotion Recognition Using Facial Expression ImagesIEEE Access10.1109/ACCESS.2025.353358013(18687-18700)Online publication date: 2025
    • (2025)Research on small-scale face detection methods in dense scenesApplied Intelligence10.1007/s10489-025-06231-955:4Online publication date: 14-Jan-2025
    • (2024)AI-Based Call Center ManagementThe European Journal of Research and Development10.56038/ejrnd.v4i4.5934:4(338-351)Online publication date: 31-Dec-2024
    • (2024)Yapay Zekâ: Alt Dalları ve Uygulama AlanlarıAksaray Üniversitesi İktisadi ve İdari Bilimler Fakültesi Dergisi10.52791/aksarayiibd.157420716:4(201-234)Online publication date: 30-Dec-2024
    • (2024)A Study on the Non-Contact Artificial Intelligence Elevator System Due to the Effect of COVID-19Electronics10.3390/electronics1316319313:16(3193)Online publication date: 12-Aug-2024
    • (2024)Face detection method based on improved YOLO-v4 network and attention mechanismJournal of Intelligent Systems10.1515/jisys-2023-033433:1Online publication date: 18-Jun-2024
    • (2024)Long-Term Hydrologic Time Series Prediction with LSPMProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679957(4308-4312)Online publication date: 21-Oct-2024
    • (2024)A comparitive study of MTCNN, Viola-Jones, SSD and YOLO face detection algorithms2024 International Conference on Intelligent and Innovative Technologies in Computing, Electrical and Electronics (IITCEE)10.1109/IITCEE59897.2024.10467445(1-7)Online publication date: 24-Jan-2024
    • (2024)Vivid and Deep Face Detection and Conformation on The Web2024 10th International Conference on Web Research (ICWR)10.1109/ICWR61162.2024.10533344(402-411)Online publication date: 24-Apr-2024
    • (2024)Complex Facial Expression Analysis and Recognition using Deep Networks2024 International Conference on Inventive Computation Technologies (ICICT)10.1109/ICICT60155.2024.10545002(563-567)Online publication date: 24-Apr-2024
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media