Cited By
View all- Lu G(2023)Research on Football object Recognition based on Mixed Gaussian model2023 8th International Conference on Information Systems Engineering (ICISE)10.1109/ICISE60366.2023.00026(95-98)Online publication date: 23-Jun-2023
Auto-Resource Provisioning for MapReduce-Based Multiple Object Tracking in Video
Article No.: 25, Pages 1 - 10
Abstract
Use of complex image analysis and globally optimal techniques make the current Multiple Object Tracking (MOT) methods for video analysis computationally slow. An important issue in this context is meeting the specific latency requirement for a given application while processing large scale video data. This is especially important in emergency situations such as accidents, natural calamities, and terrorist attacks. This paper introduces a latency reducing MapReduce/Hadoop-based parallel solution for MOT. The system includes an Auto-Resource Provisioning technique for determining the number of Hadoop nodes required to process the MOT job within a user specified deadline. The estimated number of nodes are then provisioned by the system and the MOT application is executed on the Hadoop cluster comprising the desired number of nodes. A prototype is built using the AWS EC2 cloud. A performance analysis is performed using measurements made on the prototype and insights gained into system behavior and performance are presented.
References
[1]
R. Girshick, "From Rigid Templates to Grammars: Object Detection with Structured Models.".
[2]
R. Girshick, F. Iandola, T. Darrell and J. Malik, "Deformable Part Models are Convolutional Neural Networks," in IEEE Conference on Computer Vision and Pattern Recognition, 2015.
[3]
R. Girshick, "Fast R-CNN," in IEEE International Confernece on Computer Vision, 2015.
[4]
S. Tang, B. Andres, M. Andriluka and B. Schiele, "Subgraph Decomposition for Multi-Target Tracking," in IEEE Conference on Computer Vision and Pattern Recognition, 2015.
[5]
A. Milan, K. Schindler and S. Roth, "Multi-Target Tracking by Discrete-Continuous Energy Minimization," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 38, no. 10, pp. 2054--2068, 2016.
[6]
H. Pirsiavash, D. Ramanan and C. C. Fowlkes, "Globally-optimal greedy algorithms for tracking a variable number of objects," in IEEE Conference on Computer Vision and Pattern Recognition, 2011.
[7]
G. Singh, S. Rajan and S. Majumdar, "A Greedy Data Association Technique for Multiple Object Tracking," in IEEE International Conference on Multimedia Big Data, 2017.
[8]
J. Dean and S. Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters," in Sixth Symposium on Operating System Design and Implementation, 2004.
[9]
C. Ryu, D. Lee, M. Jang and E. Seo, "Extensible Video Processing Framework in Apache Hadoop," in IEEE International Conference on Cloud Computing Technology and Science, 2013.
[10]
T. Abdullah, A. Anjum, M. F. Tariq, Y. Baltaci and N. Antonopoulos, "Traffic Monitoring Using Video Analytics in Clouds," in IEEE confernece on Utility and Cloud Computing, 2014.
[11]
"Brussels Attack 2016," {Online}. Available: https://en.wikipedia.org/wiki/2016_Brussels_bombings.
[12]
"Istanbul bombing 2016," {Online}. Available: https://en.wikipedia.org/wiki/2016_Istanbul_bombing.
[13]
S. Li, S. Hu, S. Wang, L. Su, T. Abdelzaher, I. Gupta and R. Pace, "WOHA: Deadline-Aware Map-Reduce Workflow Scheduling Framework over Hadoop Clusters," IEEE 34th International Conference on Distributed Computing Systems, pp. 93--103, 2014.
[14]
A. Verma, L. Cherkasova and R. H. Campbell, "ARIA: Automatic Resource Inference and Allocation for Mapreduce Environments," in 8th ACM International Conference on Autonomic Computing, 2011.
[15]
L. Liu, Y. Zhou, M. Liu, G. Xu, X. Chen, D. Fan and Q. Wang, "Preemptive Hadoop Jobs Scheduling under a Deadline," in Eigth International Conference on Semantics, Knowledge, and Grids, 2012.
[16]
M. Khan, Y. Jin, M. Li, Y. Xiang and C. Jiang, "Hadoop Performance Modeling for Job Estimation and Resource Provisioning," IEEE Transactions on Parallel and Distributed Systems, vol. 27, no. 2, pp. 441--454, 2016.
[17]
D. Cheng, J. Rao, C. Jiang and X. Zhou, "Resource and Deadline-Aware Job Scheduling in Dynamic Hadoop Clusters," in IEEE International Parallel and Distributed Processing Symposium, 2015.
[18]
M. Yamamoto and K. Kaneko, "Parallel Image Database Processing with MapReduce and Peformance Evaluation in Pseudo Distributed Mode," in International Journal of Electronic Commerce Studies, 2012.
[19]
G. Singh, S. Majumdar and S. Rajan, "MapReduce-based Techniques For Multiple Object Tracking in Video Analytics," IEEE Conference on Cloud and Big Data Computing (CBDCom 2017), 2017.
[20]
K. Shvachko, H. Kuang, S. Radia and R. Chansler, "The Hadoop Distributed File System," IEEE 26th Symposium on Mass Storage Systems and Technologies, 2010.
[21]
T. A. S. Foundation, "Apache Hadoop," The Apache Software Foundation, {Online}. Available: hadoop.apache.org.
[22]
H. Pirsiavash, D. Ramanan and C. C. Fowlkes, "Globally-optimal greedy algorithms for tracking a variable number of objects," in Computer Vision and Pattern Recognition, 2011.
[23]
FFMPEG, "FFMPEG Format Documentation," {Online}. Available: https://www.ffmpeg.org/ffmpeg-formats.html.
[24]
Github, "Boto," {Online}. Available: https://github.com/boto/boto.
[25]
R. Girshick, "Discriminatively trained deformable part models," 2012. {Online}. Available: http://people.cs.uchicago.edu/~rbg/latent-release5/.
[26]
L. Leal-Taixé, A. Milan, I. Reid, S. Roth and K. Schindler, "MOTChallenge 2015: Towards a Benchmark for Multi-Target Tracking," in arXiv:1504.01942 {cs.CV}, 2015.
[27]
A. Milan, L. Leal-Taixe, I. Reid, S. Roth and K. Schindler, "MOT16: A Benchmark for Multi-Object Tracking," in arXiv:1603.00831 {cs.CV}, 2016.
[28]
B. Yang and R. Nevatia, "Multi-Target Tracking by Online Learning of Nonlinear Motion Patterns and Robust Appearance Models.," in IEEE Conference on Computer Vision and Pattern Recognition, 2012.
[29]
D. L. Z. J. Eager and E. D. Lazowska, "Speedup Versus Efficiency in Parallel Systems," IEEE Transactions on Computers, vol. 38, pp. 408--423, 1989.
Recommendations
QoS-guaranteed resource provisioning for cloud-based MapReduce in dynamical environments
How to guarantee Quality of Service (QoS) with the minimum resource cost has become a new problem in cloud-based computation-intensive MapReduce computations. However, the new problem is challenging as the cloud-based MapReduce environment is ...
Big data classification using heterogeneous ensemble classifiers in Apache Spark based on MapReduce paradigm
Highlights- Distributed Heterogeneous Ensemble is designed for big data classification.
- ...
AbstractIn this era of big data, processing large scale data efficiently and accurately has become a challenging problem. Ensemble classification is a type of supervised learning that uses multiple experts to generate the final output. It ...
MapReduce in the Clouds for Science
CLOUDCOM '10: Proceedings of the 2010 IEEE Second International Conference on Cloud Computing Technology and ScienceThe utility computing model introduced by cloud computing combined with the rich set of cloud infrastructure services offers a very viable alternative to traditional servers and computing clusters. MapReduce distributed data processing architecture has ...
Comments
Information & Contributors
Information
Published In
January 2018
494 pages
ISBN:9781450363723
DOI:10.1145/3154273
Copyright © 2018 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 04 January 2018
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
ICDCN '18
ICDCN '18: 19th International Conference on Distributed Computing and Networking
January 4 - 7, 2018
Varanasi, India
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 121Total Downloads
- Downloads (Last 12 months)2
- Downloads (Last 6 weeks)0
Reflects downloads up to 05 Mar 2025
Other Metrics
Citations
Cited By
View all- Lu G(2023)Research on Football object Recognition based on Mixed Gaussian model2023 8th International Conference on Information Systems Engineering (ICISE)10.1109/ICISE60366.2023.00026(95-98)Online publication date: 23-Jun-2023
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in