3D Person Tracking In World Coordinates and Attribute Estimation with PDR

ABSTRACT

In this paper, we propose an online 3D person tracking method and an attribute estimation method with pedestrian dead reckoning (PDR). For person tracking, we employ a structured prediction approach, which extends the Struck algorithm. Although the main stream of visual object tracking, including Struck, utilizes only 2D information in image coordinates, it is difficult to track object correctly because of changes in the scale and angle of the target. In contrast, our classifier adaptively learns structural relationship in world coordinates and in image coordinates using Structured SVM. Furthermore, we combine visual tracking results and sensor trajectories based on PDR. Our method estimates a person attribute whether insider like a sales staff, or outsider like a customer. According to experimental results, the proposed method outperforms the existing methods regarding the quality of localization. In addition, experimental results show that our method can estimate the attribute at a ratio of 0.84.

References

1. K. Bernardin and R. Stiefelhagen. Evaluating multiple object tracking performance: The clear mot metrics. J. Image Video Process., 2008:1:1--1:10, Jan. 2008.
2. A. Bordes, L. Bottou, P. Gallinari, and J. Weston. Solving multiclass support vector machines with larank. In Proc. of ICML, pages 89--96, 2007.
3. M. Donoser and H. Bischof. Efficient maximally stable extremal region (mser) tracking. In Proc. of IEEE Conf. on CVPR, volume 1, pages 553--560, June 2006.
4. G. Fuhr and C. Jung. Robust patch-based pedestrian tracking using monocular calibrated cameras. In Proc. of SIBGRAPI Conf. on SIBGRAPI, pages 166--173, Aug 2012.
5. S. Hare, A. Saffari, and P. Torr. Struck: Structured output tracking with kernels. In Proc. of IEEE Conf. on ICCV, pages 263--270, Nov 2011.
6. D. Kamisaka, S. Muramatsu, T. Iwamoto, and H. Yokoyama. Design and implementation of pedestrian dead reckoning system on a mobile phone. IEICE Trans., 94:1137--1146, 2011.
7. X. Li, W. Hu, C. Shen, Z. Zhang, A. Dick, and A. V. D. Hengel. A survey of appearance models in visual object tracking. ACM Trans. Intell. Syst. Technol., 4(4):58:1--58:48, Oct. 2013.
8. G. Silveira and E. Malis. Real-time visual tracking under arbitrary illumination changes. In Proc. of IEEE Conf. on CVPR, pages 1--6, June 2007.
9. A. Smeulders, D. Chu, R. Cucchiara, S. Calderara, A. Dehghan, and M. Shah. Visual tracking: An experimental survey. IEEE Trans. Pattern Anal. Mach. Intell., 36(7):1442--1468, July 2014.
10. S. Stalder, H. Grabner, and L. Van Gool. Beyond semi-supervised tracking: Tracking should be as simple as detection, but not simpler than recognition. In Proc. of IEEE Conf. on ICCV Workshops, pages 1409--1416, Sept 2009.
11. S. Tran and L. Davis. Robust object trackinng with regional affine invariant features. In Proc. of IEEE Conf. on ICCV, pages 1--8, Oct 2007.
12. I. Tsochantaridis, T. Joachims, T. Hofmann, and Y. Altun. Large margin methods for structured and interdependent output variables. J. Mach. Learn. Res., 6:1453--1484, Dec. 2005.
13. S. Wang, H. Lu, F. Yang, and M.-H. Yang. Superpixel tracking. In Proc. of IEEE Conf. on ICCV, pages 1323--1330, Nov 2011.
14. Y. Wu, J. Lim, and M.-H. Yang. Online object tracking: A benchmark. In Proc. of IEEE Conf. on CVPR, pages 2411--2418, June 2013.
15. A. Yilmaz, O. Javed, and M. Shah. Object tracking: A survey. ACM Comput. Surv., 38(4), Dec. 2006.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision problems

        • Tracking

      • Computer vision tasks

        • Scene understanding