Dynamic Adaptive Point Cloud Streaming

ABSTRACT

High-quality point clouds have recently gained interest as an emerging form of representing immersive 3D graphics. Unfortunately, these 3D media are bulky and severely bandwidth intensive, which makes it difficult for streaming to resource-limited and mobile devices. This has called researchers to propose efficient and adaptive approaches for streaming of high-quality point clouds.

In this paper, we run a pilot study towards dynamic adaptive point cloud streaming, and extend the concept of dynamic adaptive streaming over HTTP (DASH) towards DASH-PC, a dynamic adaptive bandwidth-efficient and view-aware point cloud streaming system. DASH-PC can tackle the huge bandwidth demands of dense point cloud streaming while at the same time can semantically link to human visual acuity to maintain high visual quality when needed. In order to describe the various quality representations, we propose multiple thinning approaches to spatially sub-sample point clouds in the 3D space, and design a DASH Media Presentation Description manifest speci.c for point cloud streaming. Our initial evaluations show that we can achieve signi.cant bandwidth and performance improvement on dense point cloud streaming with minor negative quality impacts compared to the baseline scenario when no adaptations is applied.

References

1. 2014. MPEG DASH, Information technology -- Dynamic adaptive streaming over HTTP (DASH) -- Part 1: Media presentation description and segment formats. ISO-IEC-23009-1. (2014). 2014-05-12.
2. Eugene d'Eon, Bob Harrison, Taos Myers, and Philip A. Chou. Geneva, January 2017. 8i Voxelized Full Bodies - A Voxelized Point Cloud Dataset. In ISO/IEC JTC1/SC29 Joint WG11/WG1 (MPEG/JPEG) input document.
3. Olivier Devillers and Pierre-Marie Gandoin. 2000. Geometric Compression for Interactive Transmission. In Proceedings of the Conference on Visualization '00 (VIS '00). 319--326.
4. Google. 2018. Draco: 3D Data Compression. (February 2018). Retrieved March 3, 2018 from h.ps://github.com/google/draco
5. Stefan Gumhold and et al. 2005. Predictive Point-cloud Compression. In ACM SIGGRAPH 2005 Sketches (SIGGRAPH '05). ACM, New York, USA, Article 137.
6. M. Hosseini and others. 2016. Adaptive 360 VR Video Streaming: Divide and Conquer. In 2016 IEEE International Symposium on Multimedia (ISM). 107--110.
7. Yan Huang, Jingliang Peng, C.-C. Jay Kuo, and M. Gopi. 2006. Octree-based Progressive Geometry Coding of Point Clouds. In Proceedings of the 3rd Eurographics / IEEE VGTC Conference on Point-Based Graphics (SPBG'06). Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 103--110.
8. J. Kammerl and others. 2012. Real-time compression of point cloud streams. In 2012 IEEE International Conference on Robotics and Automation. 778--785.
9. R. Mekuria and L. Bivolarsky. 2016. Overview of the MPEG Activity on Point Cloud Compression. In 2016 Data Compression Conference (DCC). 620--620.
10. J. Ohlsson and G. Villarreal. 2005. Normal visual acuity in 17-18 year olds. Acta Ophthalmol Scand 83, 4 (Aug 2005), 487--491. p. 490.
11. Ruwen Schnabel and Reinhard Klein. 2006. Octree-based Point-cloud Compression. In Proc. of the IEEE VGTC Conference on Point-Based Graphics (SPBG'06). 111--121.

Index Terms

• Information systems

  • Information systems applications

    • Multimedia information systems

      • Multimedia streaming