skip to main content
10.1145/957013.957100acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
Article

Layered coding vs. multiple descriptions for video streaming over multiple paths

Published:02 November 2003Publication History

ABSTRACT

In this paper, we examine the performance of specific implementations of multiple description coding and of layered coding for video streaming over error-prone packet switched networks. We compare their performance using different transmission schemes with and without network path diversity. It is shown that given the specific implementations there is a large variation in relative performance between multiple description coding and layered coding depending on the employed transmission scheme. For scenarios where the packet transmission schedules can be optimized in a rate-distortion sense, layered coding provides a better performance. The converse is true for scenarios where the packet schedules are not rate-distortion optimized.

References

  1. M. Ghanbari, "Two-layer coding of video signals for vbr networks," IEEE J. Selected Areas in Communications, vol. 7, pp. 771--781, June 1989.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. B.-J. Kim, Z. Xiong, , and W. A. Pearlman, "Low bit-rate scalable video coding with 3D set partitioning in hierarchical trees (3-D SPIHT)," IEEE Trans. Circuits and Systems for Video Technology, vol. 10, no. 8, pp. 1374--1387, Dec. 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. M. Khansari, A. Zakauddin, W.-Y. Chan, E. Dubois, and P. Mermelstein, "Approaches to layered coding for dual-rate wireless video transmission," in Proc. Int'l Conf. Image Processing, Austin, TX, Oct. 1994, IEEE, vol. 1, pp. 258--262.Google ScholarGoogle Scholar
  4. H. Radha, Y. Chen, K. Parthasarathy, and R. Cohen, "Scalable Internet video using MPEG-4," Signal Processing: Image Communication, vol. 15, no. 1--2, pp. 95--126, Sept. 1999.Google ScholarGoogle Scholar
  5. U. Horn, K. Stuhlm\"uller, M. Link, and B. Girod, "Robust Internet video transmission based on scalable coding and unequal error protection," Signal Processing: Image Communication, vol. 15, no. 1--2, pp. 77--94, Sept. 1999.Google ScholarGoogle Scholar
  6. ISO/IEC, "Information technology --- coding of audio-visual objects: Visual (MPEG-4)," Final Committee Draft 14496-2, JTC1/SC29/WG11, Tokyo, Mar. 1998.Google ScholarGoogle Scholar
  7. Telecom. Standardization Sector of ITU, "Video coding for low bitrate communication," ITU-T Recommendation H.263 Version 2, Feb. 1998.Google ScholarGoogle Scholar
  8. J. Madhavi and S. Floyd, "TCP-friendly unicast rate-based flow control," Technical note sent to the end2end-interest mailing list, Jan. 1997, http://www.psc.edu/networking/papers/tcp_friendly.html.Google ScholarGoogle Scholar
  9. W.-T. Tan and A. Zakhor, "Internet video using error resilient scalable compression and cooperative transport protocol," in Proc. Int'l Conf. Image Processing, Chicago, IL, Oct. 1998, IEEE, vol. 3, pp. 458--462.Google ScholarGoogle Scholar
  10. S. Floyd, M. Handley, and J. Padhye, "Equation-based congestion control for unicast applications," Tech. Rep. TR-00-03, International Computer Science Institute, Berkeley, CA, Mar. 2000.Google ScholarGoogle ScholarCross RefCross Ref
  11. S. R. McCanne, M. Vetterli, and V. Jacobson, "Low-complexity video coding for receiver-driven layered multicast," IEEE J. Selected Areas in Communications, vol. 15, no. 6, pp. 983--1001, Aug. 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. W.-T. Tan and A. Zakhor, "Multicast transmission of scalable video using receiver-driven hierarchical FEC," in Proc. Int'l Packet Video Workshop, New York, Apr. 1999.Google ScholarGoogle Scholar
  13. P. A. Chou, A. E. Mohr, A. Wang, and S. Mehrotra, "Error control for receiver-driven layered multicast of audio and video," IEEE Trans. Multimedia, vol. 3, no. 1, pp. 108--122, Mar. 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. S. Blake, D. Black, M. Carlson, E. Davies, and Z. Wang, "An architecture for differentiated services," Tech. Rep. RFC-2475, IETF, Dec. 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. E. Masala, D. Quaglia, and J. C. de~Martin, "Adaptive picture slicing for distortion-based classification of video packets," in Proc. Workshop on Multimedia Signal Processing, Cannes, France, Oct. 2001, IEEE, pp. 111--116.Google ScholarGoogle Scholar
  16. J. Shin, J. Kim, and C.-C. J. Kuo, "Relative priority based QoS interaction between video applications and differentiated service networks," in Proc. Int'l Conf. Image Processing, Vancouver, Canada, Oct. 2000, IEEE, vol. 3, pp. 536--539.Google ScholarGoogle Scholar
  17. J. Shin, J. Kim, and C.-C. J. Kuo, "Quality-of-service mapping mechanism for packet video in differentiated services network," IEEE Trans. Multimedia, vol. 3, no. 2, pp. 219--231, June 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. D. Quaglia and J. C. de~Martin, "Delivery of MPEG video streams with constant perceptual quality of service," in Proc. Int'l Conf. Multimedia and Exhibition, Lausanne, Switzerland, Aug. 2002, IEEE, vol. 2, pp. 85--88.Google ScholarGoogle Scholar
  19. A. Reibman, H. Jafarkhani, Y. Wang, M. Orchard, and R. Puri, "Multiple description coding for video using motion compensated prediction," in Proc. Int'l Conf. Image Processing, Kobe, Japan, Oct. 1999, IEEE, vol. 3, pp. 837--841.Google ScholarGoogle Scholar
  20. D. Comas, R. Singh, and A. Ortega, "Rate-distortion optimization in a robust video transmission based on unbalanced multiple description coding," in Proc. Workshop on Multimedia Signal Processing, Cannes, France, Oct. 2001, pp. 581--586, IEEE.Google ScholarGoogle Scholar
  21. Y. Wang and S. Lin, "Error resilient video coding using multiple description motion compensation," in Proc. Workshop on Multimedia Signal Processing, Cannes, France, Oct. 2001, pp. 441--447, IEEE.Google ScholarGoogle Scholar
  22. Y.-C. Lee and Y. Altunbasak, "A collaborative multiple description transform coding and statistical error concealment method for error resilient video streaming over noisy channels," in Proc. Int'l Conf. Acoustics, Speech, and Signal Processing, Orlando, FL, May 2002, IEEE, vol. 2, pp. 2077--2080, IEEE.Google ScholarGoogle Scholar
  23. A. Reibman, H. Jafarkhani, M. Orchard, and Y. Wang, "Performance of multiple description coders on a real channel," in Proc. Int'l Conf. Acoustics, Speech, and Signal Processing, Phoenix, AZ, USA, Mar. 1999, IEEE, vol. 5, pp. 2415--2418. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. R. Singh, A. Ortega, L. Perret, and W. Jiang, "Comparison of multiple description coding and layered coding based on network simulations," in Proc. Visual Communications and Image Processing, San Jose, CA, USA, Jan. 2000, SPIE, vol. 3974, pp. 929--939.Google ScholarGoogle Scholar
  25. A. Reibman, Y. Wang, X. Qiu, Z. Jiang, and K. Chawla, "Transmission of multiple description and layered video over an EGPRS wireless network," in Proc. Int'l Conf. Image Processing, Vancouver, BC, Oct. 2000, IEEE, vol. 2, pp. 136--139.Google ScholarGoogle Scholar
  26. Y. Wang, S. Panwar, S. Lin, and S. Mao, "Wireless video transport using path diversity: multiple description vs. layered coding," in Proc. Int'l Conf. Image Processing, Rochester, NY, Sept. 2002, IEEE, vol. 1, pp. 21--24.Google ScholarGoogle Scholar
  27. Y.-C. Lee, J. Kim, Y. Altunbasak, and R.M. Mersereau, "Performance comparisons of layered and multiple description coded video streaming over error-prone networks," in Proc. Int'l Conf. Communications, Anchorage, AK, USA, May 2003, IEEE, vol. 1, pp. 35--39.Google ScholarGoogle Scholar
  28. Y. Su, T. Tao, J. Lu, and J. Wang, "Channel-optimized video transmission over WCDMA system," in Proc. Vehicular Technology Conference, Birmingham, AL, May 2002, IEEE, vol. 1, pp. 265--269.Google ScholarGoogle Scholar
  29. H. Wang and A. Ortega, "Robust video communication by combining scalability and multiple description coding techniques," in Proc. Symposium on Electronic Imaging, San Jose, CA, Jan. 2003, SPIE.Google ScholarGoogle Scholar
  30. P.A. Chou, H.J. Wang, and V.N. Padmanabhan, "Layered multiple description coding," in Proc. Int'l Packet Video Workshop, Nantes, France, Apr. 2003.Google ScholarGoogle Scholar
  31. J. Apostolopoulos, "Reliable video communication over lossy packet networks using multiple state encoding and path diversity," in Proc. Visual Communications and Image Processing, Seattle, WA, Jan. 2001, SPIE, pp. 329--409.Google ScholarGoogle Scholar
  32. J. Apostolopoulos and S.J. Wee, "Unbalanced multiple description video communication using path diversity," in Proc. Int'l Conf. Image Processing, Thessaloniki, Greece, Oct. 2001, IEEE, vol. 1, pp. 966--969.Google ScholarGoogle Scholar
  33. N. Gogate, D.-M. Chung, S.S. Panwar, and Y. Wang, "Supporting image and video applications in a multihop radio environment using path diversity and multiple description coding," IEEE Trans. Circuits and Systems for Video Technology, vol. 12, no. 9, pp. 777--792, Sept. 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Y.J. Liang, E. Setton, and B. Girod, "Channel-adaptive video streaming using packet path diversity and rate-distortion optimized reference picture selection," in Proc. Workshop on Multimedia Signal Processing, St. Thomas, US Virgin Islands, Dec. 2002, IEEE, pp. 420--423.Google ScholarGoogle Scholar
  35. J. Apostolopoulos, W.-T. Tan, and S. Wee, "Performance of a multiple description streaming media content delivery network," in Proc. Int'l Conf. Image Processing, Rochester, NY, USA, Sept. 2002, IEEE, vol. 2, pp. 189--192.Google ScholarGoogle Scholar
  36. A. Sehgal and P. A. Chou, "Cost-distortion optimized streaming media over DiffServ networks," in Proc. Int'l Conf. Multimedia and Exhibition, Lausanne, Switzerland, Aug. 2002, IEEE, vol. 1, pp. 857--860.Google ScholarGoogle Scholar
  37. J. Chakareski and B. Girod, "Rate-distortion optimized packet scheduling and routing for media streaming with path diversity," in Proc. Data Compression Conference, Snowbird, UT, Mar. 2003, IEEE Computer Society, pp. 203--212. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. P. A. Chou and Z. Miao, "Rate-distortion optimized streaming of packetized media," IEEE Trans. Multimedia, 2001, submitted. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. M. Mathis, J. Semke, S. Mahdavi, and T. Ott, "The macroscopic behavior of the TCP congestion avoidance algorithm," Computer Communication Review, vol. 27, no. 3, pp. 67--82, July 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. T. Turletti, S.F. Parisis, and J.-C. Bolot, "Experiments with a layered transmission scheme over the Internet," Tech. Rep. 3296, INRIA, Sophia Antipolis, France, Nov. 1997.Google ScholarGoogle Scholar
  41. D. Sisalem and H. Schulzrinne, "The loss-delay adaptation algorithm: a TCP-friendly adaptation scheme," in Proc. Network and Operating System Support for Digital Audio and Video (NOSSDAV), Cambridge, UK, July 1998, ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. R. Rejaie, M. Handley, and D. Estrin, "RAP: an end-to-end based congestion control mechanism for realtime streams in the Internet," in Proc. Conf. on Computer Communications (INFOCOM), New York, NY, Mar. 1999, IEEE, vol. 3, pp. 1337--1345.Google ScholarGoogle ScholarCross RefCross Ref
  43. Q. Zhang, Y.-Q. Zhang, and W. Zhu, "Resource allocation for audio and video streaming over the Internet," in Proc. Int'l Symp. Circuits and Systems, Geneva, Switzerland, May 2000, IEEE, vol. IV, pp. 21--24.Google ScholarGoogle Scholar
  44. "Matlab version 6.5," Tech. Rep., The Mathworks, http://www.mathworks.com.Google ScholarGoogle Scholar
  45. ITU-T~SG16/Q15 (T. Gardos, ed.), "Video codec test model number 10 (TMN-10) (H.263+)," ITU-T SG16/Q15 document Q15-D-65, Apr. 1998.Google ScholarGoogle Scholar
  46. S. Wenger, G.D. Knorr, J. Ott, and F. Kossentini, "Error resilience support in H.263+," IEEE Trans. Circuits and Systems for Video Technology, vol. 8, no. 7, pp. 867--877, Nov. 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Layered coding vs. multiple descriptions for video streaming over multiple paths

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          MULTIMEDIA '03: Proceedings of the eleventh ACM international conference on Multimedia
          November 2003
          670 pages
          ISBN:1581137222
          DOI:10.1145/957013

          Copyright © 2003 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 2 November 2003

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • Article

          Acceptance Rates

          Overall Acceptance Rate995of4,171submissions,24%

          Upcoming Conference

          MM '24
          MM '24: The 32nd ACM International Conference on Multimedia
          October 28 - November 1, 2024
          Melbourne , VIC , Australia

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader