A new hybrid error concealment scheme for H.264 video transmission

ABSTRACT

For an entropy-coded video bitstream, a transmission error in a codeword will not only affect the underlying codeword but may also affect subsequent codewords, resulting in a great degradation of received video frames. In this study, a new hybrid error concealment scheme for H.264 video transmission is proposed. Here, pixel interpolation and the fast best neighborhood matching (BNM) algorithm are employed to conceal intra-coded I frames. For inter-coded P frames, the predicted motion vector (PMV) for a corrupted block is first determined by the spatial MVs around the corrupted block and the corresponding temporally motion-projected overlapping MVs in the previous frame. Then based on the PMV, the optimal candidate concealed block for a corrupted block is searched over all the motion-compensated blocks in the previous frame with their MVs being determined by all the available spatial and temporal information. After all the corrupted blocks in a P frame are initially concealed, error concealment refinement is performed on all the initial concealed blocks to improve the error concealment results. Based on the simulation results obtained in this study, the performance of the proposed scheme is better than that of the corresponding comparison schemes.

REFERENCES

• 1: Wang, Y. and Zhu, Q. F., Error control and concealment for video communication: a review. Proceedings of the IEEE, 86, 5 (May 1998), 974--997.
• 2: Ruf, M. J. and Modestino, J. W., Operational rate-distortion performance for joint source and channel coding of images. IEEE Trans. on Image Processing, 8, 3 (March 1999), 305--320.
• 3: Redmill, D. W. and Kingsbury, N. G., The EREC: an error-resilient technique for coding variable-length blocks of data. IEEE Trans. on Image Processing, 5, 4 (April 1996), 565--574.
• 4: Lee, J. and Dickinson, B. W., Rate-distortion optimized frame type selection for MPEG encoding. IEEE Trans. on Circuits and Systems for Video Technology, 7, 3 (June 1997), 501--510.
• 5: Gallant, M. and Kossentini, F., Rate-distortion optimized layered coding with unequal error protection for robust Internet video. IEEE Trans. on Circuits and Systems for Video Technology, 11, 3 (March 2001), 357--372.
• 6: Wang. Y., Orchard, M., Vaishampayan, V., and Reibman, A. R., Multiple description coding using pairwise correlating transform. IEEE Trans. on Image Processing, 10, 3 (March 2001), 351--366.
• 7: Kang, L. W. and Leou, J. J., An error resilient coding scheme for H.264/AVC video transmission based on data embedding. Journal of Visual Communication and Image Representation, 16, 1 (Feb. 2005), 93--114.
• 8: Zeng, W. and Liu, B., Geometric-structure-based error concealment with novel applications in block-based low-bit-rate coding. IEEE Trans. on Circuits and Systems for Video Technology, 9, 4 (June 1999), 648--665.
• 9: Wang, Z., Yu, Y., and Zhang, D., Best neighborhood matching: an information loss restoration technique for block-based image coding systems. IEEE Trans. on Image Processing, 7, 7 (July 1998), 1056--1061.
• 10: Yan, B. and Ng, K. W., A novel selective motion vector matching algorithm for error concealment in MPEG-4 video transmission over error-prone channels. IEEE Trans. on Consumer Electronics, 49, 4 (Nov. 2003), 1416--1423.
• 11: Tsekeridou, S., Cheikh, F. A., Gabbouj, M., and Pitas, I., Vector rational interpolation schemes for erroneous motion field estimation applied to MPEG-2 error concealment. IEEE Trans. on Multimedia, 6, 6 (Dec. 2004), 876--885.
• 12: Zheng, J. and Chau, L. P., A temporal error concealment algorithm for H.264 using Lagrange interpolation. Proceedings of the IEEE, 2 (May 2004), 133--136.
• 13: Chu, W. J. and Leou, J. J., Detection and concealment of transmission errors in H.261 images. IEEE Trans. on Circuits and Systems for Video Technology, 8, 1 (Feb. 1998), 74--84.
• 14: Shyu, H. C. and Leou, J. J., Detection and concealment of transmission errors in MPEG-2 images-a genetic algorithm approach. IEEE Trans. on Circuits and Systems for Video Technology, 9, 6 (Sept. 1999), 937--948.
• 15: Girod, B. and Farber, N., Feedback-based error control for mobile video transmission. Proceedings of the IEEE, 87, 10 (Oct. 1999), 1707--1723.
• 16: Kang, L. W. and Leou, J. J., A hybrid error concealment scheme for MPEG-2 video transmission based on best neighborhood matching algorithm. in Proc. of 2004 IEEE Int. Conf. on Multimedia and Expo, 2 (June 2004), 1355--1358.
• 17: H.264, Draft ITU-T Recommendation and Final Draft International Standard, Redmond, WA, USA, July 2004.

INDEX TERMS

Primary Classification:
  E. Data
  E.4 CODING AND INFORMATION THEORY

Additional Classification:
  C. Computer Systems Organization
  C.2 COMPUTER-COMMUNICATION NETWORKS
      C.2.2 Network Protocols
  C.4 PERFORMANCE OF SYSTEMS

General Terms:
Algorithms, Design, Performance

Keywords:
best neighborhood matching (BNM), hybrid error concealment, predicted motion vector (PMV), video transmission