A graphics architecture for high-end interactive television terminals

ABSTRACT

This article presents a graphics software architecture for next-generation digital television receivers. We propose that such receivers should include a standardised Java-based procedural environment capable of rendering 2D/3D graphics and video, and a declarative environment supporting W3C recommendations such as SMIL and XForms. We also introduce a graphics architecture model that meets such requirements. As a proof-of-concept, a prototype implementation of the model is presented. This implementation enhances television content by allowing the user to play 3D graphics games, to run Java applications, and to browse XML-based documents while meeting current hardware restrictions.

REFERENCES

• 1: ARIB. 2003a. Application execution engine platform for digital broadcasting. ARIB STD-B23 v1.0.
• 2: ARIB. 2003b. Data coding and transmission specification for digital broadcasting. ARIB STD-B24 v3.2.
• 3: ATSC. 2004. ATSC candidate standard: Advanced common application platform (ACAP). ATSC Doc. A/101A.
• 4: Bulterman, D. C. A. et al. 2005. Synchronized Multimedia Integration Language (SMIL) 2.0 2nd Ed. W3C Recommendation.
• 5: Dick C. A. Bulterman , Lloyd Rutledge, Smil 2.0: Interactive Multimedia for Web and Mobile Devices (X.Media.Publishing), SpringerVerlag, 2004
• 6: Cesar, P., Vierinen, J., and Vuorimaa, P. 2003. Open graphical framework for interactive TV. In Proceedings of the International Symposium on Multimedia Software Engineering. Taichung, Taiwan, IEEE, 21--28.
• 7: Kyung-Ae Cha , Sangwook Kim, MPEG-4 STUDIO: An Object-Based Authoring System for MPEG-4 Contents, Multimedia Tools and Applications, v.25 n.1, p.111-131, January 2005 [doi>10.1023/B:MTAP.0000046384.83647.54]
• 8: Cheok, L.-T. and Eleftheriadis, A. 2002. SMIL vs MPEG-4 BIFS. Tech. rep. Department of Electrical Engineering, Columbia University.
• 9: Chorianopoulos, K. 2004. Virtual television channels: Conceptual model, user interface design and affective usability evalution. Ph.D. thesis, Athens University of Economics and Business, Athens, Greece.
• 10: Dubinko, M. et al. 2003. XForms 1.0. W3C Recommendation.
• 11: DVB. 2004. Digital Video Broadcasting (DVB); Globally Executable MHP (GEM). ETSI TS 102 819 v1.2.1.
• 12: DVB. 2005. Digital Video Broadcasting (DVB); Multimedia Home Platform (MHP) Specification 1.1.2. DVB Document A068 Rev. 1.
• 13: Mark Green , Robert Jacob, SIGGRAPH '90 Workshop report: software architectures and metaphors for non-WIMP user interfaces, ACM SIGGRAPH Computer Graphics, v.25 n.3, p.229-235, July 1991 [doi>10.1145/126640.126677]
• 14: Mikko Honkala , Pablo Cesar , Petri Vuorimaa, A Device Independent XML User Agent for Multimedia Terminals, Proceedings of the IEEE Sixth International Symposium on Multimedia Software Engineering (ISMSE'04), p.116-123, December 13-15, 2004
• 15: Illgner, K. and Cosmas, J. 2001. System concept for interactive broadcasting consumer terminals. In Proceedings of the International Broadcasting Convention (IBC). Amsterdam, The Netherlands.
• 16: ITU-T. 2001. Worldwide common core---application environment for digital interactive television services. ITU-T J.200.
• 17: ITU-T. 2003. Harmonization of procedural content formats for interactive TV applications. ITU-T J.202.
• 18: ITU-T. 2004. Harmonization of declarative content format for interactive TV applications. ITU-T J.201.
• 19: Jalava, T., Honkala, M., Pohja, M., and Vuorimaa, P. 2005. Timesheets: XML timing language. W3C Member Submission.
• 20: Magnor, M. 2004. 3D-TV---the future of visual entertainment. In Proceedings of the Workshop on Multimedia Databases and Image Communication. Salerno, Italy. 1--8.
• 21: Malerczyk, C., Klein, K., and Weibeisek, T. 2003. 3D reconstruction of sports events for digital TV. In Proceedings of the 11th International Conference in Central Europe on Computer Graphics, Visualization, and Computer Vision. Plzen, Czech Republic. WSCG.
• 22: Chris Marrin , Rob Myers , Jim Kent , Peter Broadwell, Steerable media: interactive television via video synthesis, Proceedings of the sixth international conference on 3D Web technology, p.7-14, February 2001, Paderbon, Germany [doi>10.1145/363361.363365]
• 23: Myers, B. 2004. Graphical user interface programming. In CRC Handbook of Computer Science and Engineering, 2nd Ed. (Chapter 48). A. B. Tucker Ed, CRC Press, Inc., Boca Raton, FL.
• 24: Brad Myers , Scott E. Hudson , Randy Pausch, Past, present, and future of user interface software tools, ACM Transactions on Computer-Human Interaction (TOCHI), v.7 n.1, p.3-28, March 2000 [doi>10.1145/344949.344959]
• 25: Dan R. Olsen, Jr., Developing user interfaces, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1998
• 26: Onural, L., Sikora, T., and Smolic, A. 2004. An overview of a new european consortium: Integrated three-dimensional television---capture, transmission and display (3DTV). In Proceedings of the European Workshop on the Integration of Knowledge, Semantics and Digital Media Technology (EWIMT). London, UK.
• 27: Fernando C. Pereira , Touradj Ebrahimi, The MPEG-4 Book, Prentice Hall PTR, Upper Saddle River, NJ, 2002
• 28: Rop Pulles , Pavel Sasno, A set top box combining MHP and MPEG-4 interactivity, Proceedings of the 2nd European Union symposium on Ambient intelligence, November 08-10, 2004, Eindhoven, Netherlands [doi>10.1145/1031419.1031427]
• 29: Nicolas Roussel, Ametista: a mini-toolkit for exploring new window management techniques, Proceedings of the Latin American conference on Human-computer interaction, August 17-20, 2003, Rio de Janeiro, Brazil
• 30: S. M. Tran , M. Preda , F. J. Preteux , K. Fazekas, Exploring MPEG-4 BIFS features for creating multimedia games, Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 2 (ICME '03), p.429-432, July 06-09, 2003

INDEX TERMS

Primary Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
      D.2.6 Programming Environments
          Subjects: Graphical environments

Additional Classification:
  D. Software
  D.2 SOFTWARE ENGINEERING
        D.2.11 Software Architectures
      D.2.6 Programming Environments
          Subjects: Interactive environments

  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Graphical user interfaces (GUI); Standardization; Windowing systems

  J. Computer Applications
  J.7 COMPUTERS IN OTHER SYSTEMS
      Subjects: Consumer products

General Terms:
Design, Experimentation, Languages

Keywords:
3D graphics, Digital TV, MHP, SMIL, XForms, XML