Embedding 3D objects into NCL multimedia presentations

ABSTRACT

This paper discusses how 3D objects, in special X3D documents, can be embedded into Digital TV middleware, aiming at providing 3D interactive content for both IPTV and terrestrial DTV systems. Particularly, the paper focuses on embedding 3D objects into Ginga-NCL, the declarative environment of the Japanese-Brazilian ISDB-T_B terrestrial DTV middleware, and ITU-T Recommendation for IPTV services. Thus, we propose a well-defined interface that allows 3D objects to be declaratively embedded into NCL -- the declarative language of Ginga-NCL -- multimedia applications. Moreover, the proposed solution will allow for 3D objects to take advantage of the high-level abstractions of NCL to specify temporal behavior of 3D scenes, and contributes to the convergence process between different multimedia (2D and 3D) technologies.

References

1. ABNT NBR 15606-2, 2011. Digital Terrestrial Television - Data Coding and Transmission Specification for Digital Broadcasting - Part 2: Ginga-NCL for fixed and mobile receivers - XML application language for application coding. Available at: http://www.abnt.org.br.
2. Adobe Systems. Adobe Flash CS5.5 Professional Website. Available at http://www.adobe.com/products/flash.
3. Azevedo, R. G. A. 2010. Suporte ao controle e à apresentação de objetos de mídia tridimensionais em NCL. Master Thesis, Pontifical Catholic University of Rio de Janeiro (PUC-Rio), Brazil, August, 2010.
4. Daher, G., Nogueira, G., Fabris, F., Comarela, M., Martinello, M. Gonçalves, J., 2010. Ginga-NCL em Dispositivos Portáteis: Uma Implementação para a Plataforma Android. Simpósio Brasileiro de Sistemas Multimídia e Web - Webmedia 2010.
5. Behr, J., Jung, Y., Keil, J., Drevensek, T., Eschler, P., Zöllner, M., Fellner, D. 2010. A scalable architecture for the HTML5/X3D integration model X3DOM. In Stephen Spencer, editor, (Proceedings Web3D 2010: 15th Intl. Conference on 3D Web Technology). New York, USA, ACM Press, pp. 185--194.
6. Bulterman, D. C. A. and Rutledge, L. W.. 2009. SMIL 3.0 - Flexible Multimedia for Web, Mobile Devices and Daisy Talking Books. 2nd ed. Springer, ISBN: 978-3-540-78546-0
7. Bulterman, D. C. A. and Hardman, L.. 2005. Structured multimedia authoring. ACM Trans. Multimedia Comput. Commun. Appl. 1, 1 (February 2005), 89--109.
8. ITU-T Recommendation H.761. 2009. Nested Context Language (NCL) and Ginga-NCL for IPTV Services. Geneva, April, 2009.
9. Ginga Community, at Software Público Brasileiro. Available at: http://www.softwarepublico.gov.br
10. Kim, M., Wood, S. and Cheok, L. 2000. Extensible MPEG-4 Textual Format (XMT). 2000. ACM Workshops on Multimedia, Los Angeles, Nov. 2000.
11. Lua. 2012. Lua Language. Available at: http://www.lua.org.
12. Pérez-Luque, M. J. and Little, T. D. C. 1996. A Temporal Reference Framework for Multimedia Synchronization. IEEE Journal on Selected Areas in Communication, 14(1), January, 1996.
13. Souza, D. F. L., Tavares, T. A., Machado, L. S., and Souza Filho, G. L. 2010. Incorporating 3D technologies to the Brazilian DTV standard: a study of integration strategies based on middleware ginga. In Proceedings of the 8th international interactive conference on Interactive TV&Video (EuroITV '10). ACM, New York, NY, USA, 251--258.
14. Soares, L. F. G., Costa, R. M. R., Moreno, M. F. and Moreno, M. F. 2009. Multiple exhibition devices in DTV systems. In Proceedings of the 17th ACM international conference on Multimedia (MM '09). ACM, New York, NY, USA, 281--290.
15. Soares, L. F. G, Moreno, M. F. and Sant'Anna, F. 2009(b). Relating Declarative Hypermedia Objects and Imperative Objects through the NCL Glue Language. X ACM Symposium on Document Engineering - DocEng2009.
16. Soares, L. F. G, Moreno, M. F., Costa, R. M. R. and Moreno, M. F. 2010. Journal of Internet Services and Applications. Volume 1, Number 1, Pages 69--79.
17. Soares, L. F. G., Moreno, M. F. 2011. Ginga-NCL Architecture for Plug-ins. Technical Report of TeleMídia Lab, PUC-Rio. Rio de Janeiro, Brazil. April 2011.
18. Stewart, J. Freewrl, open-source vrml/x3d runtime. http://freewrl.sourceforge.net/index.html.
19. Tavares, D. C. et al. 2010. Interactive Virtual Worlds in Brazilian Digital Television. Workshop on Interactive Digital TV in Emergent Countries at EuroITV 2010, Tampere, Finland. 9th June, 2010.
20. Web3D, 2009. "Extensible 3D (X3D)", ISO/IEC 19776-1.2:2009, 2009. Available at: http://www.web3d.org/x3d/specifications.
21. Web3D, 2009(b). Scene access interface (SAI). http://www.web3d.org/x3d/specifications/ISOIEC-FDIS-19775-2.2-X3D-SceneAccessInterface.
22. W3C, 2009. Html 5 specification. http://www.w3.org/TR/2009/WD-html5-20090212/no.html.
23. W3C, 2009(b). Html 5 specification draft, declarative 3D scenes section. http://www.w3.org/TR/2009/WD-html5-20090212/no.html#declarative-3d-scenes

Index Terms

• Computing methodologies

  • Computer graphics

    • Graphics systems and interfaces

      • Virtual reality

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction techniques