Michael Krone
ABSTRACT
Scientific data is typically analyzed using visualizations. Large high-resolution displays can facilitate the analysis process since they offer more screen real estate than desktop monitors, which allows visualizing more data in greater detail and working collaboratively. On the other hand, mobile devices like smartphones and tablets are getting more and more popular but do not have sufficient graphics capabilities for advanced scientific visualizations. In this paper, we discuss a client application for Android devices that allows to remote control a scientific visualization framework. Combining the power of remote rendering with the availability, flexibility, and mobility of mobile devices results in a ubiquitous computing solution for scientific visualization. The user interaction with a large high-resolution display is only one possible application scenario. Other scenarios include presentation of results and remote visualization. The design of our Android application fulfills the requirement of all these application scenarios.
- C. Butson, G. Tamm, S. Jain, T. Fogal, and J. Krüger. Evaluation of interactive visualization on mobile computing platforms for selection of deep brain stimulation parameters. IEEE Trans. Vis. Comput. Graphics, 19(1):108--117, 1 2013. Google Scholar
Digital Library
- O. Chapuis, A. Bezerianos, and S. Frantzeskakis. Smarties: An Input System for Wall Display Development. In Proc. CHI, pages 2763--2772, 2014. Google ScholarDigital Library
- H. Chen, Y. Chen, A. Finkelstein, T. Funkhouser, K. Li, Z. Liu, R. Samanta, and G. Wallace. Data Distribution Strategies for High-resolution Displays. Computers & Graphics, 25(5):811--818, 2001.Google ScholarCross Ref
- Y. Chen, H. Chen, D. W. Clark, Z. Liu, G. Wallace, and K. Li. Software Environments for Cluster-based Display Systems. In IEEE/ACM Int. Symposium on Cluster Computing and the Grid, pages 202--210, 2001. Google ScholarDigital Library
- L. Chittaro. Visualizing information on mobile devices. IEEE Computer, 39(3):40--45, 2006. Google ScholarDigital Library
- Y. Collet. LZ4 - Extremely fast compression. online (accessed 16.06.2015). https://github.com/Cyan4973/lz4.Google Scholar
- K. Fukuchi. libqrencode. online (accessed 17.04.2015). http://fukuchi.org/works/qrencode/index.html.en.Google Scholar
- T. Gjerlufsen, C. N. Klokmose, J. Eagan, C. Pillias, and M. Beaudouin-Lafon. Shared Substance: Developing Flexible Multi-surface Applications. In Proc. CHI, pages 3383--3392, 2011. Google ScholarDigital Library
- S. Grottel, M. Krone, C. Müller, G. Reina, and T. Ertl. MegaMol -- A prototyping framework for particle-based visualization. IEEE Trans. Vis. Comput. Graphics, 21(2):201--214, 2015.Google ScholarCross Ref
- S. Gumhold. Splatting Illuminated Ellipsoids with Depth Correction. In Vision, Modeling, and Visualization, pages 245--252, 2003.Google Scholar
- A. Henderson, J. Ahrens, and C. Law. The ParaView Guide. Kitware Inc., 2004. http://www.paraview.org/.Google Scholar
- M. Hereld, I. R. Judson, J. Paris, and R. L. Stevens. Developing tiled projection display systems. In Proc. Immersive Projection Technology Workshop, 2000.Google Scholar
- W. Humphrey, A. Dalke, and K. Schulten. VMD -- Visual Molecular Dynamics. Journal of Molecular Graphics, 14:33--38, 1996.Google ScholarCross Ref
- G. Humphreys, M. Houston, R. Ng, R. Frank, S. Ahern, P. D. Kirchner, and J. T. Klosowski. Chromium: A Stream-processing Framework for Interactive Rendering on Clusters. ACM Transactions on Graphics, 21(3):693--702, 2002. Google ScholarDigital Library
- B. Kozlikova, M. Krone, N. Lindow, M. Falk, M. Baaden, D. Baum, I. Viola, J. Parulek, and H.-C. Hege. Visualization of Biomolecular Structures: State of the Art. In Eurographics Conference on Visualization (EuroVis) - STARs, 2015.Google Scholar
- M. Krone, J. E. Stone, T. Ertl, and K. Schulten. Fast Visualization of Gaussian Density Surfaces for Molecular Dynamics and Particle System Trajectories. In EuroVis - Short Papers, volume 1, pages 67--71, 2012.Google Scholar
- J. Krüger. ImageVis3D Mobile Universal. https://itunes.apple.com/us/app/imagevis3d-mobile-universal/id378071694, Sep 2012.Google Scholar
- B. Lee, P. Isenberg, N. Riche, and S. Carpendale. Beyond Mouse and Keyboard: Expanding Design Considerations for Information Visualization Interactions. IEEE Trans. Vis. Comput. Graphics, 18(12):2689--2698, 2012. Google ScholarDigital Library
- Live Networks, Inc. LIVE555 Streaming Media. online (accessed 17.04.2015). http://www.live555.com/liveMedia/.Google Scholar
- E. Luke and C. Hansen. Semotus visum: a flexible remote visualization framework. In Proceedings of IEEE Visualization, pages 61--68, 2002. Google ScholarDigital Library
- C. Müller, G. Reina, and T. Ertl. The VVand: A two-tier system design for high-resolution stereo rendering. In CHI POWERWALL 2013 Workshop, 2013.Google Scholar
- S. Nam, B. Jeong, L. Renambot, A. Johnson, K. Gaither, and J. Leigh. Remote visualization of large scale data for ultra-high resolution display environments. In Proc. UltraVis, pages 42--44, 2009. Google ScholarDigital Library
- P. A. Navrátil, B. Westing, G. P. Johnson, A. Athalye, J. Carreno, and F. Rojas. A practical guide to large tiled displays. In Proc. Advances in Visual Computing, pages 970--981, 2009. Google ScholarDigital Library
- T. Ni, G. S. Schmidt, O. G. Staadt, M. A. Livingston, R. Ball, and R. May. A survey of large high-resolution display technologies, techniques, and applications. In IEEE VR Conference 2006, pages 223--236, 2006. Google ScholarDigital Library
- C. Noon, J. Holub, and E. Winer. Real-time volume rendering of digital medical images on an iOS device. In Proc. SPIE, volume 8667, pages 86670U--86670U--12, 2013.Google ScholarCross Ref
- C. Papadopoulos, K. Petkov, and A. Kaufman. Building the Reality Deck. In CHI POWERWALL 2013 Workshop, 2013.Google Scholar
- G. Reina and T. Ertl. Hardware-Accelerated Glyphs for Mono- and Dipoles in Molecular Dynamics Visualization. In EG/IEEE VGTC Symposium on Visualization, pages 177--182, 2005. Google ScholarDigital Library
- L. Renambot, A. Rao, R. Singh, J. Byungil, N. Krishnaprasad, V. Vishwanath, V. Chandrasekhar, N. Schwarz, A. Spale, C. Zhang, G. Goldman, J. Leigh, and A. Johnson. Sage: The Scalable Adaptive Graphics Environment. In Proceedings of WACE, 2004.Google Scholar
- C. Sigg, T. Weyrich, M. Botsch, and M. Gross. GPU-Based Ray-Casting of Quadratic Surfaces. In Proc. of the 3rd EG/IEEE VGTC Conference on Point-Based Graphics, pages 59--65, 2006. Google ScholarDigital Library
- SunsetLakeSoftware. Molecules iOS App 2.1. https://itunes.apple.com/app/molecules/id284943090, Apr 2012.Google Scholar
- M. Tarini, P. Cignoni, and C. Montani. Ambient Occlusion and Edge Cueing for Enhancing Real Time Molecular Visualization. IEEE Trans. Vis. Comput. Graphics, 12(5):1237--1244, 2006. Google ScholarDigital Library
- Theoretical & Comp Biophys-Univ of Illinois at UC. VMD Remote Control 1.0.03, Dec 2014. https://play.google.com/store/apps/details?id=edu.uiuc.ks.vmdmobile&hl=en.Google Scholar
- VideoLAN. libVLC. online (accessed 17.04.2015). https://wiki.videolan.org/LibVLC/.Google Scholar
- ZXing Team. Barcode scanner. online (accessed 17.04.2015), 2015. https://github.com/zxing/zxing.Google Scholar
- Remote Rendering and User Interaction on Mobile Devices for Scientific Visualization
Recommendations
Data Visualization on Mobile Devices
CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing SystemsAs mobile visualization is increasingly used and new mobile device form factors and hardware capabilities continuously emerge, it is timely to reflect on what has been discovered to date and to look into the future. This workshop will bring together ...
An exploration of interaction styles in mobile devices for navigating 3d environments
APCHI '12: Proceedings of the 10th asia pacific conference on Computer human interactionLarge displays are becoming more ubiquitous, but often only present passive information to passerby (e.g., about the 3D layouts and maps of buildings). To improve users' experience, museums and similar places could have a system where users would be ...
A Streaming-Based Solution for Remote Visualization of 3D Graphics on Mobile Devices
Mobile devices such as Personal Digital Assistants, Tablet PCs, and cellular phones have greatly enhanced user capability to connect to remote resources. Although a large set of applications are now available bridging the gap between desktop and mobile ...
Comments