C-blink: a hue-difference-based light signal marker for large screen interaction via any mobile terminal

ABSTRACT

To enable common mobile terminals to interact with contents shown on large screens, we propose "C-Blink", a new light signal marker method that uses the color liquid-crystal display of a mobile terminal as a visible light source. We overcome the performance limitations of such displays by developing a hue-difference-blink technique. In combination with a screen-side sensor, we describe a system that detects and receives light signal markers sent by cell phone displays. Evaluations of a prototype system confirm that C-Blink performs well under common indoor lighting. The C-Blink program can be installed in any mobile terminal that has a color display, and the installation costs are small. C-Blink is a very useful way of enabling ubiquitous large screens to become interfaces for mobile terminals.

REFERENCES

• 1: Dan R. Olsen, Jr. , Travis Nielsen, Laser pointer interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, p.17-22, March 2001, Seattle, Washington, United States [doi>10.1145/365024.365030]
• 2: Oh, J.-Y. and Stuerzlinger, W. Laser pointer as collaborative pointing devices. In Proceedings of Graphics Interface (GI2002), 2002, pp.141--149.
• 3: Vogt, F., Wong, J., Fels, S. and Cavens, D. Tracking multiple laser pointers for large screen interaction. Extended Abstracts of the ACM Symposium on User Interface Software and Technology (UIST2003), 2003, pp. 95--96.
• 4: Nobuyuki Matsushita , Daisuke Hihara , Teruyuki Ushiro , Shinichi Yoshimura , Jun Rekimoto , Yoshikazu Yamamoto, ID CAM: A Smart Camera for Scene Capturing and ID Recognition, Proceedings of the The 2nd IEEE and ACM International Symposium on Mixed and Augmented Reality, p.227, October 07-10, 2003
• 5: Darnell J. Moore , Roy Want , Beverly L. Harrison , Anuj Gujar , Ken Fishkin, Implementing phicons: combining computer vision with infrared technology for interactive physical icons, Proceedings of the 12th annual ACM symposium on User interface software and technology, p.67-68, November 07-10, 1999, Asheville, North Carolina, United States [doi>10.1145/320719.322585]
• 6: Hisashi Aoki , Soichiro Matsushita, Balloon Tag: (In)visible Marker Which Tells Who's Who, Proceedings of the 4th IEEE International Symposium on Wearable Computers, p.181, October 18-21, 2000
• 7: Yasue Kishino , Masahiko Tsukamoto , Yutaka Sakane , Shojiro Shojiro, Realizing a Visual Marker Using LEDs for Wearable Computing Environment, Proceedings of the 23rd International Conference on Distributed Computing Systems, p.314, May 19-22, 2003
• 8: Jun Rekimoto , Yuji Ayatsuka, CyberCode: designing augmented reality environments with visual tags, Proceedings of DARE 2000 on Designing augmented reality environments, p.1-10, April 2000, Elsinore, Denmark [doi>10.1145/354666.354667]
• 9: Y. Cho , U. Neumann, Multi-Ring Color Fiducial Systems for Scalable Fiducial Tracking Augmented Reality, Proceedings of the Virtual Reality Annual International Symposium, p.212, March 14-18, 1998
• 10: Thomas,G.A., Jin, J., Niblett, T., and Urquhart, C. A versatile camera position measurement system for virtual reality TV production. In Proceedings of International Broadcasting Convention (IBC '97), 1997, pp.284--289.
• 11: Fairchild, M.D. Color Appearance Models. Addison-Wesley, Reading, MA, 1998.
• 12: Naohiko Kohtake , Jun Rekimoto , Yuichiro Anzai, InfoPoint: A Device that Provides a Uniform User Interface to Allow Appliances to Work Together over a Network, Personal and Ubiquitous Computing, v.5 n.4, p.264-274, December 2001 [doi>10.1007/s007790170005 ]
• 13: Jun Rekimoto, Pick-and-drop: a direct manipulation technique for multiple computer environments, Proceedings of the 10th annual ACM symposium on User interface software and technology, p.31-39, October 14-17, 1997, Banff, Alberta, Canada [doi>10.1145/263407.263505]
• 14: Eiichi Hosoya , Miki Kitabata , Hidenori Sato , Ikuo Harada , Hisao Nojima , Fumiharu Morisawa , Shinichiro Mutoh , Akira Onozawa, A Mirror Metaphor Interaction System: Touching Remote Real Objects in an Augmented Reality Environment, Proceedings of the The 2nd IEEE and ACM International Symposium on Mixed and Augmented Reality, p.350, October 07-10, 2003
• 15: Osamu Morikawa , Takanori Maesako, HyperMirror: toward pleasant-to-use video mediated communication system, Proceedings of the 1998 ACM conference on Computer supported cooperative work, p.149-158, November 14-18, 1998, Seattle, Washington, United States [doi>10.1145/289444.289489]
• 16: Pattie Maes , Trevor Darrell , Bruce Blumberg , Alex Pentland, The ALIVE system: wireless, full-body interaction with autonomous agents, Multimedia Systems, v.5 n.2, p.105-112, March 1997 [doi>10.1007/s005300050046]
• 17: Myron W. Krueger , Thomas Gionfriddo , Katrin Hinrichsen, VIDEOPLACE—an artificial reality, Proceedings of the SIGCHI conference on Human factors in computing systems, p.35-40, April 1985, San Francisco, California, United States

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.5 INFORMATION INTERFACES AND PRESENTATION (I.7)
      H.5.2 User Interfaces (D.2.2, H.1.2, I.3.6)
          Subjects: Input devices and strategies (e.g., mouse, touchscreen)

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques
  I.5 PATTERN RECOGNITION
      I.5.4 Applications
          Subjects: Signal processing; Computer vision

Keywords:
color display, hue difference, mobile terminal, screen interaction