New Interaction Tools for Preserving an Old Language

ABSTRACT

The Penan people of Malaysian Borneo were traditionally nomads of the rainforest. They would leave messages in the jungle for each other by shaping natural objects into language tokens and arranging these symbols in specific ways -- much like words in a sentence. With settlement, the language is being lost as it is not being used by the younger generation. We report here, a tangible system designed to help the Penan preserve their unique object writing language. The key features of the system are that: its tangibles are made of real objects; it works in the wild; and new tangibles can be fabricated and added to the system by the users. Our evaluations show that the system is engaging and encourages intergenerational knowledge transfer and thus has the potential to help preserve this language.

References

1. Barrett, G. and Omote, R., Projected-capacitive touch technology. Information Display, 26, 3, (2010) 16--21.
2. Bidwell, N. J., Reitmaier, T., Marsden, G., & Hansen, S., Designing with mobile digital storytelling in rural Africa. In Proc Chi2010, ACM, (2010), 1593--1602.
3. Blagojevic, R., and Plimmer, B. CapTUI: Geometric Drawing with Tangibles on a Capacitive Multi-touch Display. In Proc INTERACT. (2013), 511--528.
4. Bogdan, R. C. and Biklen, S. K. Qualitative research in education. An introduction to theory and methods. Allyn & Bacon, MA, USA, 2010
5. Chan, L., Müller, S., et al, CapStones and ZebraWidgets: sensing stacks of building blocks, dials and sliders on capacitive touch screens. In Proc CHI 2012, ACM, (2012) pp. 2189--2192.
6. Chipman, G., Fails, J. A., Druin, A. and Guha, M. L., Paper vs. tablet computers: a comparative study using Tangible Flags. In Proc IDC, ACM (2012), 29--36).
7. Do, E. YL, Gross, MD. Environments for Creativity: A Lab for Making Things, ACM C&C (2007) 27--36
8. Druin, A., Montemayor, J.et al, Designing PETS: A personal electronic teller of stories. In Proceedings CHI 1999, ACM (1999), 326--329.
9. Fitzmaurice, G. W., Buxton, W., An empirical evaluation of graspable user interfaces: towards specialized, space-multiplexed input. In Proc CHI 1997, ACM (1997), 43--50.
10. Fitzmaurice, G. W., Ishii, H. and Buxton, W. A. (1995, May). Bricks: laying the foundations for graspable user interfaces. In Proc CHI 1995, ACM (1995), 442--449.
11. Geertz, C. The interpretation of cultures: Selected essays Basic books, Vol. 5019, 1973.
12. Hengeveld, B., Hummels, et al, Tangibles for toddlers learning language. In Proc TEI (2009), pp. 161--168.
13. Ishii, H., Tangible bits: beyond pixels. In Proc TEI, ACM, (2008), xv-xxv
14. Jensen, H. Sign, symbol and script: An account of man's efforts to write. London: Allen & Unwin. 1970
15. Karime, A., Hossain, et al, A., Magic stick: a tangible interface for the edutainment of young children. In Proc ICME 2009. IEEE (2009), 1338--1341.
16. Kratz, S., et al. CapWidgets: tangible widgets versus multi-touch controls on mobile devices. In Ext Abstracts CHI'11 ACM, 2011, (1351--135).
17. Liang, R. H., Chan, L., et al., GaussBricks: magnetic building blocks for constructive tangible interactions on portable displays. In Proc CHI 2014, ACM (2014), 3153--3162
18. Martínez, C., Digital Ayoyote Rattle: The Design of a Portable Low-Cost Digital Media System for a Mediated XicanIndio Resolana, In Proc IKTC, 2011, pp 88--97
19. Mayhew, D. J., The usability engineering lifecycle. In CHI'99 Extended Abstracts, ACM, (1999) 147--148.
20. Nielsen, J. 10 Usability Heuristics for User Interface Design. Nielsen Norman Group: Evidence-Based User Experience Research, Training, and Consulting. (1995)
21. Olson, I. C., Leong, Z.A., et al., It's just a toolbar!: using tangibles to help children manage conflict around a multi-touch tabletop. In Proc TEI, ACM, (2011), 29--36.
22. Price, S. and Marshall, P. (2013). Designing for learning with tangible technologies. Handbook of Design in Educational Technology, 288.
23. Rekimoto, J., SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. In Proc CHI 2002, ACM, (2002), 113--120.
24. Schuler, D., and Namioka, A., Participatory design: Principles and practices. L. Erlbaum Associates, 1993.
25. Shaer, O. and Hornecker, E., Tangible user interfaces: past, present, and future directions. Foundations & Trends in HCI, 3,1-2, (2010). 1--137.
26. Schneider, B., Jermann, P., et al, Benefits of a tangible interface for collaborative learning and interaction. IEEE Trans on Learning Technologies, 4.3, (2011). 222232.
27. Sia, C. and Tan, H., Little Chef: A Mergence of Kinesthetic and Digital Play, IDC 2014 Demos.
28. Simons, G. F. and Lewis, M. P. The world's languages in crisis. Responses to Language Endangerment. New directions in language documentation and language revitalization, (2013), 142, 3.
29. Smith, A., Reitsma, L., et al, Towards Preserving Indigenous Oral Stories Using Tangible Objects. In Culture and Computing, IEEE, (2011) pp. 86--91 IEEE.
30. Suzuki, H. and Kato, H., AlgoBlock: a tangible programming language, a tool for collaborative learning. In Proc of 4th European Logo Conference, (1993), 297303.
31. Ullmer, B. and Ishii, H., The metaDESK: models and prototypes for tangible user interfaces. In Proc UIST, ACM, (1997), 223--232. ACM.
32. Ullmer, B. and Ishii, H., Emerging frameworks for tangible user interfaces. IBM systems journal, 39,3.4, (2000), 915--931.
33. Voida, A. and Greenberg, S., Console gaming across generations: Exploring intergenerational interactions in collocated console gaming. Universal Access in the Information Society, 11:1, (2012), 45--56.
34. Wellner, P., The DigitalDesk calculator: tangible manipulation on a desk top display. In Proc UIST, ACM, (1991), 27--33).
35. Xie, L., Antle, A. N. et al, Are tangibles more fun?: comparing children's enjoyment and engagement using physical, graphical and tangible user interfaces. In Proc TEI, ACM, (2008), 191--198.
36. Yu, N. H., Chan, L. W., et al, TUIC: enabling tangible interaction on capacitive multi-touch displays. In Proc CHI'91, ACM, (1991), pp. 2995--3004.
37. Zaman, T., Jengan, G., et al. Signs, Concepts and Representation: Experiences in Documentation of Penan Indigenous Knowledge, In Proc 4th Regional Conference On Local Knowledge, Kuching, Malaysia., 2014

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)