skip to main content
10.1145/3172944.3172976acmconferencesArticle/Chapter ViewAbstractPublication PagesiuiConference Proceedingsconference-collections
research-article

An Active Tangible User Interface Framework for Teaching and Learning Artificial Intelligence

Published: 05 March 2018 Publication History

Abstract

Interactive and tangible computing platforms have garnered increased interest in the pursuit of embedding active learning pedagogies within curricula through educational technologies. Whilst Tangible User Interface (TUI) systems have successfully been developed to edutain children in various research, TUI architectures have seen limited deployment in more complex and abstract domains. In light of these limitations, this paper proposes an active TUI framework that addresses the challenges experienced in teaching and learning artificial intelligence (AI) within higher educational institutions. The proposal extends an aptly designed tabletop TUI architecture with the novel interactive paradigm of active tangible manipulatives to provide a more engaging and effective user interaction. The paper describes the deployment of the proposed TUI framework within an undergraduate laboratory session to aid in the teaching and learning of artificial neural networks. The experiment is assessed against currently adopted educational computer software and the obtained results highlight the potential of the proposed TUI framework to augment students? gain in knowledge and understanding of abstracted threshold concepts in higher education.

References

[1]
H Agrawal and K Sorathia. 2013. AstroGrasp: a tangible user interface for teaching basic astronomy concepts. Proceedings of the 11th Asia Pacific Conf: 123--128.
[2]
A. S. Ahmad, M. Y. Hassan, M. P. Abdullah, H. A. Rahman, F. Hussin, H. Abdullah, and R. Saidur. 2014. A review on applications of ANN and SVM for building electrical energy consumption forecasting. Renewable and Sustainable Energy Reviews 33: 102--109.
[3]
Xavier Alaman, Juan Mateu, and Maria J. Lasala. 2016. Designing virtual world educational applications. 2016 IEEE Global Engineering Education Conference (EDUCON), April: 1134--1137.
[4]
Joakim Almgren, Richard Carlsson, Henrik Erkkonen, Jonas Fredriksson, Sanne Moller, Henrik Rydgard, Mattias Osterberg, and Morten Fjeld. 2005. Tangible User Interface for Chemistry Education: Visualization, Portability, and Database. Visualization, Portability, and Database. Proc. SIGRAD 2005, 16: 19--24.
[5]
Ross Bencina and Martin Kaltenbrunner. 2005. The Design and Evolution of Fiducials for the reacTIVision System. In Proc. 3rd International Conf on Generative Systems in the Electronic Arts.
[6]
Lorena Blasco-Arcas, Isabel Buil, Blanca Hernández-Ortega, and F. Javier Sese. 2013. Using clickers in class. the role of interactivity, active collaborative learning and engagement in learning performance. Computers and Education 62: 102--110.
[7]
P.J. Braspenning, F. Thuijsman, and A. Weijters. 1995. Artificial neural networks: an introduction to ANN theory and practice. Springer Science & Business Media.
[8]
Lars Buitinck, Gilles Louppe, Mathieu Blondel, Fabian Pedregosa, Andreas Mueller, Olivier Grisel, Vlad Niculae, Peter Prettenhofer, Alexandre Gramfort, Jaques Grobler, Robert Layton, Jake Vanderplas, Arnaud Joly, Brian Holt, and Gaël Varoquaux. 2013. API design for machine learning software: experiences from the scikit-learn project.
[9]
Andrew Butterfield, Vivek Vedagiri, Edward Lang, Cath Lawrence, Matthew J Wakefield, Alexander Isaev, and Gavin A Huttley. 2004. PyEvolve: a toolkit for statistical modelling of molecular evolution. BMC Bioinformatics 5, 1: 1.
[10]
Alejandro Catala, Javier Jaen, Adria A. Martinez-Villaronga, and Jose A. Mocholi. 2011. AGORAS: Exploring creative learning on tangible user interfaces. In Proceedings - International Computer Software and Applications Conference, 326--335.
[11]
Caudill and Maureen. 1986. Neural networks primer, part I. AI Expert 2, 12: 46--52.
[12]
Tilanka Chandrasekera and So-Yeon Yoon. 2015. The Effect of Tangible User Interfaces on Cognitive Load in the Creative Design Process. Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality - Media, Art, Social Science, Humanities and Design: 6--8.
[13]
P. Díaz-Moreno, J. J. Carrasco, E. Soria-Olivas, J. M. Martínez-Martínez, P. Escandell-Montero, and J. Gómez-Sanchis. 2016. Educational Software Based on Matlab GUIs for Neural Networks Courses. In Handbook of Research on Computational Simulation and Modeling in Engineering. 333--358.
[14]
Darren Edge and Alan Blackwell. 2006. Correlates of the cognitive dimensions for tangible user interface. Journal of Visual Languages and Computing 17, 4: 366--394.
[15]
Ruwan Fernando, Karine Dupre, and Henry Skates. 2016. Tangible user interfaces for teaching building physics: Towards continuous designing in education. In CAADRIA 2016, 21st International Conference on Computer-Aided Architectural Design Research in Asia - Living Systems and Micro-Utopias: Towards Continuous Designing, 693--702.
[16]
Eibe Frank, Mark A Hall, and Ian H Witten. 2016. The WEKA Workbench. Morgan Kaufmann, Fourth Edition: 553--571.
[17]
Ian J. Goodfellow, David Warde-Farley, Pascal Lamblin, Vincent Dumoulin, Mehdi Mirza, Razvan Pascanu, James Bergstra, Frédéric Bastien, and Yoshua Bengio. 2013. Pylearn2: a machine learning research library.
[18]
Satoshi Ishibushi, Akira Taniguchi, Toshiaki Takano, Yoshinobu Hagiwara, and Tadahiro Taniguchi. 2015. Statistical localization exploiting convolutional neural network for an autonomous vehicle. In IECON 2015 - 41st Annual Conference of the IEEE Industrial Electronics Society, 1369--1375.
[19]
Hiroshi Ishii. 2008. Tangible bits: beyond pixels. Proceedings of the 2nd international conference on Tangible and Embedded Intreaction (TEI '08): xv--xxv.
[20]
Yangqing Jia, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross Girshick, Sergio Guadarrama, and Trevor Darrell. 2014. Caffe: Convolutional Architecture for Fast Feature Embedding. In Proceedings of the ACM International Conference on Multimedia - MM '14, 675--678.
[21]
Martin Kaltenbrunner and Ross Bencina. 2007. reacTIVision: a computer-vision framework for table-based tangible interaction. Proceedings of the 1st international conference on Tangible and embedded interaction: 69--74.
[22]
Martin Kaltenbrunner, Till Bovermann, Ross Bencina, and Enrico Costanza. 2005. TUIO: A protocol for table-top tangible user interfaces. Neuroinformatics: 1--5.
[23]
Andrew Manches, Pauline Duncan, Lydia Plowman, and Shari Sabeti. 2015. Three questions about the Internet of things and children. TechTrends 59, 1.
[24]
Barton Poulson. 2016. Artificial neural networks. Retrieved 26 September 2017 from https://www.lynda.com/Big-Data-tutorials/Artificial-neural-networks/420305/505154--4.html
[25]
Clifford De Raffaele, Geoffrey Buhagiar, Serengul Smith, and Orhan Gemikonakli. 2017. Designing a Table-Top Tangible User Interface System for Higher Education. In IEEE International Conference on Smart Systems and Technologies (SST), 286--291.
[26]
Clifford De Raffaele, Serengul Smith, and Orhan Gemikonakli. 2016. The aptness of Tangible User Interfaces for explaining abstract computer network principles. In Proceedings - Frontiers in Education Conference, FIE. 1--8.
[27]
Clifford De Raffaele, Serengul Smith, and Orhan Gemikonakli. 2016. Teaching and learning queueing theory concepts using Tangible User Interfaces. In 2016 IEEE Int Conference on Teaching, Assessment, and Learning for Engineering (TALE), 194--201.
[28]
Clifford De Raffaele, Serengul Smith, and Orhan Gemikonakli. 2017. The Application of Tangible User Interfaces for Teaching and Learning in Higher Education. In Innovative Teaching and Learning in Higher Education (illustrate), John Branch (ed.). Libri Publishing, 215--226.
[29]
Clifford De Raffaele, Serengul Smith, and Orhan Gemikonakli. 2017. Explaining multi-threaded task scheduling using tangible user interfaces in higher educational contexts. In 2017 IEEE Global Engineering Education Conf (EDUCON), 1383--1390.
[30]
J.V. Ringwood and G. Galvin. 2002. Computer-aided learning in artificial neural networks. IEEE Transactions on Education 45, 4: 380--387.
[31]
B Schneider, J Wallace, P Blikstein, and R Pea. 2013. Preparing for Future Learning with a Tangible User Interface: The Case of Neuroscience. IEEE Transactions on Learning Technologies 6, 2: 117--129.
[32]
Bertrand Schneider, Paulo Blikstein, and Wendy Mackay. 2012. Combinatorix: Tangible user interface that supports collaborative learning of probabilities. ITS '12 Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces: 129--132.
[33]
Bertrand Schneider, Patrick Jermann, Guillaume Zufferey, and Pierre Dillenbourg. 2011. Benefits of a tangible interface for collaborative learning and interaction. IEEE Transactions on Learning Technologies 4, 3: 222--232.
[34]
Orit Shaer, Consuelo Valdes, Sirui Liu, Kara Lu, Kimberly Chang, Wendy Xu, Traci L. Haddock, Swapnil Bhatia, Douglas Densmore, and Robert Kincaid. 2014. Designing reality-based interfaces for experiential bio-design. Personal and Ubiquitous Computing 18, 6: 1515--1532.
[35]
SharkTime Software. 2013. Sharky Neural Network - Classification neural network in action. Retrieved 26 September 2017 from http://sharktime.com/us_SharkyNeuralNetwork.html
[36]
Alexander Skulmowski and Günter Daniel Rey. 2017. Bodily effort enhances learning and metacognition: Investigating the relation between physical effort and cognition using dual-process models of embodiment. Advances in Cognitive Psychology 13, 1: 3--10.
[37]
Daniel Smilkov and Shan Carter. 2017. A Neural Network Playground.
[38]
Julia E. Stephenson, Clifford Brown, and Darren K. Griffin. 2008. Electronic delivery of lectures in the university environment: An empirical comparison of three delivery styles. Computers and Education 50, 3: 640--651.
[39]
Akiko Takahashi, Yasuhiro Kashiwaba, Toshiaki Okumura, Toshihiko Ando, Kuniaki Yajima, Yoshihiro Hayakawa, Motomu Takeshige, and Tatsuo Uchida. 2016. Design of advanced active and autonomous learning system for computing education - A3 learning system. In Proceedings of 2015 IEEE International Conference on Teaching, Assessment and Learning for Engineering, TALE 2015, 77--82.
[40]
Joshua Tanenbaum and Angela Tomizu. 2008. Narrative Meaning Creation in Interactive Storytelling. International Journal of Computational Science 2, 1: 3--20.
[41]
Theano Development Team. 2016. Theano: A Python framework for fast computation of mathematical expressions. arXiv e-prints abs/1605.0.
[42]
Danli Wang, Lan Zhang, Chao Xu, Haichen Hu, and Yunfeng Qi. 2016. A Tangible Embedded Programming System to Convey Event-Handling Concept. Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction - TEI '16: 133--140.
[43]
K.A. Williams and A.M.L. Cavallo. 1995. Reasoning Ability, Meaningful Learning, and Students' Understanding of Physics Concepts: Relating Students' Reasoning Ability and Learning Styles To Their Physics Misconceptions. Journal of College Science Teaching 24, 5: 311--314.
[44]
Carmen R. Wilson Van Voorhis and Betsy L Morgan. 2007. Understanding Power and Rules of Thumb for Determining Sample Sizes. Tutorials in Quantitative Methods for Psychology 3, 2: 43--50.
[45]
Oren Zuckerman, Saeed Arida, and Mitchel Resnick. 2005. Extending Tangible Interfaces for Education: Digital Montessori-inspired Manipulatives. CHI'05 Proceedings of the SIGCHI Conference on Human Factors in CS: 859--868.

Cited By

View all
  • (2024)ProtoBricks: A Research Toolkit for Tangible Prototyping & Data PhysicalizationProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661573(476-495)Online publication date: 1-Jul-2024
  • (2023)The interface is on the table: Systematic Literature Review about interaction design to applications for tangible tabletops.Proceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems10.1145/3638067.3638091(1-12)Online publication date: 16-Oct-2023
  • (2023)Mix & Match Machine Learning: An Ideation Toolkit to Design Machine Learning-Enabled SolutionsProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3572739(1-18)Online publication date: 26-Feb-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
IUI '18: Proceedings of the 23rd International Conference on Intelligent User Interfaces
March 2018
698 pages
ISBN:9781450349451
DOI:10.1145/3172944
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 March 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. artificial neural networks.
  2. computer-aided instruction
  3. higher education
  4. tangible user interface

Qualifiers

  • Research-article

Conference

IUI'18
Sponsor:

Acceptance Rates

IUI '18 Paper Acceptance Rate 43 of 299 submissions, 14%;
Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)91
  • Downloads (Last 6 weeks)8
Reflects downloads up to 19 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)ProtoBricks: A Research Toolkit for Tangible Prototyping & Data PhysicalizationProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661573(476-495)Online publication date: 1-Jul-2024
  • (2023)The interface is on the table: Systematic Literature Review about interaction design to applications for tangible tabletops.Proceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems10.1145/3638067.3638091(1-12)Online publication date: 16-Oct-2023
  • (2023)Mix & Match Machine Learning: An Ideation Toolkit to Design Machine Learning-Enabled SolutionsProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3572739(1-18)Online publication date: 26-Feb-2023
  • (2023)A comprehensive survey on the artificial neural network open source software for implementing computational intelligenceAPPLIED DATA SCIENCE AND SMART SYSTEMS10.1063/5.0177789(020010)Online publication date: 2023
  • (2021)Designing a tangible tabletop installation and enacting a socioenactive experience with TangiTimeJournal of the Brazilian Computer Society10.1186/s13173-021-00112-y27:1Online publication date: 28-May-2021
  • (2021)Evaluating the Socioenactive Experience with a Tangible Tabletop Installation: A Case StudyHuman-Computer Interaction10.1007/978-3-030-66919-5_13(126-135)Online publication date: 5-Jan-2021
  • (2020)Using tangible user interfaces for teaching concepts of internet of thingsInteractive Technology and Smart Education10.1108/ITSE-09-2019-006117:2(133-158)Online publication date: 21-Feb-2020
  • (2019)TangiTimeProceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems10.1145/3357155.3358451(1-11)Online publication date: 22-Oct-2019
  • (2019)A “learning by design” application for modeling, implementing, and evaluating hardware architectures for artificial neural networks at undergraduate levelComputer Applications in Engineering Education10.1002/cae.2214827:5(1236-1252)Online publication date: Aug-2019

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media