Joanne Leong
Patrick Parzer
Florian Perteneder
Teo Babic
Alex Olwal
Michael Haller
ABSTRACT
Today's commercially available prosthetic limbs lack tactile sensation and feedback. Recent research in this domain focuses on sensor technologies designed to be directly embedded into future prostheses. We present a novel concept and prototype of a prosthetic-sensing wearable that offers a non-invasive, self-applicable and customizable approach for the sensory augmentation of present-day and future low to mid-range priced lower-limb prosthetics. From consultation with eight lower-limb amputees, we investigated the design space for prosthetic sensing wearables and developed novel interaction methods for dynamic, user-driven creation and mapping of sensing regions on the foot to wearable haptic feedback actuators. Based on a pilot-study with amputees, we assessed the utility of our design in scenarios brought up by the amputees and we summarize our findings to establish future directions for research into using smart textiles for the sensory enhancement of prosthetic limbs.
Supplemental Material
- Büscher, G.H., Kõiva, R., Schürmann, C., Haschke, R., and Ritter, H.J. Flexible and stretchable fabric-based tactile sensor. Robotics and Autonomous Systems 63, (2015), 244--252. Google Scholar
Digital Library
- Crea, S., Cipriani, C., Donati, M., Carrozza, M.C., and Vitiello, N. Providing time-discrete gait information by wearable feedback apparatus for lower-limb amputees: usability and functional validation. IEEE Transactions on Neural Systems and Rehabilitation Engineering 23, 2 (2015), 250--7. Google ScholarCross Ref
- Danilovic, A. SmartCast - Novel Textile Sensors for Embedded Pressure Sensing of Orthopedic Casts. 2013. http://escholarship.org/uc/item/3wg3p08j.Google Scholar
- Fan, R.E., Culjat, M.O., King, C.-H., et al. A haptic feedback system for lower-limb prostheses. IEEE Transactions on Neural Systems and Rehabilitation Engineering 16, 3 (2008), 270--277. Google ScholarCross Ref
- Geldard, F.A. and Sherrick, C.E. The Cutaneous "Rabbit": A Perceptual Illusion. Science 178, 4057 (1972), 178--179. Google ScholarCross Ref
- Hammock, M.L., Chortos, A., Tee, B.C.-K., Tok, J.B.-H., and Bao, Z. 25th Anniversary Article: The Evolution of Electronic Skin (E-Skin): A Brief History, Design Considerations, and Recent Progress. Advanced Materials 25, 42 (2013), 5997--6038. Google ScholarCross Ref
- Hofmann, M., Harris, J., Hudson, S., and Mankoff, J. Helping Hands: Requirements for a Prototyping Methodology for Upper-limb Prosthetics Users. Proceedings of the 34th Annual ACM Conference on Human Factors in Computing Systems - CHI '16, ACM (2016), 525--534. Google ScholarDigital Library
- Hurst, A. and Tobias, J. Empowering individuals with do-it-yourself assistive technology. The Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility - ASSETS '11, ACM Press (2011), 11. Google ScholarDigital Library
- Israr, A. and Poupyrev, I. Tactile brush. Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems - CHI '11, ACM Press (2011), 2019--2028. Google ScholarDigital Library
- Kaczmarek, K.A., Webster, J.G., Bach-y-Rita, P., and Tompkins, W.J. Electrotactile and vibrotactile displays for sensory substitution systems. IEEE Transactions on Biomedical Engineering 38, 1 (1991), 1--16. Google ScholarCross Ref
- Kaltenbrunner, M., Sekitani, T., Reeder, J., et al. An ultra-lightweight design for imperceptible plastic electronics. Nature 499, 7459 (2013), 458--63. Google ScholarCross Ref
- Lieberman, J. and Breazeal, C. TIKL: Development of a Wearable Vibrotactile Feedback Suit for Improved Human Motor Learning. IEEE Transactions on Robotics 23, 5 (2007), 919--926. Google ScholarDigital Library
- Oddo, C.M., Raspopovic, S., Artoni, F., et al. Intraneural stimulation elicits discrimination of textural features by artificial fingertip in intact and amputee humans. eLife 5, (2016), e09148. Google ScholarCross Ref
- Parzer, P., Probst, K., Babic, T., et al. FlexTiles: A Flexible, Stretchable, Formable, Pressure Sensitive, Tactile Input Sensor. Proceedings of the 34th Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '16, ACM (2016). Google ScholarDigital Library
- Perner-Wilson, H. rSkin - Open Source Robot Skin. http://www.instructables.com/id/rSkin-Open-SourceRobot-Skin/.Google Scholar
- Perrier, A., Vuillerme, N., Luboz, V., et al. Smart Diabetic Socks: Embedded device for diabetic foot prevention. Innovation and Research in BioMedical engineering 35, 2 (2014), 72--76.Google Scholar
- Raspopovic, S., Capogrosso, M., Petrini, F.M., et al. Restoring Natural Sensory Feedback in Real-Time Bidirectional Hand Prostheses. Science Translational Medicine 6, 222 (2014), 222ra19.Google Scholar
- Sabolich, J.A. and Ortega, G.M. Sense of Feel for Lower-Limb Amputees: A Phase-One Study. JPO Journal of Prosthetics and Orthotics 6, 2 (1994), 36--41. Google ScholarCross Ref
- Schönauer, C., Fukushi, K., Olwal, A., Kaufmann, H., and Raskar, R. Multimodal motion guidance. Proceedings of the 14th ACM International Conference on Multimodal Interaction, ACM Press (2012), 133. Google ScholarDigital Library
- Shull, P.B. and Damian, D.D. Haptic wearables as sensory replacement, sensory augmentation and trainer -- a review. Journal of NeuroEngineering and Rehabilitation 12, 1 (2015), 59.Google ScholarCross Ref
- Starr, M. Lego-compatible prosthetic arm lets kids build their own hand. http://www.cnet.com/news/lego-compatibleprosthetic-arm-lets-kids-build-their-own-hand/.Google Scholar
- Tan, D.W., Schiefer, M.A., Keith, M.W., Anderson, J.R., Tyler, J., and Tyler, D.J. A neural interface provides long-term stable natural touch perception. Science Translational Medicine 6, 257 (2014), 257ra138.Google ScholarCross Ref
- Tee, B.C.-K., Chortos, A., Berndt, A., et al. A skin-inspired organic digital mechanoreceptor. Science 350, 6258 (2015), 313--316. Google ScholarCross Ref
- Tiwana, M.I., Redmond, S.J., and Lovell, N.H. A review of tactile sensing technologies with applications in biomedical engineering. Sensors and Actuators A: Physical 179, (2012), 17--31. Google ScholarCross Ref
- Walsh, F. Artificial leg allows patient to feel. 2015. http://www.bbc.com/news/health-33052091.Google Scholar
- Weigel, M., Lu, T., Bailly, G., Oulasvirta, A., Majidi, C., and Steimle, J. iSkin. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15, ACM Press (2015), 2991--3000. Google ScholarDigital Library
- Weinstein, S. Intensive and extensive aspects of tactile sensitivity as a function of body part, sex and laterality. The First International Symposium on the Skin Senses, (1968).Google Scholar
- The Cost of a New Limb Can Add up Over a Lifetime. https://www.hss.edu/newsroom_prosthetic-leg-costover-lifetime.asp.Google Scholar
- Sensoria Fitness. http://www.sensoriafitness.com/.Google Scholar
- Products - Smart Sock. http://www.alphafit.de/en/products/smartsock.html.Google Scholar
- Product development Alphamat + Smart Sock. http://www.nova-nex.com/de/projekte/alphamatsmart-sock.Google Scholar
- Outcome Measures in Lower Limb Prosthetics | KLevels. http://www.oandp.org/olc/course_extended_content. asp'frmCourseId=ACA066EC-443A-4822--822C89BC1CBD684E&frmTermId=k-levels.Google Scholar
- Pressure sensor. 2010. https://www.google.com/patents/US7770473.Google Scholar
- Peripheral sensory and supersensory replacement system. 2012. http://www.google.com/patents/CA2813656A1'cl=en.Google Scholar
Index Terms
- proCover: Sensory Augmentation of Prosthetic Limbs Using Smart Textile Covers
Recommendations
Using wearable inertial sensors to detect different strategies for the sit-to-stand transition in multiple sclerosis
ECCE '21: Proceedings of the 32nd European Conference on Cognitive ErgonomicsINTRODUCTION: The sit-to-stand (Si-St) transition is an essential activity of daily living (ADL) which is fundamental to maintaining functional independence. It can often be compromised in patients with neurological disorders such as multiple sclerosis (...
Zishi: A Smart Garment for Posture Monitoring
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing SystemsZishi is a garment designed to support posture monitoring for the purposes of rehabilitation training. It has been designed with attention to presenting accurate and informative feedback to patients regarding their thoracic and shoulder posture as well ...
Ankle-foot passive motion prototype for stroke patients
i-CREATe '12: Proceedings of the 6th International Conference on Rehabilitation Engineering & Assistive TechnologyMany stroke patients become disabled and cannot return to work. Some of the reasons are from complications such as ankle joint stiffness and muscle contracture which is caused by immobilization. In order to prevent and reduce the possibility of ankle ...
Comments