Assisted Medication Management in Elderly Care Using Miniaturised Near-Infrared Spectroscopy

Abstract

Near-infrared spectroscopy (NIRS) measures the light reflected from objects to infer highly detailed information about their molecular composition. Traditionally, NIRS has been an instrument reserved for laboratory usage, but recently affordable and smaller devices for NIRS have proliferated. Pairing this technology with the ubiquitous smartphone opens up a plethora of new use cases. In this paper, we explore one such use case, namely medication management in a nursing home/elderly care centre. First, we conducted a qualitative user study with nurses working in an elderly care centre to examine the protocols and workflows involved in administering medication, and the nurses' perceptions on using this technology. Based on our findings, we identify the main impact areas that would benefit from introducing miniaturised NIRS. Finally, we demonstrate via a user study in a realistic scenario that miniaturised NIRS can be effectively used for medication management when leveraging appropriate machine learning techniques. Specifically, we assess the performance of multiple pre-processing and classification algorithms for a selected set of pharmaceuticals. In addition, we compare our solution with currently used methods for pharmaceutical identification in a local care centre. We hope that our reflection on the multiple aspects associated with the introduction of this device in an elderly care setting can help both academics and practitioners working on related problems.

References

1. A.P. Popov, A.V. Bykov and I.V. Meglinski. 2017. Influence of local probe pressure on diffuse reflectance spectra of human skin measured in vivo. J. Biomed. Opt., 22.
2. Manel Alcalà, Marcelo Blanco, Daniel Moyano, Neville W Broad, Nada O'Brien, Don Friedrich, Frank Pfeifer and Heinz W Siesler. 2013. Qualitative and quantitative pharmaceutical analysis with a novel hand-held miniature near infrared spectrometer. Journal of Near Infrared Spectroscopy, 21 (6). 445--457.
3. Roman M Balabin and Sergey V Smirnov. 2011. Variable selection in near-infrared spectroscopy: benchmarking of feature selection methods on biodiesel data. Analytica chimica acta, 692 (1). 63--72.
4. RJ Barnes, Mewa Singh Dhanoa and Susan J Lister. 1989. Standard normal variate transformation and de-trending of near-infrared diffuse reflectance spectra. Applied spectroscopy, 43 (5). 772--777.
5. Regina M Benjamin. 2012. Medication adherence: helping patients take their medicines as directed. Public health reports, 127 (1). 2.
6. Craig F Bohren and Donald R Huffman. 2008. Absorption and scattering of light by small particles. John Wiley 8 Sons.
7. Donald A Burns and Emil W Ciurczak. 2007. Handbook of near-infrared analysis. CRC press.
8. A Candolfi, R De Maesschalck, DL Massart, PA Hailey and ACE Harrington. 1999. Identification of pharmaceutical excipients using NIR spectroscopy and SIMCA. Journal of pharmaceutical and biomedical analysis, 19 (6). 923--935.
9. Wen-Wei Chang, Tung-Jung Sung, Heng-Wei Huang, Wei-Chih Hsu, Chi-Wei Kuo, Jhe-Jhao Chang, Yi-Ting Hou, Yi-Chung Lan, Wen-Cheng Kuo and Yu-Yen Lin. 2011. A smart medication system using wireless sensor network technologies. Sensors and Actuators A: Physical, 172 (1). 315--321.
10. António Cunha, Telmo Adão and Paula Trigueiros. 2014. Helpmepills: A mobile pill recognition tool for elderly persons. Procedia Technology, 16. 1523--1532.
11. Jim Dabrowski and Ethan V Munson. 2011. 40 years of searching for the best computer system response time. Interacting with Computers, 23 (5). 555--564.
12. Theresa Dankowski and Andreas Ziegler. 2016. Calibrating random forests for probability estimation. Statistics in medicine, 35 (22). 3949--3960.
13. Klara Dégardin, Aurélie Guillemain, Nicole Viegas Guerreiro and Yves Roggo. 2016. Near infrared spectroscopy for counterfeit detection using a large database of pharmaceutical tablets. Journal of pharmaceutical and biomedical analysis, 128. 89--97.
14. M Dyrby, S Balling Engelsen, L Nørgaard, M Bruhn and L Lundsberg-Nielsen. 2002. Chemometric quantitation of the active substance (containing C ≡ N) in a pharmaceutical tablet using near-infrared (NIR) transmittance and NIR FT-Raman spectra. Applied Spectroscopy, 56 (5). 579--585.
15. Frontier Economics. 2014. Exploring the costs of unsafe care in the NHS: a report prepared for the Department of Health. London, Frontier Economics.
16. Juergen Gall, Angela Yao, Nima Razavi, Luc Van Gool and Victor Lempitsky. 2011. Hough forests for object detection, tracking, and action recognition. IEEE transactions on pattern analysis and machine intelligence, 33 (11). 2188--2202.
17. Robert Geirhos, David HJ Janssen, Heiko H Schütt, Jonas Rauber, Matthias Bethge and Felix A Wichmann. 2017. Comparing deep neural networks against humans: object recognition when the signal gets weaker. arXiv preprint arXiv:1706.06969.
18. Ma Inmaculada González-Martín, Guillermo Wells Moncada, Claudio González-Pérez, Nelson Zapata San Martín, Fernando López-González, Iris Lobos Ortega and Jose-Miguel Hernández-Hierro. 2014. Chilean flour and wheat grain: tracing their origin using near infrared spectroscopy and chemometrics. Food chemistry, 145. 802--806.
19. Andreas Hartl, Clemens Arth and Dieter Schmalstieg. 2011. Instant medical pill recognition on mobile phones. In proc. of IASTED International Conference on Computer Vision, 188--195.
20. Nicole Hartnell, Neil MacKinnon, Ingrid Sketris and Mark Fleming. 2012. Identifying, understanding and overcoming barriers to medication error reporting in hospitals: a focus group study. BMJ Qual Saf, 21 (5). 361--368.
21. M Hayakawa, Y Uchimura, K Omae, K Waki, H Fujita and K Ohe. 2013. A smartphone-based medication self-management system with realtime medication monitoring. Applied clinical informatics, 4 (1). 37--52.
22. GM Hieftje. 1972. Signal-to-noise enhancement through instrumental techniques. Analytical Chemistry, 44 (6). 81A--88A.
23. Simo Hosio, Jorge Goncalves, Niels van Berkel and Simon Klakegg. 2016. Crowdsourcing Situated 8 Subjective Knowledge for Decision Support. In International Joint Conference on Pervasive and Ubiquitous Computing Adjunct, ACM, 1478--1483.
24. Hanna-Leena Huttunen, Simon Klakegg, Nils Van Berkel, Aku Visuri, Denzil Ferreira and Raija Halonen. 2017. Understanding elderly care: a field-study for designing future homes. In Proceedings of the 19th International Conference on Information Integration and Web-based Applications 8 Services, ACM, 390--394.
25. Texas Instrument, DLP® NIRscan™ Nano EVM User's Guide. Accessed from http://www.ti.com/tool/DLPNIRNANOEVM
26. Marzena Jamrógiewicz. 2012. Application of the near-infrared spectroscopy in the pharmaceutical technology. Journal of pharmaceutical and biomedical analysis, 66. 1--10.
27. Liangxiao Jiang, Chaoqun Li, Shasha Wang and Lungan Zhang. 2016. Deep feature weighting for naive Bayes and its application to text classification. Engineering Applications of Artificial Intelligence, 52. 26--39.
28. Matti T Kinnunen, Alexey P Popov, Jerzy Plucinski, Risto A Myllyla and Alexander V Priezzhev. 2004. Measurements of glucose content in scattering media with time-of-flight technique: comparison with Monte Carlo simulations. In Saratov Fall Meeting 2003: Optical Technologies in Biophysics and Medicine V, International Society for Optics and Photonics, 181--192.
29. S. Klakegg, J. Goncalves, N. van Berkel, C. Luo, S. Hosio and V. Kostakos. 2017. Towards Commoditised Near Infrared Spectroscopy. In Conference on Designing Interactive Systems.
30. S. Klakegg, N. van Berkel, A. Visuri, C. Luo, J. Goncalves, S. Hosio, H. Huttunen and D. Ferreira. 2017. Informing Caregivers Through an Assistive Tool: An Investigation of Elderly Care Metrics. In British HCI, Sunderland, UK.
31. Simon Klakegg, Niels van Berkel, Aku Visuri, Hanna-Leena Huttunen, Simo Hosio, Chu Luo, Jorge Goncalves and Denzil Ferreira. 2017. Designing a context-aware assistive infrastructure for elderly care. In Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers, Maui, Hawaii, ACM, 563--568.
32. Simon Klakegg, Chu Luo, Jorge Goncalves, Simo Hosio and Vassilis Kostakos. 2016. Instrumenting smartphones with portable NIRS. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct, ACM, 618--623.
33. V Korhonen, T Myllylä, M Yu Kirillin, AP Popov, AV Bykov, AV Gorshkov, EA Sergeeva, M Kinnunen and V Kiviniemi. 2014. Studies of light propagation in optical sensing of the cerebral cortex of the human brain. IEEE Journal of Selected Topics in Quantum Electronics, 20 (2). 7100310.
34. V. Kostakos, D. Ferreira, J. Goncalves and S. Hosio. 2016. Modelling Smartphone Usage: A Markov State Transition Model. In International Joint Conference on Pervasive and Ubiquitous Computing, 486--497.
35. Jiangbo Li, Wenqian Huang, Xi Tian, Chaopeng Wang, Shuxiang Fan and Chunjiang Zhao. 2016. Fast detection and visualization of early decay in citrus using Vis-NIR hyperspectral imaging. Computers and Electronics in Agriculture, 127. 582--592.
36. Chu Luo, Angelos Fylakis, Juha Partala, Simon Klakegg, Jorge Goncalves, Kaitai Liang, Tapio Seppänen and Vassilis Kostakos. 2016. A data hiding approach for sensitive smartphone data. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, ACM, 557--568.
37. Chu Luo, Miikka Kuutila, Simon Klakegg, Denzil Ferreira, Huber Flores, Jorge Goncalves, Mika Mäntylä and Vassilis Kostakos. 2017. TestAWARE: A Laboratory-Oriented Testing Tool for Mobile Context-Aware Applications. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 1 (3). 80.
38. Marena Manley. 2014. Near-infrared spectroscopy and hyperspectral imaging: non-destructive analysis of biological materials. Chemical Society Reviews, 43 (24). 8200--8214.
39. Harald Martens and Edward Stark. 1991. Extended multiplicative signal correction and spectral interference subtraction: new preprocessing methods for near infrared spectroscopy. Journal of pharmaceutical and biomedical analysis, 9 (8). 625--635.
40. Medisafe, Research. Accessed from https://medisafe.com/research/
41. Eija Metsälä and Ulla Vaherkoski. 2014. Medication errors in elderly acute care--a systematic review. Scandinavian journal of caring sciences, 28 (1). 12--28.
42. MicroNIR, MicroNIR. Accessed from https://www.viavisolutions.com/en-us/osp/products/micronir-spectrometers
43. Jørgen Alexander Mølmann, Olavi Junttila, Øystein Johnsen and Jorunn Elisabeth Olsen. 2006. Effects of red, far-red and blue light in maintaining growth in latitudinal populations of Norway spruce (Picea abies). Plant, cell 8 environment, 29 (2). 166--172.
44. Gaurvika ML Nayyar, Joel G Breman, Paul N Newton and James Herrington. 2012. Poor-quality antimalarial drugs in southeast Asia and sub-Saharan Africa. The Lancet infectious diseases, 12 (6). 488--496.
45. NIRScan, DLP® NIRscan™ Nano Evaluation Module. Accessed from http://www.ti.com/tool/DLPNIRNANOEVM
46. Alan V Oppenheim. 1999. Discrete-time signal processing. Pearson Education India.
47. Celio Pasquini. 2003. Near infrared spectroscopy: fundamentals, practical aspects and analytical applications. Journal of the Brazilian Chemical Society, 14 (2). 198--219.
48. María Martínez Pérez, Mariano Cabrero-Canosa, José Vizoso Hermida, Lino Carrajo García, Daniel Llamas Gómez, Guillermo Vázquez González and Isabel Martín Herranz. 2012. Application of RFID technology in patient tracking and medication traceability in emergency care. Journal of medical systems, 36 (6). 3983--3993.
49. Alexey P Popov, Alexander V Bykov, Sami Toppari, Matti Kinnunen, Alexander V Priezzhev and Risto Myllylä. 2012. Glucose sensing in flowing blood and intralipid by laser pulse time-of-flight and optical coherence tomography techniques. IEEE Journal of Selected Topics in Quantum Electronics, 18 (4). 1335--1342.
50. Åsmund Rinnan, Frans van den Berg and Søren Balling Engelsen. 2009. Review of the most common pre-processing techniques for near-infrared spectra. TrAC Trends in Analytical Chemistry, 28 (10). 1201--1222.
51. Cyril Ruckebusch, F Orhan, A Durand, T Boubellouta and JP Huvenne. 2006. Quantitative analysis of Cotton--Polyester textile blends from near-infrared spectra. Applied spectroscopy, 60 (5). 539--544.
52. Claude Sammut and Geoffrey I Webb. 2011. Encyclopedia of machine learning. Springer Science 8 Business Media.
53. Z. Sarsenbayeva, J. Goncalves, J. García, S. Klakegg, S. Rissanen, H. Rintamäki, J. Hannu and V. Kostakos. 2016. Situational Impairments to Mobile Interaction in Cold Environments. In International Joint Conference on Pervasive and Ubiquitous Computing, 85--96.
54. Abraham Savitzky and Marcel JE Golay. 1964. Smoothing and differentiation of data by simplified least squares procedures. Analytical chemistry, 36 (8). 1627--1639.
55. SCiO, SCiO. Accessed from https://www.consumerphysics.com/
56. Heinz W Siesler, Yukihiro Ozaki, Satoshi Kawata and H Michael Heise. 2008. Near-infrared spectroscopy: principles, instruments, applications. John Wiley 8 Sons.
57. Michael C Sokol, Kimberly A McGuigan, Robert R Verbrugge and Robert S Epstein. 2005. Impact of medication adherence on hospitalization risk and healthcare cost. Medical care, 43 (6). 521--530.
58. Milan Sonka, Vaclav Hlavac and Roger Boyle. 2014. Image processing, analysis, and machine vision. Cengage Learning.
59. Lan Sun, Chang Hsiung, Christopher G Pederson, Peng Zou, Valton Smith, Marc von Gunten and Nada A O'Brien. 2016. Pharmaceutical raw material identification using miniature near-infrared (MicroNIR) spectroscopy and supervised pattern recognition using support vector machine. Applied spectroscopy, 70 (5). 816--825.
60. Tellspec, Tellspec. Accessed from http://tellspec.com/
61. Paul Trueman, DG Taylor, K Lowson, A Bligh, A Meszaros, D Wright, J Glanville, Jennifer Newbould, Mike Bury and Nick Barber. 2010. Evaluation of the scale, causes and costs of waste medicines. Report of DH funded national project.
62. Joe Wolf, Paul Michael Carter, Simon Geoffrey Parker, Robert Fearn and Niki Frampton. 2006. Multirate cochlear stimulation strategy and apparatus, Google Patents.
63. Sara Woods. 2014. Drug Consumption Rooms in Europe. Organisational overview. Regenboog Group, Amsterdam.
64. Maciej S Wróbel, Alexey P Popov, Alexander V Bykov, Matti Kinnunen, Malgorzata JÄ and Valery V Tuchin. 2015. Measurements of fundamental properties of homogeneous tissue phantoms. Journal of biomedical optics, 20 (4). 045004--045004.
65. Long Wu, Jhao-Yin Li and Chu-Ying Fu. 2011. The adoption of mobile healthcare by hospital's professionals: An integrative perspective. Decision Support Systems, 51 (3). 587--596.
66. Danfei Xu, Gerald E Loeb and Jeremy A Fishel. 2013. Tactile identification of objects using Bayesian exploration. In Robotics and Automation (ICRA), 2013 IEEE International Conference on, IEEE, 3056--3061.
67. Jimmy Zumba, James Rodgers and Matthew Indest. 2017. Impact of temperature and relative humidity on the near infrared spectroscopy measurements of cotton fiber micronaire. Textile Research Journal. 0040517517720499.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Empirical studies in HCI

  • Ubiquitous and mobile computing