skip to main content
research-article

System-Level Observation Framework for Non-Intrusive Runtime Monitoring of Embedded Systems

Published: 24 June 2015 Publication History

Abstract

As the complexity of embedded systems rapidly increases, the use of traditional analysis and debug methods encounters significant challenges in monitoring, analyzing, and debugging the complex interactions of various software and hardware components. This situation is further exacerbated for in-situ debugging and verification in which traditional debug and trace interfaces that require physical access are unavailable, infeasible, or cost prohibitive. In this article, we present a system-level observation framework that provides minimally intrusive methods for dynamically monitoring and analyzing deeply integrated hardware and software components within embedded systems. The system-level observation framework monitors hardware and software events by inserting additional logic for detecting designer-specified events within hardware cores to observe complex interaction across hardware and software boundaries at runtime, and provides visibility for monitoring complex execution behavior of software applications without affecting the system execution.

References

[1]
M. Abramovici, P. Bradley, K. Dwarakanath, G. Memmi, and D. Miller. 2006. A reconfigurable design-for-debug infrastructure for SoCs. In Proceedings of the Design Automation Conference (DAC'06). 7--12.
[2]
ARM CORP. 2013. CoreSight architecture specification v2.0. http://infocenter.arm.com/help/topic/com.arm.doc.ihi0029d/IHI0029D_coresight_architecture_spec_v2_0.pdf.
[3]
ARM CORP. 2011. Embedded trace macrocell ETMv1.0 to ETMv3.5 architecture specification. http://infocenter.arm.com/help/topic/com.arm.doc.ihi0014q/IHI0014Q_etm_architecture_spec.pdf.
[4]
N. Audsley, A. Burns, M. Richardson, K. Tindell, and A. J. Wellings. 1993. Applying new scheduling theory to static priority pre-emptive scheduling. Softw. Engin. J. 8, 5, 284--292.
[5]
R. Backasch, C. Hochberger, A. Weiss, M. Leucker, and R. Lasslop. 2013. Runtime verification for multicore SoC with high-quality trace data. ACM Trans. Des. Autom. Electron. Syst. 18, 2, 1--26.
[6]
K. Camera, H. K.-H. So, and R. Brodersen. 2005. An integrated debugging environment for reprogrammable hardware systems. In Proceedings of the 6th International Symposium on Automated Analysis-Driven Debugging (AADEBUG'05). 111--116.
[7]
M. El Hobaki and L. Lindh. 2001. A hardware and software monitor for high-level system-on-chip verification. In Proceedings of the IEEE International Symposium on Quality Electronic Design (ISQED'01). 56--61.
[8]
C. Hochberger and A. Weiss. 2008. Acquiring an exhaustive, continuous and real-time trace from SOCs. In Proceedings of the IEEE International Conference on Computer Design (ICCD'08). 356--362.
[9]
H. F. Ko, A. B. Kinsman, and N. Nicolici. 2008. Distributed embedded logic analysis for post-silicon validation of SoCs. In Proceedings of the IEEE International Test Conference (ITC'08). 1--10.
[10]
H. F. Ko and N. Nicolici. 2008. On automated trigger event generation in post-silicon validation. In Proceedings of the Design Automation and Test in Europe Conference (DATE'08). 256--259.
[11]
H. F. Ko and N. Nicolici. 2009. Resource-efficient programmable trigger units for post-silicon validation. In Proceedings of the IEEE European Test Symposium (ETS'09). 17--22.
[12]
R. Leatherman and N. Stollon. 2005. Integrating on chip debug instrumentation and EDA verification tools. http://fs2.com/pdfs/DesignCon%20East%202005_FS2_ID1202_final.pdf.
[13]
R. Leatherman and N. Stollon. 2005. An embedded debugging architecture for SOCs. IEEE Potentials 24, 1, 12--16.
[14]
J. C. Lee and R. Lysecky. 2013. System observation of blocking, non-blocking, and cascading events for runtime monitoring of real-time systems. In Proceedings of the IEEE International Conference on Engineering of Computer-Based Systems (ECBS'13). 49--58.
[15]
J. C. Lee and R. Lysecky. 2014. Area-efficient event stream ordering for runtime observability of embedded systems. In Proceedings of the IEEE/ACM Design Automation Conference (DAC'14). 1--6.
[16]
C. L. Liu and J. W. Layland. 1973. Scheduling algorithms for multiprogramming in a hard-real-time environment. J. ACM 20, 1, 46--61.
[17]
X. Liu and Q. Xu. 2007. Interconnection fabric design for tracing signals in post-silicon validation. In Proceedings of the Design Automation Conference (DAC'07). 352--357.
[18]
K. Peterson and Y. Savaria. 2004. Assertion-based on-line verification and debug environment for complex hardware systems. In Proceedings of the International Symposium on Circuits and Systems (ISCAS'04). 685--688.
[19]
M. Shultz, B. White, S. Mckee, H.-H. Lee, and J. Jeitner. 2005. OWL: Next generation system monitoring. In Proceedings of the 2nd Conference on Computing Frontiers (CF'05). 116--124.
[20]
N. Sidwell, V. Prus, P. Alves, S. Loosemore, and J. Blandy. 2008. Non-stop multi-threaded debugging in GDB. In Proceedings of the GCC Developers' Summit. 117--128.
[21]
Snu real-time benchmark suite. 2010. http://www.cprover.org/goto-cc/examples/snu.html.
[22]
B. Vermeulen and S. K. Goel. 2002. Design for debug: Catching design errors in digital chips. IEEE Des. Test Comput. 19, 3, 37--45.
[23]
C. Watterson and D. Heffernan. 2007. Runtime verification and monitoring of embedded systems. IET Softw. 1, 5, 172--179.
[24]
Xilinx, Corp. 2009a. Fast simplex link (FSL) bus (v2.11b). http://www.xilinx.com/support/documentation/ip_documentation/fsl_v20.pdf.
[25]
Xilinx, Corp. 2009b. MicroBlaze processor reference guide. http://www.xilinx.com/support/documentation/sw_manuals/xilinx11/mb_ref_guide.pdf.
[26]
Xilinx, Corp. 2009c. OS and libraries document collection. http://www.xilinx.com/support/documentation/sw_manuals/edk10_oslib_rm.pdf.
[27]
S. Yang, H. Shim, W. Yang, and C.-M. Kyung. 2004. A new RTL debugging methodology in FPGA-based verification platform. In Proceedings of the Asia-Pacific Conference on Advanced System Integrated Circuits (APASIC'04). 180--183.

Cited By

View all
  • (2021)MONICA Vision: An Approach, a Model and the Interactive Tools for Cyber-Physical Systems DesignersProceedings of the 14th Biannual Conference of the Italian SIGCHI Chapter10.1145/3464385.3464778(1-5)Online publication date: 11-Jul-2021
  • (2021)A Composable Monitoring System for Heterogeneous Embedded PlatformsACM Transactions on Embedded Computing Systems10.1145/346164720:5(1-34)Online publication date: 9-Jul-2021
  • (2021)Resilient and Secure Hardware Devices Using ASLACM Journal on Emerging Technologies in Computing Systems10.1145/342998217:2(1-26)Online publication date: 6-Jan-2021
  • Show More Cited By

Index Terms

  1. System-Level Observation Framework for Non-Intrusive Runtime Monitoring of Embedded Systems

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Transactions on Design Automation of Electronic Systems
      ACM Transactions on Design Automation of Electronic Systems  Volume 20, Issue 3
      June 2015
      345 pages
      ISSN:1084-4309
      EISSN:1557-7309
      DOI:10.1145/2796316
      • Editor:
      • Naehyuck Chang
      Issue’s Table of Contents
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Journal Family

      Publication History

      Published: 24 June 2015
      Accepted: 01 February 2015
      Revised: 01 December 2014
      Received: 01 September 2014
      Published in TODAES Volume 20, Issue 3

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Observability
      2. online system monitoring
      3. testing
      4. validation
      5. verification

      Qualifiers

      • Research-article
      • Research
      • Refereed

      Funding Sources

      • National Science Foundation

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)8
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 02 Mar 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2021)MONICA Vision: An Approach, a Model and the Interactive Tools for Cyber-Physical Systems DesignersProceedings of the 14th Biannual Conference of the Italian SIGCHI Chapter10.1145/3464385.3464778(1-5)Online publication date: 11-Jul-2021
      • (2021)A Composable Monitoring System for Heterogeneous Embedded PlatformsACM Transactions on Embedded Computing Systems10.1145/346164720:5(1-34)Online publication date: 9-Jul-2021
      • (2021)Resilient and Secure Hardware Devices Using ASLACM Journal on Emerging Technologies in Computing Systems10.1145/342998217:2(1-26)Online publication date: 6-Jan-2021
      • (2020)Why Developers Refactor Source CodeACM Transactions on Software Engineering and Methodology10.1145/340830229:4(1-30)Online publication date: 26-Sep-2020
      • (2020)FOXACM Transactions on Social Computing10.1145/34049703:3(1-23)Online publication date: 3-Aug-2020
      • (2020)Mining User-generated Content of Mobile Patient PortalACM Transactions on Social Computing10.1145/33948313:3(1-24)Online publication date: 21-Jun-2020
      • (2020)Batch-file Operations to Optimize Massive Files AccessingACM Transactions on Storage10.1145/339428616:3(1-25)Online publication date: 16-Jul-2020
      • (2020)TourgetherProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/33698323:4(1-25)Online publication date: 14-Sep-2020
      • (2020)An ESL Methodology for HW/SW Co-Design of Monitorable Embedded Systems: the “Design for Monitorability” Project - Work-in-Progress2020 International Conference on Hardware/Software Codesign and System Synthesis (CODES+ISSS)10.1109/CODESISSS51650.2020.9244025(40-42)Online publication date: 20-Sep-2020
      • (2019)Reasoning about a Machine with Local CapabilitiesACM Transactions on Programming Languages and Systems10.1145/336351942:1(1-53)Online publication date: 10-Dec-2019
      • Show More Cited By

      View Options

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media