An approach to spacecraft anomaly detection problem using kernel feature space

ABSTRACT

Development of advanced anomaly detection and failure diagnosis technologies for spacecraft is a quite significant issue in the space industry, because the space environment is harsh, distant and uncertain. While several modern approaches based on qualitative reasoning, expert systems, and probabilistic reasoning have been developed recently for this purpose, any of them has a common difficulty in obtaining accurate and complete a priori knowledge on the space systems from human experts. A reasonable alternative to this conventional anomaly detection method is to reuse a vast amount of telemetry data which is multi-dimensional time-series continuously produced from a number of system components in the spacecraft.This paper proposes a novel "knowledge-free" anomaly detection method for spacecraft based on Kernel Feature Space and directional distribution, which constructs a system behavior model from the past normal telemetry data from a set of telemetry data in normal operation and monitors the current system status by checking incoming data with the model.In this method, we regard anomaly phenomena as unexpected changes of causal associations in the spacecraft system, and hypothesize that the significant causal associations inside the system will appear in the form of principal component directions in a high-dimensional non-linear feature space which is constructed by a kernel function and a set of data.We have confirmed the effectiveness of the proposed anomaly detection method by applying it to the telemetry data obtained from a simulator of an orbital transfer vehicle designed to make a rendezvous maneuver with the International Space Station.

REFERENCES

• 1: Arindam Banerjee , Inderjit Dhillon , Joydeep Ghosh , Suvrit Sra, Generative model-based clustering of directional data, Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining, August 24-27, 2003, Washington, D.C. [doi>10.1145/956750.956757]
• 2: B. Schölkopf, Support Vector Learning, R. Oldenbourg Verlag, München, 1997, Doktorarbeit, Technische Universität Berlin.
• 3: Bernhard Schölkopf and Alexander J. Smola, Learning with Kernel, The MIT Press, 2002.
• 4: Bernhard Schölkopf , Alexander Smola , Klaus-Robert Müller, Nonlinear component analysis as a kernel eigenvalue problem, Neural Computation, v.10 n.5, p.1299-1319, July 1, 1998 [doi>10.1162/089976698300017467 ]
• 5: de Kleer Johann and Brian C. Williams, Diagnosing with behavioral modes, In: Proceedings of the 11th IJCAI, pp. 1324--1330. 1989.
• 6: D. DeCoste: Automated Learning and Monitoring of Limit Functions, In Proceedings of International Symposium on Artificial Intelligence and Robotics and Automation in Space, 1997.
• 7: Dennis DeCoste and Marie Levine. Automated Event Detection in Space Instruments: A Case Study Using IPEX-2 Data and Support Vector Machines. SPIE Conference Astronomical Telescopes and Instrumentation, March 2000.
• 8: Eamonn J. Keogh , Selina Chu , David Hart , Michael J. Pazzani, An Online Algorithm for Segmenting Time Series, Proceedings of the 2001 IEEE International Conference on Data Mining, p.289-296, November 29-December 02, 2001
• 9: F. Hutter and R. Dearden, The Gaussian Particle Filter for Diagnosis of non-linear Systems, Proceedings of the 5th IFAC. Symposium on Fault Detection, Supervision and Safety of Technical Processes, 2003.
• 10: I.S. Dhillon and S. Sra, Modeling data using directional distributions, Technical Report TR-06-03, University of Texas, Dept. of Computer Sciences, February 2003.
• 11: J. Durkin, D. Tallo and E. Petrik, FIDEX: An Expert System for Satellite Diagnostics, Space Communications Technology Conference, Onboard Processing and Switching, NASA Lewis Research Center, Cleveland, OH, Nov. 12-14, 1991.
• 12: J. Horvitz, M. Barry: Display of information for Time Critical Decision Making, In Proceedings of 11th Conference on Uncertainty in Artificial Intelligence, 1995.
• 13: Michael E. Tipping. Sparse Kernel Principal Component Analysis. In Advances in Neural Information Processing Systems (NIPS) 13, Vancouver, Dec. 2001.
• 14: Minoru Nakatsugawa, Takehisa Yairi, Naoki Ishihama, Koichi Hori and Shinichi Nakasuka "Supporting Anomaly Detection from Satellite Telemetry Data by Regression Trees" The 24th International Symposium on Space Technology and Science (ISTS), 2004.
• 15: Richard Doyle, Steve Chien, U. Fayyad and E. J. Wyatt, "Focused Real-Time Systems Monitoring Based on Multiple Anomaly Models," unpublished manuscript, Artificial Intelligence Group, Jet Propulsion Laboratory, 1992.
• 16: Ryohei Fujimaki, Takehisa Yairi, Kazuo Machida, An Anomaly Detection Method for Spacecraft using Relevance Vector Learning, The Ninth Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD), 2005, pp.785--790. (Springer, LNAI3518).
• 17: S.H. Chung, J.M. Van Eepoel, B.C. Williams: Improving Model-based Mode Estimation through Offline Compilation, In Proceedings of the 6th International Symposium on Artificial Intelligence and Robotics and Automation in Space, 2001.
• 18: Takehisa Yairi, Shiro Ogasawara, Koichi Hori, Shinichi Nakasuka, and Naoki Ishihama "Summarization of Spacecraft Telemetry Data By Extracting Significant Temporal Patterns" The Eighth Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD2004), pp.240--244, 2004.
• 19: Takehisa Yairi, Yoshikiyo Kato and Koichi Hori, "Fault Detection by Mining Association Rules from House-keeping Data", Proc. of International Symposium on Artificial Intelligence, Robotics and Automation in Space (i-SAIRAS 2001), 2001.
• 20: Tsuyoshi IDÉ , Hisashi KASHIMA, Eigenspace-based anomaly detection in computer systems, Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, August 22-25, 2004, Seattle, WA, USA [doi>10.1145/1014052.1014102]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
      I.2.6 Learning

Additional Classification:
  H. Information Systems
  H.2 DATABASE MANAGEMENT
      H.2.8 Database applications
          Subjects: Data mining

General Terms:
Algorithms

Keywords:
anomaly detection, kernel feature space, principal component analysis, spacecraft, time series data, von Mises Fisher distribution