research-article

Discriminating self from non-self with finite mixtures of multivariate Bernoulli distributions

Author:

Thomas StiborAuthors Info & Claims

GECCO '08: Proceedings of the 10th annual conference on Genetic and evolutionary computation

Pages 127 - 134

https://doi.org/10.1145/1389095.1389113

Published: 12 July 2008 Publication History

Abstract

Affinity functions are the core components in negative selection to discriminate self from non-self. It has been shown that affinity functions such as the r-contiguous distance and the Hamming distance are limited applicable for discrimination problems such as anomaly detection. We propose to model self as a discrete probability distribution specified by finite mixtures of multivariate Bernoulli distributions. As by-product one also obtains information of non-self and hence is able to discriminate with probabilities self from non-self. We underpin our proposal with a comparative study between the two affinity functions and the probabilistic discrimination.

References

[1]

H. Akaike. A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19(6):716--723, 1974.

[2]

C. M. Bishop. Pattern Recognition and Machine Learning. Springer-Verlag, 2006.

Digital Library

[3]

O. Cappé and E. Moulines. Online EM algorithm for latent data models. Preprint available at http://arxiv.org/abs/0712.4273v1, 2007.

[4]

M. A. Carreira-Perpinán and S. Renals. Practical identifiability of finite mixtures of multivariate bernoulli distributions. Neural Computation, 12(1):141--152, 2000.

Digital Library

[5]

L. N. de Castro and J. Timmis. Artificial Immune Systems: A New Computational Intelligence Approach. Springer Verlag, 2002.

Digital Library

[6]

A. Dempster, N. Laird, and D. Rubin. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, 39(1):1--38, 1977.

[7]

P. D’haeseleer, S. Forrest, and P. Helman. An immunological approach to change detection: algorithms, analysis, and implications. In Proceedings of the Symposium on Research in Security and Privacy, pages 110--119. IEEE Computer Society Press, May 1996.

Digital Library

[8]

W. Dilger. Structural properties of shape-spaces. In Proceedings of the 5th International Conference on Artificial Immune Systems (ICARIS), volume 4163 of Lecture Notes in Computer Science, pages 178--192. Springer--Verlag, 2006.

Digital Library

[9]

B. S. Everitt and D. J. Hand. Finite Mixture Distributions. Chapman and Hall, 1981.

[10]

S. Forrest, A. S. Perelson, L. Allen, and R. Cherukuri. Self-nonself discrimination in a computer. In Proceedings of the Symposium on Research in Security and Privacy, pages 202--212. IEEE Computer Society Press, 1994.

Digital Library

[11]

F. González, D. Dasgupta, and J. Gómez. The effect of binary matching rules in negative selection. In Genetic and Evolutionary Computation (GECCO), volume 2723 of Lecture Notes in Computer Science, pages 195---206, Chicago, 12--16 July 2003. Springer-Verlag.

Digital Library

[12]

M. Gyllenberg, T. Koski, E. Reilink, and M. Verlann. Non-uniqueness in probabilistic numerical identification of bacteria. Journal of Applied Probability, 31(2):542--548, 1994.

[13]

I. Steinwart, D. Hush, and C. Scovel. A classification framework for anomaly detection. Journal of Machine Learning Research, 6:211--232, 2005.

Digital Library

[14]

T. Stibor. Phase transition and the computational complexity of generating r-contiguous detectors. In Proceedings of 6th International Conference on Artificial Immune Systems (ICARIS), Lecture Notes in Computer Science, pages 142--155. Springer-Verlag, 2007.

Digital Library

[15]

T. Stibor, J. Timmis, and C. Eckert. Generalization regions in hamming negative selection. In Intelligent Information Processing and Web Mining, Advances in Soft Computing, pages 447--456. Springer-Verlag, 2006.

[16]

T. Stibor, J. Timmis, and C. Eckert. The link between r-contiguous detectors and k-CNF satisfiability. In Proceedings of Congress On Evolutionary Computation (CEC), pages 491--498. IEEE Press, 2006.

[17]

T. Stibor, J. Timmis, and C. Eckert. On permutation masks in hamming negative selection. In Proceedings of 5th International Conference on Artificial Immune Systems (ICARIS), Lecture Notes in Computer Science, pages 122--135. Springer-Verlag, 2006.

Digital Library

[18]

J. H. Wolfe. Pattern clustering by multivariate mixture analysis. Multivariate Behavior Research, 5:329--359, 1970.

Cited By

Pöllä M(2009)A generative model for self/non-self discrimination in stringsProceedings of the 9th international conference on Adaptive and natural computing algorithms10.5555/1813739.1813772(293-302)Online publication date: 23-Apr-2009
https://dl.acm.org/doi/10.5555/1813739.1813772
Pöllä M(2009)A Generative Model for Self/Non-self Discrimination in StringsProceedings of the 2009 conference on Adaptive and Natural Computing Algorithms - Volume 549510.1007/978-3-642-04921-7_30(293-302)Online publication date: 23-Apr-2009
https://dl.acm.org/doi/10.1007/978-3-642-04921-7_30

Index Terms

Discriminating self from non-self with finite mixtures of multivariate Bernoulli distributions
1. Computing methodologies
  1. Modeling and simulation
    1. Model development and analysis
      1. Model verification and validation
2. Mathematics of computing
  1. Probability and statistics
    1. Multivariate statistics
    2. Statistical paradigms
      1. Exploratory data analysis

Recommendations

Scale and shape mixtures of multivariate skew-normal distributions
Abstract
We introduce a broad and flexible class of multivariate distributions obtained by both scale and shape mixtures of multivariate skew-normal distributions. We present the probabilistic properties of this family of distributions in ...
Practical Identifiability of Finite Mixtures of Multivariate Bernoulli Distributions

The class of finite mixtures of multivariate Bernoulli distributions is known to be nonidentifiable; that is, different values of the mixture parameters can correspond to exactly the same probability distribution. In principle, this would mean that ...
EM-estimation and modeling of heavy-tailed processes with the multivariate normal inverse Gaussian distribution

The heavy-tailed multivariate normal inverse Gaussian (MNIG) distribution is a recent variance-mean mixture of a multivariate Gaussian with a univariate inverse Gaussian distribution. Due to the complexity of the likelihood function, parameter ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

GECCO '08: Proceedings of the 10th annual conference on Genetic and evolutionary computation

July 2008

1814 pages

ISBN:9781605581309

DOI:10.1145/1389095

Conference Chair:
Conor Ryan
University of Limerick, Ireland
,
Editor:
Maarten Keijzer
Chordiant Software International B.V., The Netherlands

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 July 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

GECCO08

Sponsor:

GECCO08: Genetic and Evolutionary Computation Conference

July 12 - 16, 2008

GA, Atlanta, USA

Acceptance Rates

Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
140
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Pöllä M(2009)A generative model for self/non-self discrimination in stringsProceedings of the 9th international conference on Adaptive and natural computing algorithms10.5555/1813739.1813772(293-302)Online publication date: 23-Apr-2009
https://dl.acm.org/doi/10.5555/1813739.1813772
Pöllä M(2009)A Generative Model for Self/Non-self Discrimination in StringsProceedings of the 2009 conference on Adaptive and Natural Computing Algorithms - Volume 549510.1007/978-3-642-04921-7_30(293-302)Online publication date: 23-Apr-2009
https://dl.acm.org/doi/10.1007/978-3-642-04921-7_30

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten