PaintingClass: interactive construction, visualization and exploration of decision trees

ABSTRACT

Decision trees are commonly used for classification. We propose to use decision trees not just for classification but also for the wider purpose of knowledge discovery, because visualizing the decision tree can reveal much valuable information in the data. We introduce PaintingClass, a system for interactive construction, visualization and exploration of decision trees. PaintingClass provides an intuitive layout and convenient navigation of the decision tree. PaintingClass also provides the user the means to interactively construct the decision tree. Each node in the decision tree is displayed as a visual projection of the data. Through actual examples and comparison with other classification methods, we show that the user can effectively use PaintingClass to construct a decision tree and explore the decision tree to gain additional knowledge.

References

1. R. Agrawal, S. Ghosh, T. Imielinski, B. Iyer, and A. Swami. An Interval Classifier for Database Mining Applications. Proc. 18th Intl. Conf. on Very Large Databases (VLDB '92), pp. 560--573, Vancouver, B. C., Canada, August 1992.
2. M. Ankerst, C. Elsen, M. Ester, and H.-P. Kriegel. Visual classification: An interactive approach to decision tree construction. Proc. 5th Intl. Conf. on Knowledge Discovery and Data Mining (KDD '99), pp. 392--396, 1999.
3. M. Ankerst, M. Ester, and H.-P. Kriegel. Towards an effective cooperation of the user and the computer for classification. Proc. 6th Intl. Conf. on Knowledge Discovery and Data Mining (KDD '00), 2000.
4. K. Alsabti, S. Ranka, and V. Singh. CLOUDS: A Decision Tree Classifier for Large Datasets. Proc. 4th Intl. Conf. on Knowledge Discovery and Data Mining (KDD '98), New York, 1998, pp. 2--8.
5. W.-H. Au and K. C. C. Chan. Classification with Degree of Membership: A Fuzzy Approach. Proc. 2nd IEEE Intl. Conf. on Data Mining (ICDM '02), 2002.
6. T. Barlow and P. Neville. Case Study: Visualization for Decision Tree Analysis in Data Mining. Proc. IEEE Symposium on Information Visualization, 2001.
7. A. Buja and Y-S. Lee. Data Mining Criteria for Tree-Based Regression and Classification. Proc. 7th Intl. Conf. on Knowledge Discovery and Data Mining (KDD '01), 2001.
8. U. Fayyad, G. Piatetsky-Shapiro, and P. Smyth. The KDD Process for Extracting Useful Knowledge from Volumes of Data Communications of the ACM 39, 11, 1996.
9. A. Inselberg. The Plane with Parallel Coordinates. Special Issue on Computational Geometry: The Visual Computer, vol. 1, pp. 69--91, 1985.
10. C. Z. Janikow. Fuzzy Decision Trees: Issues and Methods. IEEE Trans. on Systems, Man, and Cybernetics - Part B: Cybernetics, vol. 28, no. 1, pp. 1--14, 1998.
11. E. Kandogan. Visualizing Multi-Dimensional Clusters, Trends, and Outliers using Star Coordinates. Proc. ACM SIGKDD '01, PP. 107--116, 2001.
12. R. Kohavi. Scaling Up the Accuracy of Naive-Bayes Classifiers: A Decision Tree Hybrid. Proc. 2nd Intl. Conf. on Knowledge Discovery and Data Mining (KDD '96), Portland, Oregon, 1998.
13. B. Liu, W. Hsu, and Y. Man. Integrating Classification and Association Rule Mining. Proc. 4th Intl. Conf. on Knowledge Discovery and Data Mining (KDD '98), New York, 1998.
14. M. Mehta, R. Agrawal, and J. Rissanen. SLIQ: A Fast Scalable Classifier for Data Mining Proc. Intl. Conf. on Extending Database Technology (EDBT '96), Avignon, France, 1996.
15. D. Michie, D. J. Spiegelhalter, and C. C. Taylor. Machine Learning, Neural and Statistical Classification. Ellis Horwood, 1994.
16. NASA Ames Research Center. Introduction to IND Version 2.1, 1992.
17. R. Parekh, J. Yang, and V. Honavar. Constructive Neural-Network Learning Algorithms for Pattern Classification. IEEE Trans. on Neural Networks, vol. 11, no.2, 2000.
18. J. R. Quinlan. C4.5: Programs for Machine Learning. Morgan Kaufman, 1993.
19. J. W. Smith, J. E. Everhart, W. C. Dickson, W. C. Knowler, and R. S. Johannes. Using the ADAP Learning Algorithm to Forcast the Onset of Diabetes Mellitus. Proc. Symp. on Computer Applications and Medical Cares, pp. 422--425, 1983.
20. S. T. Teoh and K. L. Ma. StarClass: Interactive Visual Classification Using Star Coordinates. Proc. 3rd SIAM Intl. Conf. on Data Mining (SDM '03), 2003.
21. Z-H. Zhou, Y. Jiang, and S. F. Chen. A General Neural Framework for Classification Rule Mining. Intl. Journal of Computers, Systems, and Signals, vol. 1, no. 2, pp. 154--168, 2000.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Philosophical/theoretical foundations of artificial intelligence

      • Cognitive science

  • Computer graphics

• Human-centered computing

  • Human computer interaction (HCI)

• Information systems

  • Information systems applications

    • Data mining