Classification Strategies Using Certain and Possible Rules

  • Jerzy W. Grzymala-Busse
  • Xihong Zou
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1424)


A typical real-life data set is affected by inconsistencies—cases characterized by the same attribute values are classified as members of different concepts. The most apparent methodology to handle inconsistencies is offered by rough set theory. For every concept two sets are computed: the lower approximation and the upper approximation. From these two sets a rule induction system induces two rule sets: certain and possible.

The problem is how to use these two sets in the process of classification of new, unseen cases. For example, should we use only certain rules (or only possible rules) for classification? Should certain rules be used first and, when a case does not match any certain rule, should possible rules be used later? How to combine certain and possible rules with complete and partial matching of rules by a case? This paper presents experiments that were done to answer these questions. Different strategies were compared by classifying ten real-life data sets, using the error rate as a criterion of quality.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Booker, L. B., Goldberg, D. E., and Holland, J. F.: Classifier systems and genetic algorithms. In Machine Learning. Paradigms and Methods. Carbonell, J. G. (ed.), The MIT Press (1990) 235–282.Google Scholar
  2. 2.
    Grzymala-Busse, J. W.: Knowledge acquisition under uncertainty—A rough set approach. Journal of Intelligent & Robotic Systems 1 (1988) 3–16.CrossRefMathSciNetGoogle Scholar
  3. 3.
    Grzymala-Busse, J. W.: LERS—A system for learning from examples based on rough sets. In Intelligent Decision Support. Handbook of Applications and Advances of the Rough Sets Theory. Slowinski, R. (ed.), Kluwer Academic Publishers (1992) 3–18.Google Scholar
  4. 4.
    Grzymala-Busse, J. W.: Managing uncertainty in machine learning from examples. Proc. of the Third Intelligent Information Systems Workshop, Wigry, Poland, June 6–11, 1994, 70–84.Google Scholar
  5. 5.
    Grzymala-Busse, J. W. and Wang, C. P. B.: Classification and rule induction based on rough sets. Proc. of the 5th IEEE International Conference on Fuzzy Systems FUZZ-IEEE’96, New Orleans, Louisiana, September 8–11, 1996, 744–747.Google Scholar
  6. 6.
    Hamburg, M.: Statistical Analysis for Decision Making. Harcourt Brace Jovanovich Inc., 1983, Third Edition.Google Scholar
  7. 7.
    Holland, J. H., Holyoak K. J., and Nisbett, R. E.: Induction. Processes of Inference, Learning, and Discovery. The MIT Press, 1986.Google Scholar
  8. 8.
    Michalski, R. S., Mozetic, I., Hong, J. and Lavrac, N.: The AQ15 inductive learning system: An overview and experiments. Department of Computer Science, University of Illinois, Rep. UIUCDCD-R-86-1260, 1986.Google Scholar
  9. 9.
    Pawlak, Z.: Rough sets. International Journal Computer and Information Sciences 11 (1982) 341–356.CrossRefzbMATHMathSciNetGoogle Scholar
  10. 10.
    Pawlak, Z.: Rough Sets. Theoretical Aspects of Reasoning about Data. Kluwer Academic Publishers, 1991.Google Scholar
  11. 11.
    Slowinski, R. and Stefanowski, J.: ‘RoughDAS’ and ‘RoughClass’ software implementations of the rough set approach. In Intelligent Decision Support. Handbook of Applications and Advances of the Rough Sets Theory. Slowinski, R. (ed.), Kluwer Academic Publishers (1992) 445–456.Google Scholar
  12. 12.
    Stefanowski, J.: Classification and supporting based on rough set theory, Found. Computing Decision Sci. 18 (1993) 371–380.zbMATHMathSciNetGoogle Scholar
  13. 13.
    Weiss, S. M. & Kulikowski, C. A.: Computer Systems That Learn: Classification and Prediction Methods from Statistics, Neural Nets, Machine Learning, and Expert Systems. Morgan Kaufmann Publishers, 1991.Google Scholar
  14. 14.
    Ziarko, W. P.: Acquisition of control algorithms from operation data. In Intelligent Decision Support. Handbook of Applications and Advances of the Rough Sets Theory. Slowinski, R. (ed.), Kluwer Academic Publishers (1992) 61–75.Google Scholar
  15. 15.
    Ziarko, W.: Analysis of uncertain information in the framework of variable precision rough sets. Found. Computing Decision Sci. 18 (1993) 381–396.zbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1998

Authors and Affiliations

  • Jerzy W. Grzymala-Busse
    • 1
  • Xihong Zou
    • 1
  1. 1.Department of Electrical Engineering and Computer ScienceUniversity of KansasLawrenceUSA

Personalised recommendations