Bias Management of Bayesian Network Classifiers
- 556 Downloads
The purpose of this paper is to describe an adaptive algorithm for improving the performance of Bayesian Network Classifiers (BNCs) in an on-line learning framework. Instead of choosing a priori a particular model class of BNCs, our adaptive algorithm scales up the model’s complexity by gradually increasing the number of allowable dependencies among features. Starting with the simple Naïve Bayes structure, it uses simple decision rules based on qualitative information about the performance’s dynamics to decide when it makes sense to do the next move in the spectrum of feature dependencies and to start searching for a more complex classifier. Results in conducted experiments using the class of Dependence Bayesian Classifiers on three large datasets show that our algorithm is able to select a model with the appropriate complexity for the current amount of training data, thus balancing the computational cost of updating a model with the benefits of increasing in accuracy.
KeywordsBias Management Bayesian Classifiers Machine Learning
Unable to display preview. Download preview PDF.
- 1.Bouckaert, R.: Bayesian Network Classifiers in Weka (2004), Technical Report 14/2004. Computer Science Department. University of Waikato (2004)Google Scholar
- 3.Buntine, W.: Theory Refinement on Bayesian Networks. In: Proceedings of the 7th Conference on Uncertainty in Artificial Intelligence, pp. 52–60 (1991)Google Scholar
- 6.Kohavi, R., Wolpert, D.: Bias Plus Variance Decomposition for Zero-One Loss Functions. In: Proceedings of the 13th International Conference on Machine Learning (ICML 1996). Morgan Kaufmann Publishers, San Francisco (1999)Google Scholar
- 7.Kontkanen, P., Myllymaki, P., Silander, T., Tirr, H.: On Supervised Selection of Bayesian Networks. In: Proceedings of the Fifteenth International Conference on Uncertainty in Artificial Intelligence (UAI 1999), pp. 334–342. Morgan Kaufmann Publishers, San Francisco (1999)Google Scholar
- 8.Quinlan, R.: C4.5 Programs for Machine Learning. Morgan Kaufmann Publishers, San Francisco (1993)Google Scholar
- 10.Roure, J., Sangüesa, R.: Incremental Methods for Bayesian Network Learning. Research Report LSI-99-42-R. Software Department. Technical University of Catalonia (1999)Google Scholar
- 11.Sahami, M.: Learning Limited Dependence Bayesian Classifiers. In: Proceedings of the Second International Conference on Knowledge Discovery and Data Mining, pp. 335–338. AAAI Press, Portland (1996)Google Scholar