Abstract—This paper focuses on reducing the interference effect among input attributes. When training different attributes together, there may exist negative effect among them due to interference. To reduce the interference, input attributes are placed into different groups such that attributes with no interference with each other are placed in the same group. Two types of grouping strategies are examined in this paper, i.e. non-overlapping and overlapping. To further enhance the performance, multiple learners are employed to tackle different groups. Three integration methods i.e. voting, weighting and result-integration network (RIN) are examined. It turns out that the result-integration network has the best performance, followed by weighting and then voting. The ensemble approach can improve the performance of neural-network learning. Such an approach also can be employed with feature selection to further enhance the performance.
Index Terms—Interference, neural network, ensemble learning, grouping.
Meihua Li and Sheng-Uei Guan are with School of Electronic and Information Engineering, Xi’an Jiaotong University, Xi’an, China, (e-mail: Steven.Guan@ xjtlu.edu.cn; lmh270341819@yahoo.com.cn)
Linfan Zhao and Weifan.Li are with Department of Computer Science and Software Engineering, Xi’an Jiaotong-Liverpool University, Suzhou, China (e-mail: Linfan.Zhao10@.student.xjtlu.edu.cn; Linfan.Zhao10@.student.xjtlu.edu.cn).
Cite:Meihua Li, Sheng-Uei Guan, Linfan Zhao, and Weifan Li, "Learning of Neural Network with Reduced Interference – An Ensemble Approach," International Journal of Machine Learning and Computing vol.2, no. 6, pp. 786-790, 2012.