Skip to main content
Springer Nature Link
Log in

A novel artificial bee colony optimization strategy-based extreme learning machine algorithm

  • Regular Paper
  • Published:
Save article
View saved research
Progress in Artificial Intelligence Aims and scope Submit manuscript

Abstract

Extreme learning machine (ELM) is a kind of single-hidden layer feedforward neural networks (SLFNs). Compared with traditional neural networks algorithms, ELM is simpler in structure with higher learning speed and better generalization performance. Due to generating randomly input weights and biases of ELM, there can exist some non-optimal or unnecessary input weights and biases. In addition, ELM can need more hidden nodes which can make ELM respond slowly to unknown testing data. Consequently, a new NABC-ELM algorithm, which is optimized by a novel artificial bee colony called NABC, is proposed. To improve generalization performance of ELM, the NABC is applied to optimize input weights and biases. In NABC, the Tent chaotic opposition-based learning method is applied to initialize the population. Meanwhile, the self-adaptive search strategy is presented in the employed bee and onlooker bee phase. In addition, the Tent chaotic local search for scout bee is implemented. Finally, experiments on some popular classification data sets demonstrate that the proposed NABC-ELM can consistently get better generalization performance than some existing ELM variants.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+
from €37.37 /Month
  • Starting from 10 chapters or articles per month
  • Access and download chapters and articles from more than 300k books and 2,500 journals
  • Cancel anytime
View plans

Buy Now

Price includes VAT (Netherlands)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
The alternative text for this image may have been generated using AI.

Similar content being viewed by others

Explore related subjects

Discover the latest articles, books and news in related subjects, suggested using machine learning.

References

  1. Jain, A.K., Mao, J.: Artificial neural networks: a tutorial. IEEE Comput. 29, 31–44 (1996)

  2. Siniscalchi, S.M., Svendsen, T., Lee, C.H.: An artificial neural network approach to automatic speech processing. Neurocomputing 140, 326–338 (2014)

    Article  Google Scholar 

  3. Dai, Q., Liu, N.: Alleviating the problem of local minima in backpropagation through competetive learning. Neurocomputing 94, 152–158 (2012)

    Article  Google Scholar 

  4. Cortes, C., Vapnik, V.N.: Support vector networks. Mach. Learn. 20, 273–297 (1995)

    MATH  Google Scholar 

  5. Huang, G.B., Zhu, Q.Y., Siew, C.K.: Extreme learning machine: theory and applications. Neurocomputing 70, 489–501 (2006)

    Article  Google Scholar 

  6. Huang, G.B., Ding, X., Zhou, H.: Optimization method based extreme learning machine for classification. Neurocomputing 74, 155–163 (2010)

    Article  Google Scholar 

  7. Li, L.N., et al.: A computer aided diagnosis system for thyroid disease using extreme learning machine. J. Med. Syst. 36(5), 3327–3337 (2012)

    Article  Google Scholar 

  8. Zhao, X., Wang, G., Bi, X., Gong, P., Zhao, Y.: XML document classification based on elm. Neurocomputing 74(16), 2444–2451 (2011)

    Article  Google Scholar 

  9. Kennedy, J., Eberhart, R.: Particle swarm optimization. In: IEEE Int. Conf. Neural Networks, pp. 1942–1948 (1995)

  10. Dorigo, M., Stutzle, T.: Ant colony optimization. MIT Press, Cambridge, MA (2004)

    MATH  Google Scholar 

  11. Tang, K.S., Man, K.F., Kwong, S., He, Q.: Genetic algorithms and their applications. IEEE Signal Process. Mag. 13, 22–37 (1996)

    Article  Google Scholar 

  12. Karaboga, D.: An idea based on honey bee swarm for numerical optimization. Technical Report-tr06, Erciyes University, Engineering Faculty, Computer Engineering Department (2005)

  13. Karaboga, D., Basturk, B.: On the performance of artificial bee colony (ABC) algorithm. Appl. Soft Comput. 8, 687–697 (2008)

    Article  Google Scholar 

  14. Karaboga, D., Basturk, B.: A comparative study of artificial bee colony algorithm. Appl. Math. Comput. 214, 108–132 (2009)

    MathSciNet  MATH  Google Scholar 

  15. Huang, Y.M., Lin, J.C.: A new bee colony optimization algorithm with idle-time-based filtering scheme for open shop-scheduling problems. Expert Syst. Appl. 38, 5438–5447 (2011)

    Article  Google Scholar 

  16. Karaboga, D., Ozturk, C., Karaboga, N., Gorkemli, B.: Artificial bee colony programming for symbolic regression. Inf. Sci. 209, 1–15 (2012)

    Article  Google Scholar 

  17. Shayeghi, H., Ghasemi, A.: A modified artificial bee colony based on chaos theory for solving non-convex emission/economic dispatch. Energy Convers. Manage 79, 344–354 (2014)

    Article  Google Scholar 

  18. Singh, A., Sundar, S.: An artificial bee colony algorithm for the minimum routing cost spanning tree problem. Soft Comput. 15, 2489–2499 (2011)

    Article  Google Scholar 

  19. Xiang, W.L., An, M.Q.: An efficient and robust artificial bee colony algorithm for numerical optimization. Comput. Oper. Res. 40, 1256–1265 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  20. Basturk, B., Karaboga, D.: A modified artificial bee colony algorithm for real-parameter optimization. Inf. Sci. 192, 120–142 (2012)

    Article  Google Scholar 

  21. Zhu, G., Kwong, S.: Gbest-guided artificial bee colony algorithm for numerical function optimization. Appl. Math. Comput. 217, 3166–3173 (2010)

    MathSciNet  MATH  Google Scholar 

  22. Gao, W.F., Liu, S.Y.: Improved artificial bee colony algorithm for global optimization. Inf. Process. Lett. 111, 871–882 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  23. Li, G., Niu, P., Xiao, X.: Development and investigation of efficient artificial bee colony algorithm for numerical function optimization. Appl. Soft Comput. 12, 320–332 (2012)

    Article  Google Scholar 

  24. Yurtkuran, A., Emel, E.: An adaptive artificial bee colony algorithm for global optimization. Appl. Math. Comput. 271, 1004–1023 (2015)

    MathSciNet  Google Scholar 

  25. Maeda, M., Tsuda, S.: Reduction of artificial bee colony algorithm for global optimization. Neurocomputing 148, 70–74 (2015)

    Article  Google Scholar 

  26. Gao, W.F., Huang, L.L., et al.: Artificial bee colony algorithm with multiple search strategies. Appl. Math. Comput. 271, 269–287 (2015)

    MathSciNet  Google Scholar 

  27. Shan, L., Qiang, H., Li, J., et al.: Chaotic optimization algorithm based on Tent map. Control Decis. 20(2), 179–182 (2005)

    MATH  Google Scholar 

  28. Rahnamayan, S., Tizhoosh, H.R., Salama, M.M.A.: Opposition versus randomness in soft computing techniques. Appl. Soft Comput. 8, 906–918 (2008)

    Article  Google Scholar 

  29. Alatas, B.: Chaotic bee colony algorithms for global numerical optimization. Expert Syst. Appl. 37, 5682–5687 (2010)

    Article  Google Scholar 

  30. Gao, W.F., Liu, S.Y.: A modified artificial bee colony algorithm. Comput. Oper. Res. 39, 687–697 (2012)

    Article  MATH  Google Scholar 

  31. Liao, X., Zhou, J.Z., et al.: An adaptive chaotic artificial bee colony algorithm for short-term hydrothermal generation scheduling. Electr. Power Energy Syst. 53, 34–42 (2013)

    Article  Google Scholar 

  32. Banharnsakun, A., Achalakul, T., Sirinaovakul, B.: The best-so-far selection in artificial bee colony algorithm. Appl. Soft Comput. 11, 2888–2901 (2011)

  33. Gao, W.F., Liu, S.Y., Huang, L.L.: Enhancing artificial bee colony algorithm using more information-based search equations. Inf. Sci. 270, 112–133 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  34. Bartlett, P.L.: The sample complexity of pattern classification with neural networks: the size of the weights is more important than the size of the network. IEEE Trans. Inf. Theory 44(2), 525–536 (1998)

    Article  MathSciNet  MATH  Google Scholar 

  35. Han, F., Yao, H.F., Ling, Q.H.: An improved evolutionary extreme learning machine based on particle swarm optimization. Neurocomputing 116, 87–93 (2013)

    Article  Google Scholar 

  36. Gao, W.F., Liu, S.Y., Huang, L.L.: Inspired artificial bee colony algorithm for global optimization problems. Acta Electron. Sin. 40(12), 2396–2403 (2012)

    Google Scholar 

  37. University of California, Irvine, Machine Learning Repository. http://archive.ics.uci.edu/ml/

Download references

Author information

Authors and Affiliations

  1. College of Information Science and Engineering, Northeastern University, Shenyang, 110004, People’s Republic of China

    Yang Wang, Anna Wang, Qing Ai & Haijing Sun

  2. School of Computer and Communication Engineering, Liaoning Shihua University, Fushun, 113001, People’s Republic of China

    Yang Wang

Authors
  1. Yang Wang
    View author publications

    Search author on:PubMed Google Scholar

  2. Anna Wang
    View author publications

    Search author on:PubMed Google Scholar

  3. Qing Ai
    View author publications

    Search author on:PubMed Google Scholar

  4. Haijing Sun
    View author publications

    Search author on:PubMed Google Scholar

Corresponding author

Correspondence to Yang Wang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, Y., Wang, A., Ai, Q. et al. A novel artificial bee colony optimization strategy-based extreme learning machine algorithm. Prog Artif Intell 6, 41–52 (2017). https://doi.org/10.1007/s13748-016-0102-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue date:

  • DOI: https://doi.org/10.1007/s13748-016-0102-4

Keywords