Hybridizing PSO With SA for Optimizing SVR Applied to Software Effort Estimation

Dinda Novitasari, Imam Cholissodin, Wayan Firdaus Mahmudy

Abstract


This study investigates Particle Swarm Optimization (PSO) hybridization with Simulated Annealing (SA) to optimize Support Vector Machine (SVR). The optimized SVR is used for software effort estimation. The optimization of SVR consists of two sub-problems that must be solved simultaneously; the first is input feature selection that influences method accuracy and computing time. The next sub-problem is finding optimal SVR parameter that each parameter gives significant impact to method performance. To deal with a huge number of candidate solutions of the problems, a powerful approach is required. The proposed approach takes advantages of good solution quality from PSO and SA. We introduce SA based acceptance rule to accept new position in PSO. The SA parameter selection is introduced to improve the quality as stochastic algorithm is sensitive to its parameter. The comparative works have been between PSO in quality of solution and computing time. According to the results, the proposed model outperforms PSO SVR in quality of solution

Keywords


particle swarm optimization; simulated annealing; support vector regression; feature selection; parameter optimization

Full Text:

PDF

References


Smola AJ, Scholkopf B. A Tutorial on Support Vector Regression. Statistics and Computing. 2004;14(3):199–222.

Wang W, Xu Z, Lu W, Zhang X. Determination of The Spread Parameter in the Gaussian Kernel For Classification and Regression. Neurocomputing. 2003;55:643–63.

Frohlich H, Chapelle O, Scholkopf B. Feature Selection for Support Vector Machines by Means of Genetic Algorithm. In: Proceedings 15th IEEE International Conference on Tools with Artificial Intelligence. 2003. p. 142–8.

Oliveira ALI. Estimation of software project effort with support vector regression. Neurocomputing. 2006;69(13-15):1749–53.

Braga PL, Oliveira ALI, Meira SRL. A GA-based Feature Selection and Parameters Optimization for Support Vector Regression Applied to Software Effort Estimation. In: Proceedings of the 2008 ACM Symposium on Applied Computing. Fortaleza, Ceará, Brazil: ACM; 2008. p. 1788–92.

Novitasari D, Cholissodin I, Mahmudy WF. Optimizing support vector regression using particle swarm optimization for software effort estimation. Submitted to: IAENG International Journal of Computer Science. 2015;

Shi Y, Eberhart RC. Empirical study of particle swarm optimization. In: Proceedings of the 1999 Congress on Evolutionary Computation-CEC99. 1999. p. 1945–50.

Locatelli M. Convergence properties of simulated annealing for continuous global optimization. Journal of Applied Probability. 1996;33(4):1127–40.

Novitasari D, Cholissodin I, Mahmudy WF. Optimizing SVR using Local Best PSO for Software Effort Estimation. In: Submitted to: International Conference on Information Technology Systems and Innovation (ICITSI), November, 16-17. Bandung-Bali, Indonesia; 2015.

Shieh H-L, Kuo C-C, Chiang C-M. Modified particle swarm optimization algorithm with simulated annealing behavior and its numerical verification. Applied Mathematics and Computation. Elsevier Inc.; 2011;218(8):4365–83.

Vijayakumar S, Wu S. Sequential Support Vector Classifiers and Regression. In: Proceedings of International Conference on Soft Computing (SOCO ‘99). 1999. p. 610–9.

Kennedy J, Eberhart R. Particle Swarm Optimization. In: Proceedings of IEEE International Conference on Neural Networks. Piscataway, NJ; 1995. p. 1942–8.

Shi Y, Eberhart R. A Modified Particle Swarm Optimizer. In: 1998 IEEE International Conference on Evolutionary Computation Proceedings IEEE World Congress on Computational Intelligence. 1998. p. 69–73.

Kennedy J, Eberhart RC. A discrete binary version of the particle swarm algorithm. In: Proceedings of the World Miulticonference on Systemics, Cybernetics and Informatics. Piscataway, NJ; 1997. p. 4104–9.

Kirkpatrick S, Gelatt CD, Vecchi MP. Optimization by Simulated Annealing. Science. 1983;220(4598):671–80.

Metropolis N, Rosenbluth AW, Rosenbluth MN, Teller AH, Teller E. Equation of State Calculations by Fast Computing Machines. Journal of Chemical Physics. 1953;1087(21).

Mahmudy WF. Improved simulated annealing for optimization of vehicle routing problem with time windows ( VRPTW ). Kursor. 2014;7(3):109–16.

Guo Y. An Integrated PSO for Parameter Determination and Feature Selection of SVR and Its Application in STLF. In: Proceedings of the Eighth International Conference on Machine Learning and Cybernetics. Baoding; 2009. p. 12–5.

Sayyad Shirabad J, Menzies TJ. The PROMISE Repository of Software Engineering Databases [Internet]. School of Information Technology and Engineering, University of Ottawa, Canada. 2005 [cited 2015 Mar 5]. Available from: http://promise.site.uottawa.ca/SERepository




DOI: http://doi.org/10.12928/telkomnika.v14i1.2812

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

TELKOMNIKA Telecommunication, Computing, Electronics and Control
ISSN: 1693-6930, e-ISSN: 2302-9293
Universitas Ahmad Dahlan, 4th Campus
Jl. Ringroad Selatan, Kragilan, Tamanan, Banguntapan, Bantul, Yogyakarta, Indonesia 55191
Phone: +62 (274) 563515, 511830, 379418, 371120
Fax: +62 274 564604

View TELKOMNIKA Stats