Weight optimization in recurrent neural networks with hybrid metaheuristic cuckoo search techniques for data classification
Recurrent neural network (RNN) has been widely used as a tool in the data classification. This network can be educated with gradient descent back propagation. However, traditional training algorithms have some drawbacks such as slow speed of convergence being not definite to find the global minimum...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Published: |
Hindawi Publishing Corporation
2015
|
| Subjects: | |
| Online Access: | http://www.hindawi.com/journals/mpe http://www.hindawi.com/journals/mpe http://eprints.uthm.edu.my/7263/1/nazri_mohd_nawi_U.pdf |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Summary: | Recurrent neural network (RNN) has been widely used as a tool in the data classification. This network can be educated
with gradient descent back propagation. However, traditional training algorithms have some drawbacks such as slow speed of
convergence being not definite to find the global minimum of the error function since gradient descent may get stuck in local
minima. As a solution, nature inspired metaheuristic algorithms provide derivative-free solution to optimize complex problems.
This paper proposes a new metaheuristic search algorithm called Cuckoo Search (CS) based on Cuckoo bird’s behavior to train
Elman recurrent network (ERN) and back propagation Elman recurrent network (BPERN) in achieving fast convergence rate and
to avoid local minima problem. The proposed CSERN and CSBPERN algorithms are compared with artificial bee colony using
BP algorithm and other hybrid variants algorithms. Specifically, some selected benchmark classification problems are used. The
simulation results show that the computational efficiency of ERN and BPERN training process is highly enhanced when coupled
with the proposed hybrid method. |
|---|