Performance Of Scaled Conjugate Gradient Algorithm In Face Recognition
A supervised learning algorithm (Scaled Conjugate Gradient, SCG) with superliner convergence rate is introduced. The algorithm is based upon a class of optimization techniques well known in numerical analysis as the Conjugate Gradient Methods. SCG uses second order information from the neural networ...
Saved in:
| Main Author: | |
|---|---|
| Format: | Monograph |
| Published: |
UTeM
2009
|
| Subjects: | |
| Online Access: | http://library.utem.edu.my:8000/elmu/index.jsp?module=webopac-d&action=fullDisplayRetriever.jsp&szMaterialNo=0000055153 http://library.utem.edu.my:8000/elmu/index.jsp?module=webopac-d&action=fullDisplayRetriever.jsp&szMaterialNo=0000055153 http://eprints.utem.edu.my/3902/1/Performance_Of_Scaled_Conjugate_Gradient_Algorithm_In_Face_Recognition_Mohd_Afzanizam_Bin_Hamdan_TA1650.M33_2009_-_24_Pages.pdf http://eprints.utem.edu.my/3902/2/Performance_Of_Scaled_Conjugate_Gradient_Algorithm_In_Face_Recognition_Mohd_Afzanizam_Bin_Hamdan_TA1650.M33_2009.pdf |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Summary: | A supervised learning algorithm (Scaled Conjugate Gradient, SCG) with superliner convergence rate is introduced. The algorithm is based upon a class of optimization techniques well known in numerical analysis as the Conjugate Gradient Methods. SCG uses second order information from the neural network but requires only (N) memory usage, where N is the number of weights in the network. The performance of SCG yields a speed-up of at least an order of magnitude relative to BP. The speed-up depends on the convergence criterion, i.e., the bigger demand for reduction in error the bigger the speed-up. SCG is fully automated including no user dependent parameters and avoids a time consuming line-search, which CGB and BFGS uses in each iteration in order to determine an appropriate step size. The smaller the complexity of the neural network relative to the problem domain, the bigger the possibility that the weight space contains long ravines characterized by sharp curvature. While BP is inefficient on these ravine phenomena, it is shown that SCG handles them effectively. |
|---|