logo Idiap Research Institute        
 [BibTeX] [Marc21]
Optimal Setting of Weights, Learning Rate, and Gain
Type of publication: Idiap-RR
Citation: Thimm-97.2
Number: Idiap-RR-04-1997
Year: 1997
Institution: IDIAP
Abstract: The optimal setting of the initial weights, learning rate, and gain of the activation function, which are key parameters of a neural network, influencing training time and generalization performance, are investigated by means of a large number of experiments using ten benchmarks using high order perceptrons. The results are used to illustrate the influence of these key parameters on the training time and generalization performance and permit general conclusions to be drawn on the behavior of high order perceptrons, some of which can be extended to the behavior of multilayer perceptrons. Furthermore, optimal values for the learning rate and the gain of the activation function are found and compared to those recommended by existing heuristics.
Userfields: ipdmembership={learning}, nofpages={15},
Keywords: gain, generalization, high order perceptron, initial weights, learing rate, training time
Projects Idiap
Authors Thimm, Georg
Fiesler, Emile
Added by: [UNK]
Total mark: 0
  • rr97-04.pdf
  • rr97-04.ps.gz