Capabilities and training of feedforward nets. Sontag, E. In Neural networks (New Brunswick, NJ, 1990), pages 303–321. Academic Press, Boston, MA, 1991.
abstract   bibtex   
This paper surveys recent work by the author on learning and representational capabilities of feedforward nets. The learning results show that, among two possible variants of the so-called backpropagation training method for sigmoidal nets, both of which variants are used in practice, one is a better generalization of the older perceptron training algorithm than the other. The representation results show that nets consisting of sigmoidal neurons have at least twice the representational capabilities of nets that use classical threshold neurons, at least when this increase is quantified in terms of classification power. On the other hand, threshold nets are shown to be more useful when approximating implicit functions, as illustrated with an application to a typical control problem.
@INCOLLECTION{MR1114761,
   AUTHOR       = {E.D. Sontag},
   BOOKTITLE    = {Neural networks (New Brunswick, NJ, 1990)},
   PUBLISHER    = {Academic Press},
   TITLE        = {Capabilities and training of feedforward nets},
   YEAR         = {1991},
   ADDRESS      = {Boston, MA},
   OPTCHAPTER   = {},
   OPTCROSSREF  = {},
   OPTEDITION   = {},
   OPTEDITOR    = {},
   OPTMONTH     = {},
   OPTNOTE      = {},
   OPTNUMBER    = {},
   PAGES        = {303--321},
   OPTSERIES    = {},
   OPTTYPE      = {},
   OPTVOLUME    = {},
   KEYWORDS     = {neural networks, neural networks},
   PDF          = {../../FTPDIR/90caip.pdf},
   ABSTRACT     = { This paper surveys recent work by the author on 
      learning and representational capabilities of feedforward nets. The 
      learning results show that, among two possible variants of the 
      so-called backpropagation training method for sigmoidal nets, both of 
      which variants are used in practice, one is a better generalization 
      of the older perceptron training algorithm than the other. The 
      representation results show that nets consisting of sigmoidal neurons 
      have at least twice the representational capabilities of nets that 
      use classical threshold neurons, at least when this increase is 
      quantified in terms of classification power. On the other hand, 
      threshold nets are shown to be more useful when approximating 
      implicit functions, as illustrated with an application to a typical 
      control problem. }
}

Downloads: 0