A regularization term to avoid the saturation of the sigmoids in multilayer neural networks

DOI
10.1142/S0129065796000233
Serra-Ricart, M.; Gaitan, V.; Gomez, S.; Garrido, L.
Bibliographical reference

INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, Volume 7, 257, pp. 6

Advertised on:
7
1996
Number of authors
4
IAC number of authors
1
Citations
0
Refereed citations
0
Description
In this paper we propose a new method to prevent the saturation of any set of hidden units of a multilayer neural network. This method is implemented by adding a regularization term to the standard quadratic error function, which is based on a repulsive action between pairs of patterns.
Type
Refereed

It may interest you

  • Refereed
    An ultra-short-period super-Earth with an extremely high density and an outer companion
    We present the discovery and characterization of a new multi-planetary system around the Sun-like star K2-360 (EPIC 201595106). K2-360 was first identified in K2 photometry as the host of an ultra-short-period (USP) planet candidate with a period of 0.88 d. We obtained follow-up transit photometry, confirming the star as the host of the signal
    Livingston, John H. et al.

    Advertised on:

    11
    2024
    Bibcode
    2024NatSR..1427219L
    Citations
    0
  • Refereed
    The Galaxy Activity, Torus, and Outflow Survey (GATOS): V. Unveiling PAH survival and resilience in the circumnuclear regions of AGNs with JWST
    This study analyses JWST MIRI/MRS observations of the infrared (IR) polycyclic aromatic hydrocarbon (PAH) bands in the nuclear (∼0.4″ at 11 μm; ∼75 pc) and circumnuclear regions (inner ∼kpc) of local active galactic nuclei (AGNs) from the Galactic Activity, Torus, and Outflow Survey (GATOS). We examine the PAH properties in the circumnuclear
    García-Bernete, I. et al.

    Advertised on:

    11
    2024
    Bibcode
    2024A&A...691A.162G
    Citations
    0
  • Refereed
    Neural calibration of imaging Stokes polarimeters
    Current polarimetric calibration techniques derive the instrument modulation matrix by numerically fitting an instrumental model to measurements of a set of calibration Stokes vectors. These techniques are typically limited to an error on the retrieved normalized Stokes Q, U and V parameters, in the $1\times10^{-2}$ to $1\times10^{-3}$ range. This
    Iglesias, F. A. et al.

    Advertised on:

    8
    2024
    Bibcode
    2024BAAA...65..281I
    Citations
    0