A regularization term to avoid the saturation of the sigmoids in multilayer neural networks

DOI
10.1142/S0129065796000233
Serra-Ricart, M.; Gaitan, V.; Gomez, S.; Garrido, L.
Bibliographical reference

INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, Volume 7, 257, pp. 6

Advertised on:
7
1996
Number of authors
4
IAC number of authors
1
Citations
0
Refereed citations
0
Description
In this paper we propose a new method to prevent the saturation of any set of hidden units of a multilayer neural network. This method is implemented by adding a regularization term to the standard quadratic error function, which is based on a repulsive action between pairs of patterns.
Type
Refereed

It may interest you

  • Refereed
    A SART-Based Iterative Inversion Methodology to Infer the Solar Rotation Rate from Global Helioseismic Data
    We present a new iterative rotation inversion technique based on the Simultaneous Algebraic Reconstruction Technique developed for image reconstruction. We describe in detail our algorithmic implementation and compare it to the classical inversion techniques like the Regularized Least Squares (RLS) and the Optimally Localized Averages (OLA) methods
    Korzennik, Sylvain G. et al.

    Advertised on:

    6
    2024
    Bibcode
    2024SoPh..299...86K
    Citations
    0
  • Refereed
    TOI-837 b is a young Saturn-sized exoplanet with a massive 70 M<SUB>⊕</SUB> core
    We present an exhaustive photometric and spectroscopic analysis of TOI-837, a F9/G0 35 Myr young star, hosting a transiting exoplanet, TOI-837 b, with an orbital period of ~8.32 d. Utilizing data from the Transiting Exoplanet Survey Satellite and ground-based observations, we determine a planetary radius of $0.818_{-0.024}^{+0.034}$ R J for TOI-837
    Barragán, Oscar et al.

    Advertised on:

    7
    2024
    Bibcode
    2024MNRAS.531.4275B
    Citations
    0
  • Refereed
    Detailed cool star flare morphology with CHEOPS and TESS***
    Context. White-light stellar flares are proxies for some of the most energetic types of flares, but their triggering mechanism is still poorly understood. As they are associated with strong X and ultraviolet emission, their study is particularly relevant to estimate the amount of high-energy irradiation onto the atmospheres of exoplanets
    Alonso, R. et al.

    Advertised on:

    6
    2024
    Bibcode
    2024A&A...686A.239B
    Citations
    0