Vanishing gradient problem
id:
vanishing-gradient-problem-175-6577649
title:
Vanishing gradient problem
text:
In machine learning, the vanishing gradient problem is encountered when training neural networks with gradient-based learning methods and backpropagation. In such methods, during each iteration of training each of the neural networks weights receives an update proportional to the partial derivative of the error function with respect to the current weight. The problem is that as the network depth or sequence length increases, the gradient magnitude typically is expected to decrease, slowing the t
brand slug:
wiki
category slug:
encyclopedia
description:
Machine learning model training problem
original url:
https://en.wikipedia.org/wiki/Vanishing_gradient_problem
date created:
2014-08-08T02:05:51Z
date modified:
2024-09-03T02:25:23Z
main entity:
{"identifier":"Q18358230","url":"https://www.wikidata.org/entity/Q18358230"}
image:
fields total:
13
integrity:
15