Activation function
id:
activation-function-204-6698073
title:
Activation function
text:
The activation function of a node in an artificial neural network is a function that calculates the output of the node based on its individual inputs and their weights. Nontrivial problems can be solved using only a few nodes if the activation function is nonlinear. Modern activation functions include the smooth version of the ReLU, the GELU, which was used in the 2018 BERT model, the logistic (sigmoid) function used in the 2012 speech recognition model developed by Hinton et al, the ReLU used i
brand slug:
wiki
category slug:
encyclopedia
description:
Artificial neural network node function
original url:
https://en.wikipedia.org/wiki/Activation_function
date created:
2007-11-10T20:37:02Z
date modified:
2024-09-09T20:54:24Z
main entity:
{"identifier":"Q4677469","url":"https://www.wikidata.org/entity/Q4677469"}
image:
{"content_url":"https://upload.wikimedia.org/wikipedia/commons/8/88/Logistic-curve.svg","width":600,"height":400}
fields total:
13
integrity:
16