Attention (machine learning)
id:
attention-machine-learning-185-7753875
title:
Attention (machine learning)
text:
Attention is a machine learning method that determines the relative importance of each component in a sequence relative to the other components in that sequence. In natural language processing, importance is represented by "soft" weights assigned to each word in a sentence. More generally, attention encodes vectors called token embeddings across a fixed-width sequence that can range from tens to millions of tokens in size. Unlike "hard" weights, which are computed during the backwards training p
brand slug:
wiki
category slug:
encyclopedia
description:
Machine learning technique
original url:
https://en.wikipedia.org/wiki/Attention_(machine_learning)
date created:
2020-12-03T09:15:34Z
date modified:
2024-09-07T18:52:10Z
main entity:
{"identifier":"Q103701642","url":"https://www.wikidata.org/entity/Q103701642"}
image:
{"content_url":"https://upload.wikimedia.org/wikipedia/commons/6/62/Attention_mechanism_overview.svg","width":251,"height":187}
fields total:
13
integrity:
16