GPT-3

id: gpt-3-204-5555130
title: GPT-3
text: Generative Pre-trained Transformer 3 (GPT-3) is a large language model released by OpenAI in 2020. Like its predecessor, GPT-2, it is a decoder-only transformer model of deep neural network, which supersedes recurrence and convolution-based architectures with a technique known as "attention". This attention mechanism allows the model to focus selectively on segments of input text it predicts to be most relevant. GPT-3 has 175 billion parameters, each with 16-bit precision, requiring 350GB of sto
brand slug: wiki
category slug: encyclopedia
description: 2020 text-generating language model
original url: https://en.wikipedia.org/wiki/GPT-3
date created: 2020-07-31T21:39:45Z
date modified: 2024-09-09T21:06:15Z
main entity: {"identifier":"Q95726734","url":"https://www.wikidata.org/entity/Q95726734"}
image:
fields total: 13
integrity: 15

Related Entries

Explore Next Part