DBRX

id: dbrx-319-9639933
title: DBRX
text: DBRX is an open-sourced large language model (LLM) developed by Mosaic ML team at Databricks, released on March 27, 2024. It is a mixture-of-experts Transformer model, with 132 billion parameters in total. 36 billion parameters are active for each token. The released model comes in either a base foundation model version or an instruct-tuned variant. DRBX outperforms other prominent open-source models such as Meta's LLaMA 2, Mistral AI's Mixtral, and xAI's Grok and close-sourced models such as GP
brand slug: wiki
category slug: encyclopedia
description: Open-sourced large language model
original url: https://en.wikipedia.org/wiki/DBRX
date created:
date modified: 2024-04-20T01:35:54Z
main entity:
image:
fields total: 13
integrity: 13

Related Entries

Explore Next Part