Entropy (information theory)
id:
entropy-information-theory-164-4978396
title:
Entropy (information theory)
text:
In information theory, the entropy of a random variable quantifies the average level of uncertainty or information associated with the variable's potential states or possible outcomes. This measures the expected amount of information needed to describe the state of the variable, considering the distribution of probabilities across all potential states. Given a discrete random variable X, which takes values in the set X and is distributed according to p : X → [ 0, 1 ], the entropy is H := − ∑ x ∈
brand slug:
wiki
category slug:
encyclopedia
description:
Expected amount of information needed to specify the output of a stochastic data source
original url:
https://en.wikipedia.org/wiki/Entropy_(information_theory)
date created:
2001-07-09T18:56:04Z
date modified:
2024-08-28T20:09:39Z
main entity:
{"identifier":"Q204570","url":"https://www.wikidata.org/entity/Q204570"}
image:
{"content_url":"https://upload.wikimedia.org/wikipedia/commons/d/d4/Entropy_flip_2_coins.jpg","width":1312,"height":768}
fields total:
13
integrity:
16