Precision (computer science)
id:
precision-computer-science-253-15217846
title:
Precision (computer science)
text:
In computer science, the precision of a numerical quantity is a measure of the detail in which the quantity is expressed. This is usually measured in bits, but sometimes in decimal digits. It is related to precision in mathematics, which describes the number of digits that are used to express a value. Some of the standardized precision formats are Half-precision floating-point format
Single-precision floating-point format
Double-precision floating-point format
Quadruple-precision floating-point
brand slug:
wiki
category slug:
encyclopedia
description:
original url:
https://en.wikipedia.org/wiki/Precision_(computer_science)
date created:
date modified:
2023-08-26T06:36:37Z
main entity:
{"identifier":"Q962365","url":"https://www.wikidata.org/entity/Q962365"}
image:
fields total:
13
integrity:
13