Goto

Collaborating Authors

 mixed-precision nvidia blog


Difference Between Single-, Double-, Multi-, Mixed-Precision NVIDIA Blog

#artificialintelligence

There are a few different ways to think about pi. As apple, pumpkin and key lime … or as the different ways to represent the mathematical constant of ℼ, 3.14159, or, in binary, a long line of ones and zeroes. An irrational number, pi has decimal digits that go on forever without repeating. So when doing calculations with pi, both humans and computers must pick how many decimal digits to include before truncating or rounding the number. In grade school, one might do the math by hand, stopping at 3.14.


Difference Between Single-, Double-, Multi-, Mixed-Precision NVIDIA Blog

#artificialintelligence

There are a few different ways to think about pi. As apple, pumpkin and key lime … or as the different ways to represent the mathematical constant of ℼ, 3.14159, or, in binary, a long line of ones and zeroes. An irrational number, pi has decimal digits that go on forever without repeating. So when doing calculations with pi, both humans and computers must pick how many decimal digits to include before truncating or rounding the number. In grade school, one might do the math by hand, stopping at 3.14.