Why are value converted to floats in a strange way? [Solved]

[EddyG]

It seems that value's are converted to floats in a strange way.

Code: Select all

Woonkamer Temperatuur: 21.200000762939

This value is in the database and display 21.2
Why is that?

[ronaldbro]

That's because of the precision of the data type. You will see the same in Excel when you show a lot of decimals.

You can use string.format to specify how many decimals you want.
Try string.format("%.0f", 21.200000762939)

[waaren]

It seems that value's are converted to floats in a strange way.

Code: Select all

Woonkamer Temperatuur: 21.200000762939

This value is in the database and display 21.2
Why is that?

Short explanation:

because of the way the underlying platform handles floating point numbers, and ultimately with the inaccuracy you’ll always have when writing down numbers as a string of a fixed number of digits.

Long explanation

wiki Floating point

[EddyG]

Tnx, That explains a lot.