Conversation

Notices

1. JordiGH (jordigh@mathstodon.xyz)'s status on Monday, 28-May-2018 15:04:56 UTC JordiGH

   Whoa, I'm used to numerical error, a fact of life. But I wasn't aware that Excel used a different kind of float than IEEE 754 floats. How is that code even written internally?

   https://en.wikipedia.org/wiki/Numeric_precision_in_Microsoft_Excel

   • Hallå Kitteh repeated this.
   • Hallå Kitteh (clacke@social.heldscal.la)'s status on Monday, 28-May-2018 15:14:09 UTC Hallå Kitteh

     in reply to
     @jordigh Painstakingly. :-)
     
     I wasn't aware of it either. Extra fun added when VBA most likely has IEE 754 floats rather than "[modified IEEE 754 of 1985]" floats.