OASIS Mailing List ArchivesView the OASIS mailing list archive below
or browse/search using MarkMail.

 


Help: OASIS Mailing Lists Help | MarkMail Help

 


 

   RE: [xml-dev] Avoiding roundoff errors in calculations?

[ Lists Home | Date Index | Thread Index ]

Financial calculations for example.  Plus, IEEE floats just plain give the
wrong answer sometimes.
Try 9/10/10, an from
http://www2.hursley.ibm.com/decimal/decifaq1.html#inexact


-----Original Message-----
From: Tim Bray [mailto:tbray@textuality.com] 
Sent: Friday, August 29, 2003 12:57 PM
To: Roger L. Costello
Cc: xml-dev@lists.xml.org
Subject: Re: [xml-dev] Avoiding roundoff errors in calculations?


Roger L. Costello wrote:

> What are your thoughts on this?  What techniques do people use to avoid
> introducing roundoff errors?  /Roger

Use FORTRAN, it supports REAL numbers, it says so right in the syntax :)

I'm curious; what applications require more precision than IEEE double? -Tim



-----------------------------------------------------------------
The xml-dev list is sponsored by XML.org <http://www.xml.org>, an
initiative of OASIS <http://www.oasis-open.org>

The list archives are at http://lists.xml.org/archives/xml-dev/

To subscribe or unsubscribe from this list use the subscription
manager: <http://lists.xml.org/ob/adm.pl>




 

News | XML in Industry | Calendar | XML Registry
Marketplace | Resources | MyXML.org | Sponsors | Privacy Statement

Copyright 2001 XML.org. This site is hosted by OASIS