I’m using MS Excel 2000 v9.0 and I’m trying to calculate very large numbers. However, when I get into the 15 digit range the program starts to round the last 2 digits. I’d like to know why.
Try this: Format cells in column A to ‘Number’ with zero decimal places, and make it wide enough to fit about 16 digits. In cell A1 type a 1 In cell A2 type a 2 In cell A3 type this formula: =A2+A1, you should get a 3 Now copy that formula all the way to cell A75 You’ll see that the last digit in cell A71 is a 4, and the last digit in cell A72 is a 3. This should make the last digit in cell A73 a 7, but on my spreadsheet it is a zero. It has rounded 1,304,969,544,928,657 to 1,304,969,544,928,660. Why??????
It all depends on the mathematics. 15-digit precision is not very precise to be honest with you. Sure, it's more than enough precision to balance a checkbook and perform basic accounting calculations and such.
I thought Chris's point was fairly clear. While double precision is fine for checkbooks (unless you have 100 trillion or more dollars in it), it can be a problem in other circumstances.
One of my co-workers has run into this problem in his data-workup, and obviously Kendor was calculating large numbers for some purpose.
Kendor - If you need to calculate with greater precision, there are add-ins available. I have no idea how well any of them work, though.
My point of reasoning is that Excel is not limited by the types of tasks that can be performed within it. Excel is not just used to balance checkbooks, or perform basic accounting methods/calculations.
I, for one, would have used Excel extensively in Analytical Chemistry. Electron Capture Dissociation and Dissociation Constants are - for instance, upwards of 50 to 60 digits in precision. Excel is a very good tool, but I was left completely out in the woods.
My solution? I used Python, a high-level programming language. I was able to control what variable types I was using, and have program flow and control.
I'm with you Chris, Multiple percision arithmitic is an interisting topic.
Why would anyone want to calculate Pi to a million places. Not to many practical applications but its been done. ( Why - 'Cause it's there.)
Methos Wrote, "Interestingly, A74-A73 does give you exactly A72, so it appears to be a limitation in the display, but not actually the number in the memory."
Microsoft Works SS does the same thing. "Very interesting"
Mike b. (AKA Byter)
Posts: 1052 | Location: Sun Valley, Calif. :^þ | Registered: 06-03-02