RBarryYoung (12/9/2009)
As for the last part, you appaerntly overlooked applying the MAX(..) function in your calculations:According to the table from the above link, the result precision is: p1 - s1 + s2 + max(6, s1 + p2 + 1) = 38 - 10 + 10 + max(6, 10 + 38 + 1) = 38 + 49 = 87.
should be:
1: p1 - s1 + s2 + max(6, s1 + p2 + 1)
= 38 - 10 + 10 + max(6, 10 + 38 + 1)
= 38 + max(6, 49)
= 38 + 6
= 38 *(applying the rule of absolute 38 max)
and:
The result scale is: max(6, s1 + p2 + 1) = max(6, 10 + 38 + 1) = 49.
should be:
2: max(6, s1 + p2 + 1)
= max(6, 10 + 38 + 1)
= max(6, 49)
= 6
I beg to differ, RBarry. MAX() returns the maximum of the two values. So MAX(6,49) is 49.