• RBarryYoung (12/9/2009)


    As for the last part, you appaerntly overlooked applying the MAX(..) function in your calculations:

    According to the table from the above link, the result precision is: p1 - s1 + s2 + max(6, s1 + p2 + 1) = 38 - 10 + 10 + max(6, 10 + 38 + 1) = 38 + 49 = 87.

    should be:

    1: p1 - s1 + s2 + max(6, s1 + p2 + 1)

    = 38 - 10 + 10 + max(6, 10 + 38 + 1)

    = 38 + max(6, 49)

    = 38 + 6

    = 38 *(applying the rule of absolute 38 max)

    and:

    The result scale is: max(6, s1 + p2 + 1) = max(6, 10 + 38 + 1) = 49.

    should be:

    2: max(6, s1 + p2 + 1)

    = max(6, 10 + 38 + 1)

    = max(6, 49)

    = 6

    I beg to differ, RBarry. MAX() returns the maximum of the two values. So MAX(6,49) is 49.