Home Forums SQL Server 2008 T-SQL (SS2K8) 6 places after decimal without rounding RE: 6 places after decimal without rounding

  • March 4, 2013 at 8:12 pm

    #1593264

    Considering that you're only working with 6 digits to begin with, consider transposing your formula for a smidgen more accuracy.

    UPDATE dbo.Analysis

    SET AccMargin = ((MArgin+Freight)/Gallons)

    Of course, since you're doing decimal division, you should as consider expanding the precision and scale of the calculation by doing as Dwain suggested with CAST and then round to the correct number of decimal places.

    --Jeff Moden

    RBAR is pronounced "ree-bar" and is a "Modenism" for Row-By-Agonizing-Row.
    First step towards the paradigm shift of writing Set Based code:
    ________Stop thinking about what you want to do to a ROW... think, instead, of what you want to do to a COLUMN.

    Change is inevitable... Change for the better is not.

    Helpful Links:
    How to post code problems
    How to Post Performance Problems
    Create a Tally Function (fnTally)