I am unfortunately not seeing the same behavior when using your sample data and setting the "Summarize By" option in Power Pivot to "Average".

I'd recommend that you check the following:

Data Types - Ensure that they are decimals and that rounding is not causing the error.

Calculated Field - If your "Overall Score" attribute is already a calculation of averages, you cannot calculate the average of averages...it will result in incorrect values.