Working from pivot tables, which are a result in themselves, is the wrong way to approach any of this.

I recommend solving the problem using the data in the original tables and then pivoting the results if that's what you need for a final result. Think of it like any other code... keep the presentation layer separate from the other layers. Figure out the results first, the figure out how to display them. Life will be much easier across the board for this and similar problems.