So the fix for me was to add a manual FakeKey to both data sources because you have to have at least 1 straight field a = field b mapping...