Yeah, you can create the table variables into the In-Memory storage and it really does speed them up a bunch. I wouldn't recommend it for general use for all the reasons you list. However, if you're hitting recompile issues, stuff like that, where table variables MIGHT be useful, then implementing them using In-Memory makes them a lot less painful.
Cool. Thanks for the lessons, Grant.