What's happening is that my instance of SQL Server Management Studio is losing its connection to our SQL Server after I open a new Query window.
The connection eventually (within a minute or so) returns, but then I need to re-use the db I'm running queries against in order for queries to work.