in failover cluster manager, select the SQL service.

right click the server name select properties. possible owners are on the advanced policies tab. Untick the passive node.

don't remove the node from the cluster before patching.

edit - its not the same thing as preferred owners