If I'm using my hands in a rescue situation I'm not thinking about the temperature and neither are my hands.
I've never found gloves that keep me warm enough and they all suck when rope handling and working with gear so you take them off anyway. Pogies keep my hands warm while on the water to it takes a long time for my hands to get cold after taking my hands off the paddle.
I even started using pogies on my raft paddle. I've even converted a dude I raft with to their voodoo now.