I’ve never actually thought about this as a possible problem – there you go. When I do my early morning dog walking my pump lives on my belt under two down jackets (it’s bloody cold pre-dawn in the Pentland Hills!) so I presume it stays warm enough to keep functioning without any problems.
I guess if you were travelling round the Arctic then it might be more of a problem?