Ianto is just pre-empting the fact that half an hour from now he'll be complaining he's got cold ears and expect Ianto to do something about it.
In fairness to Jack though, it's hard to be dashing in a beanie. :)