Practice makes perfect. I said the same thing when I started, I always had to have my gloves off and all that but when it's 5 degres outside i like feeling my fingers so the gloves are staying on. I've learned how to blow it with one hand and with gloves now. Practice, Practice.
No, I'm not a good shot, but I shoot often.