I've leaned towards using polyester fill sleeping bags in the wet climate I live in. I haven't used down clothing for the same reason and I would soak it with sweat anyway, but it dawned on me that I wouldn't be hiking wih that kind of insulation on anyway. I have a down sweater that doesn't save me a bunch of weight, but it is much more compressible and delivers about three times the loft of something like a Patagonia Micro-Puff garment would. The revelation is that it is camp stuff and won't get sweaty bacuse I would be sitting still when wearing. I have good confidence that it won't get rain soaked if I pack it properly– in a waterproof stuff sack. My rain gear, wind shirt and wicking base layers can take care of the rest. For summer stuff, I'm still leaning to a light polyfill vest for weight and space saving.
My 2 cents.

