So, you folks have me geeking out bringing up this topic. I hike in the PNW, and I've always packed everything in stuff sacks, being more than a little concerned about how dry my stuff stays. I've never had a wet kit, so I felt that this method, combined with a pack cover, worked pretty well. However, I remember Mary D mentioning long ago that she tests her stuff sacks every spring before setting out on the trails backpacking, and I've never done that–thought it sounded like a good idea.
So, I have both Zpacks Cuben sacks, and MLD Cuben sacks. I also have a few Sea to Summit bags left over, some silnylon, some heavier–possibly PU?
The first test I did, I filled the sacks with water, rolled down the tops 4 times, then put a little pressure on them. I did 1 Zpacks, 1 MLD, and 1 S2S silnylon. All 3 of them had a little water drip from the corners, and, all 3 had water squish through the roll-top closure and leak.
Huh, I thought, well, really, that's not a good real world test–when would the sacks ever need to hold water pressure? So, I took 3 more sacks–Zpacks, MLD, and a S2S PU bag. I put some dry paper towels in them, rolled the tops down 4 times, did not evacuate all the air from them, clicked the clips, and submerged them in a tub full of water (note to self, use warm water next time!). Each sack allowed air to escape the seal–all of them. they all deflated a little. However, when I opened the sack, the paper towels inside were dry, except for the MLD bag–but I held that one under the water the longest, and evacuated ALL the air through the roll top closure.
On the S2S PU bag, there is a tag, which states "This Sea to Summit Dry Sack is made from high performance water proof fabric, heat sealed tape seams with a roll down *watertight* closure. Use to keep contents dry in any wet situation where *the bag is not submerged.*"
So, neither test is really a good test of the bag's performance, and it is not realistic to expect air not to escape. All you really want, is that the bag sheds rain, does not allow seepage through the material, and preferably not to fall into creeks or go scuba diving with your backpack.
In writing with Joe Valesko on seam sealing my new Arc Blast ( I bought one of the older ones that didn't come with taped seams), I asked him if I could skip the stuff sacks now, as the backpack will be water-tight? He said that he didn't trust just one method to keep equipment dry, and would back up the seam sealing on the backpack with either a pack cover, or stuff sacks or pack liner, but not both a cover and roll-top bags.
I've always been a little uncomfortable with the notion of a roll-top backpack closure, and now I feel justified–would it really be water-tight in all day rain, or could pooling occur on top, and allow water to seep inside? If the pack-cover protects the roll-top closure, that might be enough. If the contents are protected inside by a second roll-top closure, it would be harder to seep through both–but, the bag on the bottom of the backpack, where leaking water might collect, had better not have the closure on the bottom, and probably shouldn't be placed inside the backpack sideways either.
I'm not sure what this means in terms of how I shall carry my gear in the future. I'm going to have to think it over–I like stuff sacks for the organization feature, have never liked carrying my gear loose inside a pack liner.