I'm normally a size medium and I used women's large GoLite Reed pants last season. They fit great (see avatar). The fit looks entirely unisex to me. No one would ever suspect they're ladies pants.

It is possible that GoLite's current offerings are more gender specific since they are moving more mainstream, hence their answer. I still don't think there can be a lot of 'gender' in rain pants though aside from color.