Patagonia Capilene 4 Hoody

"Is it because the fabric creates a bridge over the lumbar area and the fabric doesn't make contact with your skin?"

Yes,exactly. It just doesn't feel comfortable and I use a thin baselayer under it,despite losing some efficacy in the process.