My experience matches Piper's. If I tell people distances, they don't seem to have any sense of what that means. I wonder if a lot of people are wondering for a qualitative answer ("not far") or hoping for some unrealistically optimistic answer ("just around the corner").
I watch my watch a lot for many reasons, but it also allows me to give my version, "It took me 40 minutes." If there's a huge discrepancy between my fitness and their's, I might forego my time and estimate their's, especially if I've noted their pace as they approach me "at your pace, about 2 hours from here." That seems most useful if they are debating snacking, water, or just trying to pace themselves.

