If weight AND cost are not a factor, then DSLR/interchangeable lens cameras are the way to go. There are many options but you can pay anything from $1000 and up for something that will work better than a P&S. IF you are looking at something <$1000, you are probably looking at a perfectly good camera with a crappy kit lens. Until you upgrade to a better (and heavier) lens you'll have a setup that is inferior (in terms of image quality) to, say, a 10 oz Sony Cyber-shot DSC-RX100 III or other good fixed-lens camera.
I don't know why this is the case, but ever since the Sony R1 camera (in 2005 I think), Sony (and now Panasonic and maybe others) have been sticking super good lenses on $800 to $1000 fixed-lens cameras where the lens is actually better than an interchangeable lens alone for $1200. Makes no sense that I can see but it's true. The really recent trend now is to put bigger sensors in relatively small cameras (not yet APS-C but 1" and 4/3; look in Wiki if you want to learn the cryptic sensor size terms). So the fixed lens cameras are really stepping up. One theory I've read is that the P&S market is dead/dying due to phone cameras. But that has opened up a new niche for cameras that are light/small but produce good image quality (though of course less versatile than DSLR).
The best place for camera reviews and detailed information is http://www.dpreview.com/. [Edit: Oops! I see you've already been there…]
Two I'd recommend (from reviews/specs alone, I haven't tried them) would be Sony Cyber-shot DSC-RX100 III (10 oz; ~$800) and the new Panasonic Lumix DMC-LX100 (13 oz; ~$900). The former has been out longer and you can find posts on it here. If you want to pay less than $500 but have something 90% as good, find a used Sony Cyber-shot DSC-RX100 I or II.
On "getting away from P&S" photography, it isn't changing lenses that is going to help you so much. It's getting control of aperture/shutter/etc that will make a difference. For this, I'd recommend the Panasonic mentioned above. It has the brightest sensor/lens combo of anything under 1 lb, I think, meaning more depth control. But probably more important, it puts dedicated aperture and shutter speed controls on top of the camera where you will actually use them (and thus, learn to use them). It has some other control features that look really good, like easy aspect control. (In general, any feature that requires going into a menu won't get used and therefore might as well not exist.)
I'd guess that the Sony will give you better landscape images (due to more pixels), but Panasonic better "portrait" and creative style close images (due to brighter lens/sensor combo and better controls). Both are limited in zoom, but that's the price you pay for good image quality in a small package. There are many other factors and trade-offs to consider — no perfect solution exists.
One thing to consider is that you can rent these cameras (and many others) from http://www.lensrentals.com. (I'm considering that for JMT hike next summer so I won't have to buy anything or carry my current 60 oz rig.)
EDIT (after actually looking at camera suggested in thread title): Sensor size relative to small body size is good and is following current trend. We don't know anything about image quality so you should wait for DPReview info on that (I doubt it's as good as the Carl Zeiss or Leica lens you get with my two suggestions above). However, from what I can see in the picture of this camera, I'd say that you are definitely looking at a P&S shooting experience here. You simply won't use controls that aren't easily accessible on top. Carrying around 2 or 3 lenses won't help with that.
If you do go the interchangeable lens route, you should consider carefully the lens mount. There are excellent and cheaper 3rd-party lenses available for the long-established lens mounts: Canon, Nikon and Sony "A-mount" (inherited from Minolta). Sony created the newer "E mount" (for A6000, alpha7, etc) to facilitate smaller system without need to support old Minolta lenses. There is much less available for this new mount but I'd guess that Sony is serious about supporting it and that these will come over time. I'd worry that neither Samsung nor any one else will bother to develop very good lenses for the new Samsung mount, but I may be wrong…
The great thing about an interchangeable lens mount *that is well supported* is that you can rent a monster 600mm lens for something like $180 when you go on safari (rather than buying it for $thousands) and take pictures like this: https://500px.com/cwwhitfield.