Yeah this is one of the things i like about summer in the south.
Considerations: are you doing tent, tarp or shelter? Are you wearing convertible pants you can add the legs back on?
I've slept in a tent, with just a jacket, and no sleeping pad down to 65-68. Gets a little drafty around 2-4am.
If you use just the jacket, I'd bet you're going to end up curled up in the fetal position. Probably wake up a couple times due to drafts. If you sleep with a sheet or sleeping bag liner, you'll sleep much more stretched out. wake up less in the night.
Just be real sure with elevation and weather, the temp won't drop down into the 50s. 50s is where hyperthermia can become an issue.