Danger is often in the eyes of the beholder. What could happen?
If the weather is filthy, yes, you could be at some risk. Unwise.
If the weather is really fine, just cold, the worst that could happen is that you might be cold all night. I had better add here that cold nights can feel rather long … You could take some warm clothing and tough it out, with the knowledge that it is only one night and it isn't too far to your car or whatever.
If the weather is cold and windy, it is really going to depend on your shelter. If you only have a small tarp, things are going to be a bit drafty and miserable. That's not so clever. Wind can be bad.
If you have something which can block the wind reasonably well, it is another matter. There are quite a few people here who have made hot drinks or done 20 crunches at 3 am to get warm. Then had a wonderful sunrise.
One thing to consider: take a good mat, a warm hat and warm socks. If what you are lying on is cold, life is grim. But a warm mat underneath and a warm head makes a huge amount of difference.
Cheers