I've been browsing LowEndBox and found a good deal with vpshostingservice.co. The problem is that I've never heard of them before so I'm wondering if the deal is too good to be true.
If you search for vpshostingservice.co/cheapwindowsvps.com (same service) on lowendbox, you'll find a range of opinions. For non-critical use, it seems fine to me. But if you think that deal is too good to be true, you should browse more of the holiday deal threads on there, especially on black friday. It's a decent deal, just not exceptional.
Some of the best deals on Low End Box come in a fair bit cheaper than that. Not so long ago there were truly low-end deals on OpenVZ in the realm of $1-$2 per month, and I've seen Racknerd servers for $20 a year. If you're going to pay $5/mo you could get Linode/Akamai, Digital Ocean, Vultr, etc. It all depends what you want specs-wise and what your risk appetite is - the lower-end / newer players might be less reliable than the more established ones, use older hardware, or have additional AUP restrictions on them. It's a matter of matching your needs carefully with what you are buying.