For $8.95/month you can get a small 512 MB OpenVZ server at
XenLayer.com - 1000 GB datatransfer, root access, a control panel and management comes with that. This includes periodical updates, checkups and optimizing your VPS for maximum performance with more abilities and security than on shared hosting.