Re: What is the point ?
I find it useful because it's got a static IP address, I can use it for VPN services and as an endpoint for my mail server (which redirects to my home system via other means where the ISP blocks port 25). It's a convenient remote web host, too, and a useful launch point for when I want to poke my own system from the outside. I used to host my websites with a provider who gave me an ssh shell as part of the package. With the VPS I get the whole machine to do what I want and host as many websites and back-end databases as I want.
However, it does mean you're responsible for your own security, so a bit of care in setting it up is required.