Re: All this to avoid installing ssh and usable command line tools
SSH is not different from remote desktop - just you don't have a GUI but a character shell only on the remote machine.
Proper remoting is actually a different thing - you have a GUI or shell locally, and commands invoke a remote API to perform tasks.
The difference is that with a shell you have far broader access. With proper remoting, you can restrict more easily what someone can do on a remote machine. Just, proper remoting requires more effort to implement than a simple shell.