You don't need a rudder... Just look at the B2 or other flying wing designs. Most don't have anything for a rudder.
https://en.wikipedia.org/wiki/Flying_wing
Granted, it still isn't well designed for atmospheric flying.
You also don't need elevators or canards... if you have suitable thrusters in place.