How about
Weighted canards on the vehicle?
Launch horizontally, the canards will droop due to the weights, pitching the vehicle up.
Once the trajectory becomes vertical, the weights will no longer deflect the canards and the rocket will go straight up.
Will need some experimenting with the weights and limiters on the canards to give the turn radius large enough to clear the balloon but tight enough to make the turn while the motor is still going. Launch downwind, to make things easier.
Here is what I mean: http://www.ukimagehost.com/view/d92ea6d9cd0b9aba.jpg
Aerofoils at 60,000ft will generate less lift than at sea level density, so the canards will need to be scaled up accordingly.