Re: "a pilot is also taught when it's safe to ignore the view outside"
When comparing with HUD's in military jets there are some key points to bear in mind:
A pilot is taught.
A pilot is trained.
And of course: A fraction of a percent of the population are deemed fit to even be taught or trained as a pilot (even fewer as pilot of a military aircraft with HUD). Once they have been selected for aptitude the training is then *rigorous* and even then not everyone makes it.
The threshold for obtaining a driving license is, shall we say, somewhat less arduous.
And I have to wonder, why do you "dearly like the idea of night driving with IR-enhanced HUD display showing me the road as if it were broad daylight" ?
So that you can drive along that road in dead of night AS IF it were broad daylight ? Good luck if your HUD glitches, or you happen to encounter a part of the map which isn't quite as accurate or up to date as you might like, while you are merrily tanking along reliant on it to keep you on the grey ribbon.