Re: Set the brightness to how you like it, depending on your setting
Generally ambient settings will be fine. However, there are possible improvements. For example, when I'm using my S5 to navigate I do need to ramp up the brightness manually. But there are other apps that can probably have the brightness dialled down even further. And I can imagine things like colour temperature (great if you've got an OLED screen) being set less rigidly than is currently the case (according to the clock).
All in all maybe nice to have but you probably (and probably shouldn't) notice.